Code

A specialized Winograd Conv2d op#971

Code

Draft

bssrdf wants to merge 23 commits intoggerganov:masterggerganov/ggml:masterfrom bssrdf:add-winograd-conv2dbssrdf/ggml:add-winograd-conv2dCopy head branch name to clipboard

+1,730-3

Commits

Commits on Sep 26, 2024

• added two winograd ops

  

  bssrdf

  committed
  5b4e448

  Copy full SHA for 5b4e448

Commits on Sep 27, 2024

• added more checking for precondition to use winograd; switch to im2co if not satisfied

  

  bssrdf

  committed
  68c251b

  Copy full SHA for 68c251b

• added source code for winograd kernel

  

  bssrdf

  committed
  2ccc67d

  Copy full SHA for 2ccc67d

• winograd build ok

  

  bssrdf

  committed
  02a3cb1

  Copy full SHA for 02a3cb1

• test now passed; for some reason, ggml_conv_2d didn't output correct results

  

  bssrdf

  committed
  3d80466

  Copy full SHA for 3d80466

• remove debugging printouts

  

  bssrdf

  committed
  893ca79

  Copy full SHA for 893ca79

Commits on Sep 28, 2024

• added a FP16 FX kernel to deal with fp16 filter data; no need to use FP32 buffer

  

  bssrdf

  committed
  6afbf6e

  Copy full SHA for 6afbf6e

Commits on Sep 29, 2024

• sync from sd.cpp

  

  bssrdf

  committed
  0491858

  Copy full SHA for 0491858

• restore test-conv2d.cpp test

  

  bssrdf

  committed
  93c3da7

  Copy full SHA for 93c3da7

• restore src/CMakeLists.txt

  

  bssrdf

  committed
  4e8e0d4

  Copy full SHA for 4e8e0d4

• change mask to unsigned int; add __restric__ to various pointers

  

  bssrdf

  committed
  e0e94c4

  Copy full SHA for e0e94c4

• fix indentation

  

  bssrdf

  committed
  c8700ca

  Copy full SHA for c8700ca

Commits on Oct 1, 2024

• skip if already computed in a preprocess step

  

  bssrdf

  committed
  c5d43a2

  Copy full SHA for c5d43a2

• added winograd conv2d to backend op tests

  

  bssrdf

  committed
  00ad37e

  Copy full SHA for 00ad37e

Commits on Oct 2, 2024

• add conv2d as a test case in test-backend-op

  

  bssrdf

  committed
  4f93d67

  Copy full SHA for 4f93d67

Commits on Dec 18, 2024

• further refine super tile size; implement a proper performance comparison

  

  bssrdf

  committed
  1d606ed

  Copy full SHA for 1d606ed

Commits on Dec 25, 2024

• fix test case

  

  bssrdf

  committed
  864e4a7

  Copy full SHA for 864e4a7

Commits on Dec 26, 2024

• changing #define macros to template arguments, step 1

  

  bssrdf

  committed
  2d10e24

  Copy full SHA for 2d10e24

• sync. winograd impl. from sd.cpp

  

  bssrdf

  committed
  86d7aa9

  Copy full SHA for 86d7aa9

Commits on Dec 30, 2024

• test performance for configs from sd.cpp

  

  bssrdf

  committed
  67ec285

  Copy full SHA for 67ec285

Commits on Jan 1, 2025

• refactor test-conv2d-winograd

  

  bssrdf

  committed
  d7103e3

  Copy full SHA for d7103e3

Commits on Jan 5, 2025

• add the missing ggml_gallocr_free(allocr)

  

  bssrdf

  committed
  3dbd324

  Copy full SHA for 3dbd324

Commits on Jan 6, 2025

• get rid of #defines by using template arguments

  

  bssrdf

  committed
  bf845d5

  Copy full SHA for bf845d5