Code

Add support for MatMulNBits#3496

Code

Merged

causten merged 8 commits intodevelopROCm/AMDMIGraphX:developfrom matmulnbitsROCm/AMDMIGraphX:matmulnbitsCopy head branch name to clipboardOct 10, 2024

+1,087

Commits

Commits on Sep 27, 2024

• Base case implementation

  music-dino

  committed
  e8809b0

  Copy full SHA for e8809b0

Commits on Oct 1, 2024

• Fix error in b input shape assumption, implement support for zero point input

  music-dino

  committed
  3267543

  Copy full SHA for 3267543

Commits on Oct 2, 2024

• Implement onnx verify tests for MatMulNBits

  music-dino

  committed
  1d1b8a3

  Copy full SHA for 1d1b8a3

• Refactor matmulnbits parser, implement onnx parse tests

  music-dino

  committed
  ebf438e

  Copy full SHA for ebf438e

• Implement negative parse tests for MatMulNBits

  music-dino

  committed
  cccb35a

  Copy full SHA for cccb35a

• Offload unpack_int4 to cpu during gpu lowering

  music-dino

  committed
  879176b

  Copy full SHA for 879176b

• Merge remote-tracking branch 'upstream' into matmulnbits

  music-dino

  committed
  4b0b4c2

  Copy full SHA for 4b0b4c2

• Fix clang-tidy issues, change type for attribute variables

  music-dino

  committed
  ffc5304

  Copy full SHA for ffc5304