Code

Quantized GGUF style#1523

Code

Merged

Narsil merged 10 commits intomainhuggingface/candle:mainfrom metal6huggingface/candle:metal6Copy head branch name to clipboardJan 17, 2024

+6,447-516

Commits

Commits on Jan 15, 2024

• Metal quantized modifications proposal.

  Show description for 9c4b4f0
  

  Nicolas Patry

  authored and

  Narsil

  committed
  9c4b4f0

  Copy full SHA for 9c4b4f0

• Cleanup.

  Narsil

  committed
  2cd1e59

  Copy full SHA for 2cd1e59

• Fix the rebase.

  Narsil

  committed
  61ad8d9

  Copy full SHA for 61ad8d9

• Removing the fences speeds everything up and *is* correct this time...

  Narsil

  committed
  c8c603c

  Copy full SHA for c8c603c

• Cleanup the fence.

  Narsil

  committed
  3aefc70

  Copy full SHA for 3aefc70

• After rebase.

  Narsil

  committed
  9ef0403

  Copy full SHA for 9ef0403

• Bad code removal.

  Narsil

  committed
  b2db5ad

  Copy full SHA for b2db5ad

• Rebase after phi2 merge + fix replit default to CPU.

  Narsil

  committed
  3dbf65e

  Copy full SHA for 3dbf65e

• Making the CI happy.

  Narsil

  committed
  f1b624c

  Copy full SHA for f1b624c

• More happy tests.

  Narsil

  committed
  1c0404a

  Copy full SHA for 1c0404a