Code

feat(mlx_lm)!: batch_generate#948

Code

Open

llllvvuu wants to merge 13 commits intoml-explore:mainml-explore/mlx-examples:mainfrom llllvvuu:feat/batch_generatellllvvuu/mlx-examples:feat/batch_generateCopy head branch name to clipboard

+264-70

Commits

Commits on Aug 29, 2024

• feat: support batch input in generate()

  Show description for 280b378
  llllvvuu

  committed
  280b378

  Copy full SHA for 280b378

• feat: show batch generation progress

  llllvvuu

  committed
  2caa832

  Copy full SHA for 2caa832

Commits on Oct 9, 2024

• Merge branch 'main' into feat/batch_generate

  llllvvuu

  committed
  8fb82fe

  Copy full SHA for 8fb82fe

• Merge branch 'main' into feat/batch_generate

  llllvvuu

  committed
  9ee726c

  Copy full SHA for 9ee726c

Commits on Oct 24, 2024

• Merge branch 'main' into feat/batch_generate

  llllvvuu

  committed
  ed73339

  Copy full SHA for ed73339

Commits on Dec 27, 2024

• WIP: most of the merge, minus llms/mlx_lm/utils.py

  Show description for 3082db0
  llllvvuu

  committed
  3082db0

  Copy full SHA for 3082db0

• update generate_step callsites

  llllvvuu

  committed
  a28ca03

  Copy full SHA for a28ca03

• fix test_generate

  llllvvuu

  committed
  cded149

  Copy full SHA for cded149

• implement batch_generate

  llllvvuu

  committed
  465eb79

  Copy full SHA for 465eb79

• mask dtype

  llllvvuu

  committed
  fdd16ca

  Copy full SHA for fdd16ca

• tweaks

  llllvvuu

  committed
  30e98c8

  Copy full SHA for 30e98c8

Commits on Dec 28, 2024

• dtype fix

  llllvvuu

  committed
  0894808

  Copy full SHA for 0894808

• format

  llllvvuu

  committed
  2541f13

  Copy full SHA for 2541f13