Code

Vllm integration#14

Code

Merged

timvieira merged 37 commits intomainChiSym/genparse:mainfrom vllmChiSym/genparse:vllmCopy head branch name to clipboardJun 24, 2024

+1,468-53

Commits

Commits on Jun 19, 2024

• vllm inference

  lyutyuh

  committed
  e4dda7e

  Copy full SHA for e4dda7e

• vllm particle

  lyutyuh

  committed
  e5ff3de

  Copy full SHA for e5ff3de

Commits on Jun 20, 2024

• vllm base

  lyutyuh

  committed
  4e059a0

  Copy full SHA for 4e059a0

• more makefile cleanup

  

  benlipkin

  authored and

  lyutyuh

  committed
  d98994b

  Copy full SHA for d98994b

• Fix: Use the draw argument in proposal distributions and LM sampling methods.

  

  timvieira

  authored and

  lyutyuh

  committed
  0eafb43

  Copy full SHA for 0eafb43

• make smc-steer print out particle info when verbosity>0

  

  postylem

  authored and

  lyutyuh

  committed
  c92cec8

  Copy full SHA for c92cec8

• make smc-steer print out particle info when verbosity>0

  

  postylem

  authored and

  lyutyuh

  committed
  5e71fed

  Copy full SHA for 5e71fed

• tidying up

  

  timvieira

  authored and

  lyutyuh

  committed
  b283e08

  Copy full SHA for b283e08

• misc cleanups

  

  timvieira

  authored and

  lyutyuh

  committed
  ee1ff33

  Copy full SHA for ee1ff33

• fix: hf_tokenizers should use genparse.tokenization methods.

  

  timvieira

  authored and

  lyutyuh

  committed
  5bda0d8

  Copy full SHA for 5bda0d8

• tidy

  

  timvieira

  authored and

  lyutyuh

  committed
  e0a8467

  Copy full SHA for e0a8467

• refactor prompt formatter to be compatible with hf and vllm

  

  leo-du

  authored and

  lyutyuh

  committed
  95d07db

  Copy full SHA for 95d07db

• add script to evaluate spider on vllm

  Show description for 873b62f
  

  leo-du

  authored and

  lyutyuh

  committed
  873b62f

  Copy full SHA for 873b62f

• add vLLM setup instructions

  

  leo-du

  authored and

  lyutyuh

  committed
  2855191

  Copy full SHA for 2855191

• tidy

  

  timvieira

  authored and

  lyutyuh

  committed
  0e294df

  Copy full SHA for 0e294df

• whoops; forget to add file

  

  timvieira

  authored and

  lyutyuh

  committed
  db7849b

  Copy full SHA for db7849b

• ()

  

  timvieira

  authored and

  lyutyuh

  committed
  9c62b33

  Copy full SHA for 9c62b33

• new utils to simplify simplify instantiation of HFPPLSampler, loading models, and creating CFG guides (Issue #11)

  

  timvieira

  authored and

  lyutyuh

  committed
  385c9cf

  Copy full SHA for 385c9cf

• vllm inference

  lyutyuh

  committed
  b5e115f

  Copy full SHA for b5e115f

• vllm base

  lyutyuh

  committed
  988af54

  Copy full SHA for 988af54

• fix params

  lyutyuh

  committed
  01939d0

  Copy full SHA for 01939d0

• ignore

  lyutyuh

  committed
  505ff9f

  Copy full SHA for 505ff9f

• Merge branch 'main' into vllm

  lyutyuh

  committed
  7dd732f

  Copy full SHA for 7dd732f

• fixing p_next for vllm

  lyutyuh

  committed
  b1cddb3

  Copy full SHA for b1cddb3

• add vllm dependency

  lyutyuh

  committed
  ae08a64

  Copy full SHA for ae08a64

• mock llm pnext kwargs

  lyutyuh

  committed
  eee0efc

  Copy full SHA for eee0efc

• cleaning code and commenting

  lyutyuh

  committed
  bca561c

  Copy full SHA for bca561c

• Merge branch 'main' into vllm

  benlebrun

  authored
  dc48360

  Copy full SHA for dc48360

• vllm version

  lyutyuh

  committed
  8bf257c

  Copy full SHA for 8bf257c

• fix sample_next_token in token proposal duplication and return value of sample_next_token in vllm particle

  benlebrun

  committed
  ff5cf6c

  Copy full SHA for ff5cf6c

Commits on Jun 23, 2024

• fix multi particle

  lyutyuh

  committed
  44a9c9f

  Copy full SHA for 44a9c9f

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 7f4c9f1
  pre-commit-ci[bot]

  committed
  7f4c9f1

  Copy full SHA for 7f4c9f1

• formatting

  lyutyuh

  committed
  bb2766f

  Copy full SHA for bb2766f

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for fe1bccb
  pre-commit-ci[bot]

  committed
  fe1bccb

  Copy full SHA for fe1bccb

• benchmarking

  lyutyuh

  committed
  f7759b3

  Copy full SHA for f7759b3

• commenting

  lyutyuh

  committed
  db092e7

  Copy full SHA for db092e7

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 51e5133
  pre-commit-ci[bot]

  committed
  51e5133

  Copy full SHA for 51e5133