Code

✨ vLLM Backend integration#42

Code

Open

parfeniukink wants to merge 19 commits intoparfeniukink/features/deepsparse-backendneuralmagic/guidellm:parfeniukink/features/deepsparse-backendfrom parfeniukink/features/vllm-backendneuralmagic/guidellm:parfeniukink/features/vllm-backendCopy head branch name to clipboard

+486-84

Commits

Commits on Aug 30, 2024

• 🚚 Better naming is provided

  Show description for 5e93c1f
  

  Dmytro Parfeniuk

  committed
  5e93c1f

  Copy full SHA for 5e93c1f

• ✨ vllm backend integration is added

  Show description for cea679e
  

  Dmytro Parfeniuk

  committed
  cea679e

  Copy full SHA for cea679e

• ✅ vllm tests are skipped if platform is not Linux

  

  Dmytro Parfeniuk

  committed
  440d4be

  Copy full SHA for 440d4be

• 📌 vLLM python version is increased to 3.12

  

  Dmytro Parfeniuk

  committed
  1a715a6

  Copy full SHA for 1a715a6

• 📌 vllm dependency is skipped if platform IS NOT Linux

  

  Dmytro Parfeniuk

  committed
  14f4c42

  Copy full SHA for 14f4c42

Commits on Sep 2, 2024

• 🚧 WIP

  

  Dmytro Parfeniuk

  committed
  6e30870

  Copy full SHA for 6e30870

• 🚧 WIP

  

  Dmytro Parfeniuk

  committed
  b0c0acb

  Copy full SHA for b0c0acb

• dummy.data.openai is removed

  

  Dmytro Parfeniuk

  committed
  9f431ea

  Copy full SHA for 9f431ea

Commits on Sep 4, 2024

• WIP Docker tests

  

  Dmytro Parfeniuk

  committed
  832b316

  Copy full SHA for 832b316

• removed tmp file

  

  Dmytro Parfeniuk

  committed
  3d8c80f

  Copy full SHA for 3d8c80f

Commits on Sep 6, 2024

• Dockerfile remove COPY

  

  Dmytro Parfeniuk

  committed
  7836d45

  Copy full SHA for 7836d45

Commits on Sep 9, 2024

• 🚧 WIP

  

  Dmytro Parfeniuk

  committed
  defe53d

  Copy full SHA for defe53d

• dockerfile is improved

  

  Dmytro Parfeniuk

  committed
  9071358

  Copy full SHA for 9071358

• tests are comlete

  

  Dmytro Parfeniuk

  committed
  59e4cc6

  Copy full SHA for 59e4cc6

• docker testing guide is added

  

  Dmytro Parfeniuk

  committed
  bd76806

  Copy full SHA for bd76806

• 💚 Code quality is provided

  

  Dmytro Parfeniuk

  committed
  92c8819

  Copy full SHA for 92c8819

• Dockefile improved. Removed unused parts

  

  Dmytro Parfeniuk

  committed
  e25be2f

  Copy full SHA for e25be2f

Commits on Sep 10, 2024

• ✅ tests are fixed

  

  Dmytro Parfeniuk

  committed
  809694c

  Copy full SHA for 809694c

• 🐳 --platform is removed from Dockerfile

  

  Dmytro Parfeniuk

  committed
  78b78ed

  Copy full SHA for 78b78ed