Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Multi lora cpu - testing PR checks (not going to merge) #2

Open
wants to merge 33 commits into
base: main
Choose a base branch
from
Open

Multi lora cpu - testing PR checks (not going to merge) #2

wants to merge 33 commits into from

Conversation

mosalov
Copy link

@mosalov mosalov commented Dec 17, 2024 •
edited by github-actions bot
Loading

No description provided.

Akshat-Tripathi and others added 12 commits December 11, 2024 12:48
@Akshat-Tripathi
Added Multi-LoRA implementation for the CPU backend
c8a8c5b 
Signed-off-by: Akshat Tripathi <[email protected]>
@Akshat-Tripathi
Readded final
3545ac1 
Signed-off-by: Akshat Tripathi <[email protected]>
@Akshat-Tripathi
Decoupled PunicaWrapperCPU from PunicaWrapperGPU
2b3c650 
Signed-off-by: Akshat Tripathi <[email protected]>
@Akshat-Tripathi
Fixed typing
cc0bd6c 
Signed-off-by: Akshat Tripathi <[email protected]>
@Akshat-Tripathi
Renamed lora op directories
dc9091a 
Signed-off-by: Akshat Tripathi <[email protected]>
@Akshat-Tripathi
Fixed tests
410b746 
Signed-off-by: Akshat Tripathi <[email protected]>
@Akshat-Tripathi
Merge branch 'main' into multi_lora_cpu
8eab6a6 
Signed-off-by: Akshat Tripathi <[email protected]>
@Akshat-Tripathi
Removed one-to-one correspondence between triton and torch ops
5dfcf62 
Signed-off-by: Akshat Tripathi <[email protected]>
@Akshat-Tripathi
Fixed mypy error
651dc04 
Signed-off-by: Akshat Tripathi <[email protected]>
@Akshat-Tripathi
Removed redundant optionals
d1026bb 
Signed-off-by: Akshat Tripathi <[email protected]>
@mosalov
Merge branch 'main' into multi_lora_cpu
2840445 
Signed-off-by: Oleg Mosalov <[email protected]>
@mosalov
Renamed add_input to add_inputs in punica_cpu.py.
41c518f 
Signed-off-by: Oleg Mosalov <[email protected]>
@github-actions GitHub Actions
Copy link

👋 Hi! Thank you for contributing to the vLLM project.
Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which starts running only a small and essential subset of CI tests to quickly catch errors. You can run other CI tests on top of those by going to your fastcheck build on Buildkite UI (linked in the PR checks section) and unblock them. If you do not have permission to unblock, ping simon-mo or khluu to add you in our Buildkite org.

Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging.

To run CI, PR reviewers can do one of these:

  • Add ready label to the PR
  • Enable auto-merge.

🚀

Akshat-Tripathi and others added 2 commits January 10, 2025 16:47
@Akshat-Tripathi
Updated compatibility docs
76444f4 
Signed-off-by: Akshat Tripathi <[email protected]>
@Akshat-Tripathi @Isotr0py
Update .buildkite/run-cpu-test.sh
64c700f 
Co-authored-by: Isotr0py <[email protected]>
Signed-off-by: Akshat Tripathi <[email protected]>
Akshat-Tripathi and others added 4 commits January 10, 2025 17:08
@Akshat-Tripathi
Lint
06399bc 
Signed-off-by: Akshat Tripathi <[email protected]>
@Akshat-Tripathi
Lint2
69eb3dc 
Signed-off-by: Akshat Tripathi <[email protected]>
@jeejeelee
Merge branch 'main' of https://github.com/vllm-project/vllm into mult…
e208468 
…i_lora_cpu
@jeejeelee
Reduce test memory
d8cb9af 
Signed-off-by: Jee Jee Li <[email protected]>
Akshat-Tripathi added a commit that referenced this pull request Jan 17, 2025
@Akshat-Tripathi
Merge pull request #2 from krai/punica_wrapper
eb331fc 
Create Pytorch wrapper for punica
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@mosalov @Akshat-Tripathi @jeejeelee