Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for LiteLLM in inference job #818

Draft
wants to merge 4 commits into
base: main
Choose a base branch
from
Draft

Support for LiteLLM in inference job #818

wants to merge 4 commits into from
+1,053 −581

Conversation

njbrake
Copy link
Contributor

@njbrake njbrake commented Feb 6, 2025

What's changing

Provide a clear and concise description of the content changes you're proposing. List all the
changes you are making to the content.

  • Updated section...
  • Added new...
  • Removed outdated information from...
  • Fixed a typo in...
  • ...

If this PR is related to an issue or closes one, please link it here.

Refs #...
Closes #...

How to test it

Steps to test the changes:

Additional notes for reviewers

Anything you'd like to add to help the reviewer understand the changes you're proposing.

I already...

  • Tested the changes in a working environment to ensure they work as expected
  • Added some tests for any new functionality
  • Updated the documentation (both comments in code and product documentation under /docs)
  • Checked if a (backend) DB migration step was required and included it if required

@njbrake njbrake linked an issue Feb 6, 2025 that may be closed by this pull request
[FEATURE]: LiteLLM for LLM provider backends #475
Open
1 task
@github-actions github-actions bot added dependencies Pull requests that update a dependency file backend api Changes which impact API/presentation layer schemas Changes to schemas (which may be public facing) labels Feb 6, 2025
@njbrake njbrake self-assigned this Feb 6, 2025
@njbrake njbrake changed the base branch from main to brake/deletecompletions February 6, 2025 14:19
@github-actions github-actions bot added documentation Improvements or additions to documentation sdk labels Feb 6, 2025
Base automatically changed from brake/deletecompletions to main February 6, 2025 15:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@njbrake njbrake

Labels
api Changes which impact API/presentation layer backend dependencies Pull requests that update a dependency file documentation Improvements or additions to documentation schemas Changes to schemas (which may be public facing) sdk
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[FEATURE]: LiteLLM for LLM provider backends
1 participant
@njbrake