Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support failure handling with retries #43

Open
liana313 opened this issue Nov 25, 2024 · 2 comments
Open

support failure handling with retries #43

liana313 opened this issue Nov 25, 2024 · 2 comments
Assignees
Labels
feature request New feature or request

Comments

@liana313
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
Currently, LLM calls are best effort and may not to adhere to the right output (eg for filter, it's possible an LLM call doesn't return true or false)

Describe the solution you'd like
support retries or structured outputs for LLM calls

@liana313 liana313 added the feature request New feature or request label Nov 25, 2024
@abiswal2001 abiswal2001 self-assigned this Dec 2, 2024
@abiswal2001
Copy link

abiswal2001 commented Dec 2, 2024

Clarification: Is this issue specific to LLM filters? Which other LOTUS operators require specific structured outputs?

@liana313
Copy link
Collaborator Author

filter, joins, and top-k

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants