Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Better CoT / Prompting Strategy Support #50

Open
sidjha1 opened this issue Dec 13, 2024 · 1 comment · May be fixed by #75
Open

Better CoT / Prompting Strategy Support #50

sidjha1 opened this issue Dec 13, 2024 · 1 comment · May be fixed by #75
Assignees
@dhruviyer
Labels
feature request New feature or request

Comments

@sidjha1
Copy link
Collaborator

sidjha1 commented Dec 13, 2024

Is your feature request related to a problem? Please describe.
Currently the way CoT is implemented is not very bespoke, and it only exists for certain operators. Additionally, it requires few-shot demonstrations. It would be good to support zero-shot CoT and expand support to all possible operators.
@sidjha1 sidjha1 added the feature request New feature or request label Dec 13, 2024
@dhruviyer
Copy link
Collaborator

@sidjha1 this looks like an interesting one, do you have any pointers for what you'd want to see done? I see some basic CoT is already supported in the sem_filter and sem_map prompts. Two thoughts I had:

  1. Allow users to supplement with their own "reasoning" guidelines, like a tutorial that gets injected into the prompt
  2. Support CoT in all semantic operator prompts

Are there more advanced CoT techniques you wanted to explore?

@dhruviyer dhruviyer self-assigned this Jan 10, 2025
@dhruviyer dhruviyer linked a pull request Jan 10, 2025 that will close this issue
Composable scaffolding for CoT #75
Open
@dhruviyer dhruviyer linked a pull request Jan 15, 2025 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dhruviyer dhruviyer

Labels
feature request New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Composable scaffolding for CoT guestrin-lab/lotus
2 participants
@dhruviyer @sidjha1