Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proposed configuration option for better control over hard-coded system messages #3786

Open
2 tasks done
ferenci84 opened this issue Jan 20, 2025 · 1 comment
Open
2 tasks done
Assignees
Labels
area:configuration Relates to configuration options kind:enhancement Indicates a new feature request, imrovement, or extension "needs-triage" priority:medium Indicates medium priority

Comments

@ferenci84
Copy link

Validations

  • I believe this is a way to improve. I'll try to join the Continue Discord for questions
  • I'm not able to find an open issue that requests the same enhancement

Problem

Problem: There are hard-coded system message and there is no way to override.

Why is it a problem:
Reason 1: Some models behave better if we do not add everything possible into the system message.
Reason 2: If the default system message is wrong (which is the case now, as it breaks code formatting), it would be easier to test a better version if there is a way to override
Reason 3: Developers are said to be smart, let's give them more control

Solution

There may be plenty of other solutions, this is just one of them:
A config option, named "replaceSystemMessage" (self-descriptive), default false. This would keep the default behavior as it is now, and let us configure the system message for each model separately.

I have already made the modification, pull request will be done in a moment.

@dosubot dosubot bot added area:configuration Relates to configuration options kind:enhancement Indicates a new feature request, imrovement, or extension priority:medium Indicates medium priority labels Jan 20, 2025
@ferenci84
Copy link
Author

ferenci84 commented Jan 20, 2025

I have already made a pull request. I'll continue to work on it based on suggestions.

#3787

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:configuration Relates to configuration options kind:enhancement Indicates a new feature request, imrovement, or extension "needs-triage" priority:medium Indicates medium priority
Projects
None yet
Development

No branches or pull requests

2 participants