Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

replaceSystemMessage model config option #3787

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

ferenci84
Copy link

Description

#3786

A model config option, named "replaceSystemMessage" (self-descriptive), default false.

Behavior:
When true, the model's systemMessage property, or the config's root systemMessage property will replace the default hard-coded system message (Something like "When generating new code:\n\n1. Always produce a single code block.\n2. Never separate the code into multiple code blocks.\n3. Only include the code that is being added.\n4. Replace existing code with a "lazy" comment like this ...." and also "When using tools, follow the following guidelines:\n- Avoid calling tools unless they are absolutely necessary...")

Setting false or not setting at all, will keep the current behavior.

Minor change:
The existing behavior, that the model config's systemMessage has higher precedence than the root config's systemMesage, was not documented, I added that to make the information in the documentation more obvious about the new config.

Checklist

  • The relevant docs, if any, have been updated or created
  • The relevant tests, if any, have been updated or created

Screenshots

[ For visual changes, include screenshots. ]

Testing instructions

Testing replaceSystemMessage = true

  1. Create a systemMessage in the default Claude model config.
  2. Add replaceSystemMessage true in the model config.
  3. Send any message with the model
  4. Check the Continue LLM Prompt/Completion on the Output tab.
  5. The system message in the sent request should now be the just the one given in the model config.
  6. Remove the config and send the message again.
  7. The system message should be appended to the default one.

Copy link

netlify bot commented Jan 20, 2025

Deploy Preview for continuedev ready!

Name Link
🔨 Latest commit b058b60
🔍 Latest deploy log https://app.netlify.com/sites/continuedev/deploys/678e90c06ade1c0008036da5
😎 Deploy Preview https://deploy-preview-3787--continuedev.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant