Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix conda env names in distribution example run files #461

Closed
wants to merge 2 commits into from

Conversation

hickeyma
Copy link
Contributor

@hickeyma hickeyma commented Nov 15, 2024

What does this PR do?

The Self-Hosted Distribution documentation contain steps to start llama server via conda environment. If the user generates the conda environment using llaama build command with --template flag, it generate an environment with name of the distribution and not default name of local as per the example run yaml files. It will therefore fail when user tried to run the server because the local conda env does not exist.

Error similar to the following:

$ llama stack run run.yaml

You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.
  warnings.warn(

EnvironmentNameNotFound: Could not find conda environment: llamastack-local
You can list all discoverable environments with `conda info --envs`.

This PR fixes the conda env names in the distribution example run yaml files.

The Self-Hosted Distribution documentation contain steps
to start llama server via conda environment. If the user
generates conda environment using llaama build command and template,
it generate an environment with name of the distribution and not
defaulyt name of local as per the example run yaml file. It
will thereore fail when user tried to run the server.

This PR fixes the conda env name in the run yaml file.

Signed-off-by: Martin Hickey <[email protected]>
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Nov 15, 2024
Fix formatting issue also.

Signed-off-by: Martin Hickey <[email protected]>
@hickeyma
Copy link
Contributor Author

Closing as fixed in 1fb6113

@hickeyma hickeyma closed this Nov 19, 2024
@hickeyma hickeyma deleted the fix-conda-env-names branch November 19, 2024 16:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Meta Open Source bot.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants