Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When the pipelines service is restarted, the list of models in open-webui disappears. #111

Open
2 of 4 tasks
sabretus opened this issue Jun 21, 2024 · 5 comments
Open
2 of 4 tasks

Comments

@sabretus
Copy link

Bug Report

Description

Bug Summary:
When the pipelines service is restarted, the list of models in open-webui disappears.

Steps to Reproduce:
Everything works fine until the pipelines container is restarted. Then all models are gone from open-webui.

Expected Behavior:
Automatically reload the list of models

Actual Behavior:
I have to go to settings -> pipelines -> hit SAVE to load list of models

Environment

  • Open WebUI Version: 0.3.5

  • Open WebUI Pipelines Version: latest from master

  • Ollama (if applicable): none

  • Operating System: Ubuntu 22.04.4

Reproduction Details

Confirmation:

  • I have read and followed all the instructions provided in the README.md.
  • I am on the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.

Logs and Screenshots

No errors in logs

Installation Method

Service open-webui configured with pipelines (with litellm_manifold_pipeline.py) and connected to lightllm proxy. All are running in docker containers

@tjbck tjbck transferred this issue from open-webui/open-webui Jun 21, 2024
@bannert1337
Copy link

Do you have a volume mapping for pipelines?

@attilaszasz
Copy link
Contributor

@bannert1337, I experience the same problem. I have a volume mapping, but it's not the same as the open-webui volume. Should it be?

My volumes in docker-compose:

volumes:
  open-webui: {}
  pipelines: {}

@justinh-rahb
Copy link
Collaborator

justinh-rahb commented Aug 2, 2024

This is likely an issue from the pipeline code in question here not implementing the correct initialization/startup logic.

@attilaszasz
Copy link
Contributor

Yep, I fixed for the Google pipeline, the same fix should work here, but I don't use litellm to be able to test it.

@justinh-rahb
Copy link
Collaborator

justinh-rahb commented Aug 2, 2024

@attilaszasz thanks again for that, I've applied the same in #210 to fix LiteLLM manifold. Would appreciate if someone here would test that before merging. Nevermind, we YOLO-merge :P

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants