Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to Retrieve User Feedback (Thumbs Up/Down) from Open Web UI Pipelines for RLHF #222

Open
latent-variable opened this issue Aug 12, 2024 · 5 comments

Comments

@latent-variable
Copy link

I'm trying to figure out how to retrieve user feedback submitted via the thumbs up/thumbs down interface in the Web UI. Specifically, I need to know how to access this feedback data through the pipelines. Despite searching through the documentation and codebase, I haven't found clear instructions or examples on how to do this.

Can someone please provide guidance or point me to the relevant resources?

@pkeffect
Copy link

There is no user feedback. Those buttons are not used at the moment. They are for future use.

@latent-variable
Copy link
Author

@pkeffect thanks for the response, I will go ahead and close the issue now and track the progress of those features in the open webui

@latent-variable
Copy link
Author

latent-variable commented Aug 13, 2024

@pkeffect I did some digging. The feedback is being tracked,
open-webui/open-webui#1836
you can manually pull it using the export all chats features
"annotation":{"rating":-1,"reason":"Don't like the style","comment":""}

@pedroallenrevez
Copy link

Isn't there a way to have a hook in pipelines for each of the given feedback?

@RAPHCVR
Copy link

RAPHCVR commented Jan 9, 2025

I Also Would be very interested in this feature, being able to track that in a filter would be incredible (for example, langfuse rating)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants