New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DeepSeek-R1-Distill gibberish output on iOS (simulator-only) #116

Open

jhen0409 opened this issue Jan 25, 2025 · 0 comments

Labels

bug

Member

jhen0409 commented Jan 25, 2025

OK, I did see the issue with the model on iOS simulator (it skipped Metal), but it works on real device.

Also, the main issue seems be caused by llama.cpp, I can reproduce with -DGGML_METAL=OFF on llama-cli. I'll open another issue to track it.

Originally posted by @jhen0409 in #115

I was wrong in #110 (review) because I was only test it on a real device.

The text was updated successfully, but these errors were encountered:

jhen0409 added the bug label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment