Skip to content

Issues: kvcache-ai/ktransformers

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

290 Open 136 Closed
290 Open 136 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

在运行main.py时报错：CUDA error: no kernel image is available for execution on the deviceCUDA kernel errors might be asynchronously reported at some other ApI call,
#579 opened Feb 21, 2025 by winni0
通过 Open-WebUI 使用 KTransformer
#578 opened Feb 21, 2025 by TTThanos
1
16G显卡游戏本能否用来加速ds-r1_32b推理速度
#576 opened Feb 21, 2025 by wjtxt
有没有windows部署成功的贴一下环境看看
#575 opened Feb 21, 2025 by Epic-W
A40显卡配置使用KLinearMarlin报错
#574 opened Feb 21, 2025 by evenking1
本地部署 deepseek-R1/Q4_K_M. eval rate:4.5tokens/s,想优化到15s/token.如何优化?
#573 opened Feb 21, 2025 by snailfrying
1
编译时提示没有设置环境变量CUDA_HOME，但无论是系统中还是conda虚拟环境中都已设置此变量
#572 opened Feb 21, 2025 by kenzining
1
Window 下编译错误
#571 opened Feb 21, 2025 by xialang2012
1
显卡可以用K80这种老卡不？虽然它跑ollama都很慢。。。
#569 opened Feb 21, 2025 by dingxmhan
1
使用DeepSeek-R1 Q4_K_M 模型回复结果很乱，是框架问题还是要换模型
#568 opened Feb 21, 2025 by Mararesliu
1
Chat开始后输入信息弹出报错，显示RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument index in method wrapper_CUDA__index_select)
#567 opened Feb 21, 2025 by JRZL123
请问下ktransformers是否支持跑蒸馏模型啊
#566 opened Feb 21, 2025 by xzd20132443
1
尝试兼容国产摩尔线程GPU的工作
#565 opened Feb 21, 2025 by yeungtuzi
After successful deployment, the chat does not work and the following error is reported：After successful deployment, the chat does not work and the following error is reported
#563 opened Feb 21, 2025 by CmyLjj
修改YAML文件，多GPU部署时的性能异常问题
#561 opened Feb 21, 2025 by VinayaLee
1
256GB内存，DeepSeek-R1-Q4_K_M可以正常运行，查看设备运行内存占用不正常？还有为什么不会报内存错误？
#560 opened Feb 21, 2025 by codedoves
1
内存占用低、推理速度慢、回答无显示
#559 opened Feb 21, 2025 by chiyan2022
6
在A40服务器上编译失败
#558 opened Feb 21, 2025 by cxmt-ai-tc
为什么需要两个模型才能运行
#557 opened Feb 21, 2025 by yimisiyang
10
Can I have a toy run example for Deepseek-R1?
#555 opened Feb 21, 2025 by MingyuQi1995
如何完整编译
#554 opened Feb 21, 2025 by cnsdzbhm
1
An error occurred when starting the API server in Docker and using the API locally
#553 opened Feb 20, 2025 by lililolo0927
cpu 13th Gen Intel(R) Core(TM) i9-13900K 支持 amx吗
#552 opened Feb 20, 2025 by liangpn
1
v0.3的dockerfile官方同学能上线吗
#551 opened Feb 20, 2025 by txg1550759
如何将gpu显卡性能发挥到最大
#549 opened Feb 20, 2025 by txg1550759
10
ProTip! What’s not been updated in a month: updated:<2025-01-21.