Skip to content
This repository has been archived by the owner on Dec 6, 2024. It is now read-only.

💡 [Question] - QwenCPP Python Binding 如何 支持 BLAS CPU 加速 #64

Open
micronetboy opened this issue Dec 15, 2023 · 2 comments
Open

💡 [Question] - QwenCPP Python Binding 如何 支持 BLAS CPU 加速 #64

micronetboy opened this issue Dec 15, 2023 · 2 comments
Assignees
@simonJJJ
Labels
question Further information is requested

Comments

@micronetboy
Copy link

起始日期 | Start Date

No response

实现PR | Implementation PR

No response

相关Issues | Reference Issues

No response

摘要 | Summary

QwenCPP Python Binding 如何 支持 BLAS CPU 加速

基本示例 | Basic Example

无

缺陷 | Drawbacks

无

未解决问题 | Unresolved questions

No response
@micronetboy micronetboy added the question Further information is requested label Dec 15, 2023
@micronetboy
Copy link
Author

micronetboy commented Dec 15, 2023 •
edited
Loading

python binding 如何设置 OpenBLAS 在CPU上加速？谢谢

python binding 如何设置 cuBLAS 在GPU上加速？谢谢

@micronetboy
Copy link
Author

llama-cpp-python 有如下的选项，qwen-cpp 是否有类似的选项？

On Linux and Mac you set the CMAKE_ARGS like this:

CMAKE_ARGS="-DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenBLAS" pip install llama-cpp-python

@jklj077 jklj077 transferred this issue from QwenLM/Qwen Dec 18, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@simonJJJ simonJJJ

Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@simonJJJ @micronetboy