Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Why use the NT computation method in mul mat operator? #1108

Open
huanglsh opened this issue Feb 9, 2025 · 1 comment
Open

Why use the NT computation method in mul mat operator? #1108

huanglsh opened this issue Feb 9, 2025 · 1 comment

Comments

@huanglsh
Copy link

huanglsh commented Feb 9, 2025

@ggerganov Hi, I noticed that in the mul mat operator, GGML always uses the NT computation method, regardless of the BLAS backend or the CPU backend is used.

Is there a specific reason for this design?

Image Image
@ggerganov
Copy link
Member

What do you mean by "the NT computation method"?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ggerganov @huanglsh