Access to metadata of the underlying model #953
Unanswered
shadowfaxproject
asked this question in
Q&A
Replies: 1 comment 1 reply
-
I'd be interested to know if this is possible as well. That way, we can have a program that changes our preset prompt formats based on the type of model, since some models use whereas others use [INST]. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Is there a way to access (print) metadata such as
general.name
ormodel type
from the python code when using llama-cpp-python. I am able to access the standard params provided by the user but not the core metadata of the model.Beta Was this translation helpful? Give feedback.
All reactions