Issue model.safetensors.index.json should exist with loading model in safetensors format

[LeMoussel]

When loading the model unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit, I have the error : AssertionError: model.safetensors.index.json should exist.

from airllm import AutoModel

model = AutoModel.from_pretrained("unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit")

Indeed in this model there is no file model.safetensors.index.json
The same goes for the model unsloth/Meta-Llama-3.1-70B-bnb-4bit
The file model.safetensors.index.json is present in the model unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit

[zeynepgulhanuslu]

I get the same error. Could you fix this?

[werruww]

I get the same error

[karanbhatia007]

Same error

[gokulcoder7]

same error

[gokulcoder7]

have you enabled cuda cores ?