Skip to content

Fine-tune the recent Llama-2-7b model on a single GPU and turn it into a chatbot I will leverage PEFT library from Hugging Face ecosystem, as well as QLoRA for more memory efficient finetuning.

License

Notifications You must be signed in to change notification settings

DavidLanz/Llama2-Fine-Tuning-using-QLora

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Llama 2 Fine-Tuning using QLora

Welcome to this repo. that shows how to fine-tune the recent Llama-2-7b model on a single GPU and turn it into a chatbot.

About

Fine-tune the recent Llama-2-7b model on a single GPU and turn it into a chatbot I will leverage PEFT library from Hugging Face ecosystem, as well as QLoRA for more memory efficient finetuning.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published