Skip to content

Commit

Permalink
FIX Dataset loaded twice in 4-bit finetuning script (#1164)
Browse files Browse the repository at this point in the history
lukaskuhn-lku authored Nov 22, 2023

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
1 parent 0ae52fe commit b4ac2d8
Showing 1 changed file with 0 additions and 5 deletions.
5 changes: 0 additions & 5 deletions examples/fp4_finetuning/finetune_fp4_opt_bnb_peft.py
Original file line number Diff line number Diff line change
@@ -131,11 +131,6 @@ def print_trainable_parameters(model):

"""### Training"""


data = load_dataset("Abirate/english_quotes")
data = data.map(lambda samples: tokenizer(samples["quote"]), batched=True)


data = load_dataset("Abirate/english_quotes")
data = data.map(lambda samples: tokenizer(samples["quote"]), batched=True)

0 comments on commit b4ac2d8

Please sign in to comment.