Skip to content

Commit b2541a4

Browse files
authored
Specify dataset version used by funeTuning workload (#5736)(#5738)
To workaround this issue when loading dataset when running qloar fineTuning nf4 case: RuntimeError: Dataset scripts are no longer supported, but found viggo.py * set use_cache=False in LLama2 fineTuning case * fix datasets version to v3.6.0 in QLora fineTuning case
1 parent bea75b2 commit b2541a4

File tree

2 files changed

+3
-1
lines changed

2 files changed

+3
-1
lines changed

examples/gpu/llm/bitsandbytes/requirements.txt

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3,3 +3,4 @@ transformers==4.51.3
33
tf-keras
44
accelerate==1.1.1
55
peft==0.14.0
6+
datasets==3.6.0

examples/gpu/llm/fine-tuning/Llama2/llama2_ft.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -238,7 +238,8 @@ def train():
238238
model_args.model_name_or_path,
239239
cache_dir=custom_args.cache_dir,
240240
attn_implementation="sdpa" if model_args.use_flashattn else "eager",
241-
use_safetensors=False
241+
use_safetensors=False,
242+
use_cache=False
242243
# num_hidden_layers=1, # set only 1 decoder layer
243244
)
244245

0 commit comments

Comments
 (0)