Skip to content

Commit

Permalink
Update 3B_qlora_single_device.yaml
Browse files Browse the repository at this point in the history
  • Loading branch information
krammnic authored Oct 25, 2024
1 parent 41b0012 commit c0e9645
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion recipes/configs/llama3_2/3B_qlora_single_device.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ loss:
epochs: 1
max_steps_per_epoch: null
gradient_accumulation_steps: 4
compile=False # pytorch compile, set to true for perf/memory improvement# set it to True for better memory and performance
compile: False # pytorch compile, set to true for perf/memory improvement# set it to True for better memory and performance

# Logging
output_dir: /tmp/lora_finetune_output
Expand Down

0 comments on commit c0e9645

Please sign in to comment.