Skip to content

Commit

Permalink
Update QAT: add grad clipping, torch.compile, collate fn
Browse files Browse the repository at this point in the history
**Summary:** Update the qat_distributed recipe to match the
full_finetune_distributed recipe. This commit adds features to
QAT like gradient clipping, torch.compile, and user configurable
collate function for data pre-processing.

**Test Plan:** TBD
  • Loading branch information
andrewor14 committed Nov 1, 2024
1 parent f560cbb commit bb0cc85
Showing 1 changed file with 231 additions and 73 deletions.
Loading

0 comments on commit bb0cc85

Please sign in to comment.