Skip to content

Commit

Permalink
Faster, less memory by caching dpo logprobs (#395)
Browse files Browse the repository at this point in the history
* by default cache dpo log probs

* make style quality

* handle epoch shuffling and resume

* ref log probs is successful
  • Loading branch information
vwxyzjn authored Oct 23, 2024
1 parent 476aab5 commit 91df2a6
Showing 1 changed file with 1,187 additions and 0 deletions.
Loading

0 comments on commit 91df2a6

Please sign in to comment.