Skip to content

Transformer built from scratch in PyTorch for educational purposes.

License

Notifications You must be signed in to change notification settings

ilyalasy/yet-another-transformer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

40 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

yet-another-transformer

Transformer build from scratch in PyTorch for educational purposes.

TODO List

  • Add trainer
  • Add decoding code
  • Train on wikitext dataset
  • Train seq2seq task on Friends dialog dataset (No significant results due to quality of the dataset)

About

Transformer built from scratch in PyTorch for educational purposes.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published