resources.md

Code completion with transformers

• https://arxiv.org/pdf/2402.16197

• https://arxiv.org/pdf/2202.13169

Transformer big idea:

• https://jalammar.github.io/illustrated-transformer/

Transformers: more granular

• https://github.com/sgrvinod/a-PyTorch-Tutorial-to-Transformers

Transformers implementation:

• https://github.com/hyunwoongko/transformer

• https://github.com/tunz/transformer-pytorch

  • This one is good because code is short and readable. Files are split up but not over-compartmentalized.

• Picture: https://miro.medium.com/v2/resize:fit:975/1*vrSX_Ku3EmGPyqF_E-2_Vg.png

• Also: https://cdn.prod.website-files.com/62528d398a42420e66390ef9/65cd0d82d6983755c129822a_Untitled.png