<aside>

📁 다운받은 폴더 위치

• Code:
• Checkpoint:
• Dataset: </aside>

참고자료

• https://www.amazon.com/Hands-Large-Language-Models-Understanding/dp/1098150961
  • https://product.kyobobook.co.kr/detail/S000216550234
• https://distill.pub/2016/augmented-rnns/
• https://jalammar.github.io/illustrated-transformer/
• 나동빈: Original Paper Link / Paper Review Video / Summary PDF / Code Practice
• https://poloclub.github.io/transformer-explainer/
  • https://www.youtube.com/watch?v=V5kAmFRwuxc
• https://wikidocs.net/156986
• Tensorflow
  • https://wikidocs.net/31379
  • https://velog.io/@jiyoung/Transformer-직접-구현하고-이해하기
  • https://velog.io/@jiyoung/Transformer-구현하고-이해하기2
• Pytorch Tutorials
  • https://docs.pytorch.org/docs/stable/generated/torch.nn.Transformer.html
  • https://docs.pytorch.org/tutorials/intermediate/char_rnn_classification_tutorial.html
  • https://docs.pytorch.org/tutorials/intermediate/seq2seq_translation_tutorial.html
  • https://docs.pytorch.org/tutorials/intermediate/char_rnn_generation_tutorial.html
  • https://github.com/pytorch/examples/tree/main/word_language_model

내용

<aside>

기존 한계점

핵심 아이디어

본 방법론의 한계점

</aside>