Training GPT-2 From Scratch on a GTX1050
Author(s): malrsapps Originally published on Towards AI. Training GPT-2 From Scratch on a GTX1050 This project started with curiosity rather than a clear plan. I wanted to understand how language models were actually trained and whether it was possible to build and …