nanogpt-lecture
Code created in the Neural Networks: Zero To Hero video lecture
nanogpt-lecture contains the code developed during the nanoGPT installment of Andrej Karpathy's Neural Networks: Zero to Hero lecture series. It is designed to accompany the video so students can inspect, modify, and rerun the implementation themselves. The repository begins with a simple character-level bigram language model and develops toward a GPT-style transformer. Its compact Python code exposes core ideas such as tokenization, embeddings, attention, transformer blocks, training, and...