Skip to content
#

nanogpt

Here are 165 public repositories matching this topic...

This repository contains the collection of explorative notebooks pure in python and in the language that we, humans can read. Have tried to compile all lectures from the Andrej Karpathy's 💎 playlist on Neural Networks - which we will end up with building GPT.

  • Updated Apr 30, 2024
  • Jupyter Notebook

A GPT built and trained in 243 lines of pure, dependency-free Python - no PyTorch, no NumPy. Based on Andrej Karpathy's microgpt, it hand-rolls autograd, attention and Adam to show how little a language model really needs.

  • Updated Feb 12, 2026
  • Python

免费 AI / 深度学习学习资料合集 + 学习笔记与代码 | A curated list of free AI & deep learning resources (ML, DL, RL, GNN, LLM, Transformer, Diffusion), plus study notes and code (nanoGPT, minimind, VAE).

  • Updated Oct 6, 2026
  • Jupyter Notebook

A 134M-parameter GPT written from scratch in PyTorch, no nn.Transformer and no HuggingFace, pretrained on a 7B tokens corpus of FineWeb-Edu, where it consumed 1.2B tokens on one free Kaggle P100. Held-out perplexity 36.12 against a Chinchilla prediction of 38.70.

  • Updated Sep 6, 2026
  • Jupyter Notebook

Add this topic to your repo

To associate your repository with the nanogpt topic, visit your repo's landing page and select "manage topics."

Learn more