These notes are based on the course CS336: Language Modeling at Stanford. They are meant to be a comprehensive resource for understanding the fundamentals of language modeling and large language models.

Course Overview

CS336 covers the foundations of language modeling, from tokenization to full fledge implementation of a modern LLM.