Deepwatch

Courses, Stanford Online

Stanford CS336: Language Modeling from Scratch | Spring 2026

18 lectures, 24 hr 10 min in all

This course is designed to provide students with a comprehensive understanding of language models by walking them through the entire process of developing their own. Drawing inspiration from operating systems courses that create an entire operating system from scratch, we will lead students through every aspect of language model creation, including data collection and cleansing for pre-training, transformer model construction, model training, and evaluation before deployment. For more information about Stanford's online Artificial Intelligence programs, visit: https://stanford.io/ai Learn course details: https://online.stanford.edu/courses/cs336-language-modeling-scratch Visit the course website: https://cs336.stanford.edu/

0 of 18 watched

Start lecture 1
  1. 1
  2. 2
  3. 3
  4. 4
  5. 5
  6. 6
  7. 7
  8. 8
  9. 9
  10. 10
  11. 11
  12. 12
  13. 13
  14. 14
  15. 15
  16. 16
  17. 17
  18. 18