Stanford CS224N: NLP w/ DL | Spring 2024 | Lecture 12 - Efficient Training, Shikhar Murty

For more information about Stanford's online Artificial Intelligence programs, visit: https://stanford.io/ai This lecture covers: 1. Efficient Neural Network Training 2. Mixed Precision Training [20 mins] 3. Multi-GPU Training with DDP / FSDP [40 mins] 4. Parameter Efficient Finetuning: LoRA [20 mins] To learn more about enrolling in this course, visit: https://online.stanford.edu/courses/cs224n-natural-language-processing-deep-learning To follow along with the course schedule and syllabus, visit: hhttps://web.stanford.edu/class/archive/cs/cs224n/cs224n.1246/ Shikhar J. Murty Stanford University Computer Science PhD Candidate Professor Christopher Manning Thomas M. Siebel Professor in Machine Learning, Professor of Linguistics and of Computer Science Director, Stanford Artificial Intelligence Laboratory (SAIL)