Stanford CS224N: NLP with Deep Learning | Spring 2024 | Lecture 11 - Benchmarking by Yann Dubois

For more information about Stanford's online Artificial Intelligence programs, visit: https://stanford.io/ai This lecture covers: 1. Different reasons for measuring performance 2. Text Classification / Close-ended 3. Text Generation / Open-ended a. Automatic Evaluation b. Human Evaluation 4. Current evaluations of LLMs 5. Issues and challenges with evaluations To learn more about enrolling in this course, visit: https://online.stanford.edu/courses/cs224n-natural-language-processing-deep-learning To follow along with the course schedule and syllabus, visit: hhttps://web.stanford.edu/class/archive/cs/cs224n/cs224n.1246/ Yann Dubois Stanford University PhD Student in Machine Learning Professor Christopher Manning Thomas M. Siebel Professor in Machine Learning, Professor of Linguistics and of Computer Science Director, Stanford Artificial Intelligence Laboratory (SAIL)