Stanford CS25: V3 I Beyond LLMs: Agents, Emergent Abilities, Intermediate-Guided Reasoning, BabyLM

November 28, 2023 Steven Feng, Stanford University Div Garg, Stanford University Karan Singh, Stanford University In this talk, we will explore cutting-edge topics in the realm of AI, particularly focusing on going beyond a single monolithic Large Language Model (LLM) to Autonomous Agentic AI Systems, as well as discussing the emergent abilities of LLMs as they scale up. Further, there is discussion about different approaches for LLM intermediate-guided reasoning: methods of breaking down the reasoning process for text generation to arrive at a final answer (e.g. into a series of steps, such as chain-of-thought). Additionally, the talk will delve into a concept known as BabyLM, aimed at creating small yet highly efficient language models that can learn on similar amounts of training data as human children. This talk will not only highlight the technical aspects of these developments but also discuss the ethical implications and future prospects of AI in our increasingly digital world. More about the course can be found here: https://web.stanford.edu/class/cs25/ View the entire CS25 Transformers United playlist: https://www.youtube.com/playlist?list=PLoROMvodv4rNiJRchCzutFw5ItR_Z27CM