Lecture 2 | AI Safety, Ethics, & Society: AI Fundamentals

Lecture 2 | AI Safety, Ethics, & Society: AI Fundamentals

You can find more information including the corresponding section of the AI Safety, Ethics, & Society textbook at https://www.aisafetybook.com/textbook/ai-fundamentals Topics: AI Fundamentals Dan Hendrycks, Director, Center for AI Safety; PhD Computer Science, UC Berkeley https://www.safe.ai/ Section Synopsis: To understand the risks that artificial intelligence (AI) poses and to learn what measures we can take to mitigate them, it is essential to understand the technology itself: how it works, how it is used, and where its strengths and weaknesses lie. We describe key concepts in machine learning (ML), the approach that powers most modern AI systems, with a particular focus on the technologies that power Large Language Models such as OpenAI's GPT-4 or Google's Gemini. We introduce the phenomenon of scaling laws, where AI systems' performance improves predictably as the amounts of data and computation used during their training are increased, and consider what this implies for future AI progress. 0:00 Introduction 1:35 Definition of AI 5:48 Machine Learning 15:00 Evaluating ML Models 17:49 Three Types of Machine Learning 23:48 Deep Learning 43:42 Scaling Laws 49:32 The Bitter Lesson 51:12 Recap