▶
Lecture 2 | AI Safety, Ethics, & Society: AI Fundamentals
You can find more information including the corresponding section of the AI Safety, Ethics, & Society textbook at https://www.aisafetybook.com/textbook/ai-fundamentals
Topics: AI Fundamentals
Dan Hendrycks, Director, Center for AI Safety; PhD Computer Science, UC Berkeley
https://www.safe.ai/
Section Synopsis: To understand the risks that artificial intelligence (AI) poses and to learn what measures we can take to mitigate them, it is essential to understand the technology itself: how it works, how it is used, and where its strengths and weaknesses lie. We describe key concepts in machine learning (ML), the approach that powers most modern AI systems, with a particular focus on the technologies that power Large Language Models such as OpenAI's GPT-4 or Google's Gemini. We introduce the phenomenon of scaling laws, where AI systems' performance improves predictably as the amounts of data and computation used during their training are increased, and consider what this implies for future AI progress.
0:00 Introduction
1:35 Definition of AI
5:48 Machine Learning
15:00 Evaluating ML Models
17:49 Three Types of Machine Learning
23:48 Deep Learning
43:42 Scaling Laws
49:32 The Bitter Lesson
51:12 Recap
