Conversations about science, technology, history, philosophy and the nature of intelligence, consciousness, love, and power. Lex is an AI researcher at MIT and beyond.

#258 – Yann LeCun: Dark Matter of Intelligence and Self-Supervised Learning

January 22, 2022 2:51:40 123.6 MB Downloads: 0

Yann LeCun is the Chief AI Scientist at Meta, professor at NYU, Turing Award winner, and one of the seminal researchers in the history of machine learning. Please support this podcast by checking out our sponsors:
Public Goods: https://publicgoods.com/lex and use code LEX to get $15 off
Indeed: https://indeed.com/lex to get $75 credit
ROKA: https://roka.com/ and use code LEX to get 20% off your first order
NetSuite: http://netsuite.com/lex to get free product tour
Magic Spoon: https://magicspoon.com/lex and use code LEX to get $5 off

EPISODE LINKS:
Yann’s Twitter: https://twitter.com/ylecun
Yann’s Facebook: https://www.facebook.com/yann.lecun
Yann’s Website: http://yann.lecun.com/
Books and resources mentioned:
Self-supervised learning (article): https://bit.ly/3Aau1DQ

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/lexfridman
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(06:58) – Self-supervised learning
(17:17) – Vision vs language
(23:08) – Statistics
(28:55) – Three challenges of machine learning
(34:45) – Chess
(42:47) – Animals and intelligence
(52:31) – Data augmentation
(1:13:51) – Multimodal learning
(1:25:40) – Consciousness
(1:30:25) – Intrinsic vs learned ideas
(1:34:37) – Fear of death
(1:42:29) – Artificial Intelligence
(1:56:18) – Facebook AI Research
(2:12:56) – NeurIPS
(2:29:08) – Complexity
(2:37:33) – Music
(2:42:28) – Advice for young people