#306 – Oriol Vinyals: Deep Learning and Artificial General Intelligence

Oriol Vinyals is the Research Director and Deep Learning Lead at DeepMind. Please support this podcast by checking out our sponsors:
–Shopify:https://shopify.com/lexto get 14-day free trial
–Weights & Biases:https://lexfridman.com/wnb
–Magic Spoon:https://magicspoon.com/lexand use code LEX to get $5 off
–Blinkist:https://blinkist.com/lexand use code LEX to get 25% off premium

EPISODE LINKS:
Oriol’s Twitter:https://twitter.com/oriolvinyalsml
Oriol’s publications:https://scholar.google.com/citations?user=NkzyCvUAAAAJ
DeepMind’s Twitter:https://twitter.com/DeepMind
DeepMind’s Instagram:https://instagram.com/deepmind
DeepMind’s Website:https://deepmind.com
Papers:
1. Gato:https://deepmind.com/publications/a-generalist-agent
2. Flamingo:https://deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-model
3. Language Models are Few-Shot Learners:https://arxiv.org/abs/2005.14165
4. Emergent Abilities of Large Language Models:https://arxiv.org/abs/2206.07682
5. Attention Is All You Need:https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf

PODCAST INFO:
Podcast website:https://lexfridman.com/podcast
Apple Podcasts:https://apple.co/2lwqZIr
Spotify:https://spoti.fi/2nEwCF8
RSS:https://lexfridman.com/feed/podcast/
YouTube Full Episodes:https://youtube.com/lexfridman
YouTube Clips:https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon:https://www.patreon.com/lexfridman
– Twitter:https://twitter.com/lexfridman
– Instagram:https://www.instagram.com/lexfridman
– LinkedIn:https://www.linkedin.com/in/lexfridman
– Facebook:https://www.facebook.com/lexfridman
– Medium:https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(05:18) – AI
(20:14) – Weights
(26:33) – Gato
(1:01:22) – Meta learning
(1:15:21) – Neural networks
(1:37:46) – Emergence
(1:44:30) – AI sentience
(2:08:27) – AGI