Skip to content
Artwork for Wes Roth
Wes Roth ยท Saturday ยท 32 min

Google Deepmind RT 2 - Using LLMs to Build Thinking, Learning Robots

#deepmind #ai #robotics ๐Ÿ”ฅ Get my A.I. + Business Newsletter (free): https://natural20.com/ [LINKS] https://www.deepmind.com/blog/rt-2-new-model-translates-vision-and-language-into-action https://robotics-transformer2.github.io/assets/rt2.pdf https://openai.com/research/gpt-4 https://www.understandingai.org/p/large-language-models-explained-with https://voyager.minedojo.org/assets/documents/voyager.pdf https://twitter.com/DrJimFan [MENTIONED VIDEOS] Minecraft AI - SELF-IMPROVING ๐Ÿคฏ autonomous agent: https://www.youtube.com/watch?v=7yI4yfYftfM LLMs as Tool Makers [LATM] - GPT-4 *UPGRADES* lower AI Models. https://www.youtube.com/watch?v=qWI1AJ2nSDY Sam Altman on UBI and Massive Job Losses from AI Automation https://www.youtube.com/watch?v=5Nsqv3FWXio [TIMELINE] [00:00] Intro [02:04] Using LLMs as a "brain" [05:28] Robotic Control [09:03] What's the Point?! [12:40] The Paper [18:15] Dr Jim Fan [19:30] Examples and Limitations [22:59] Training in Simulations Learn more about your ad choices. Visit megaphone.fm/adchoices

0:00-32:43

transcript

No transcript โ€” this publisher did not publish one.

show notes

#deepmind #ai #robotics

๐Ÿ”ฅ Get my A.I. + Business Newsletter (free):
https://natural20.com/

[LINKS]
https://www.deepmind.com/blog/rt-2-new-model-translates-vision-and-language-into-action

https://robotics-transformer2.github.io/assets/rt2.pdf

https://openai.com/research/gpt-4

https://www.understandingai.org/p/large-language-models-explained-with

https://voyager.minedojo.org/assets/documents/voyager.pdf

https://twitter.com/DrJimFan


[MENTIONED VIDEOS]

Minecraft AI - SELF-IMPROVING ๐Ÿคฏ autonomous agent:
https://www.youtube.com/watch?v=7yI4yfYftfM

LLMs as Tool Makers [LATM] - GPT-4 *UPGRADES* lower AI Models.
https://www.youtube.com/watch?v=qWI1AJ2nSDY

Sam Altman on UBI and Massive Job Losses from AI Automation
https://www.youtube.com/watch?v=5Nsqv3FWXio

[TIMELINE]

[00:00] Intro
[02:04] Using LLMs as a "brain"
[05:28] Robotic Control
[09:03] What's the Point?!
[12:40] The Paper
[18:15] Dr Jim Fan
[19:30] Examples and Limitations
[22:59] Training in Simulations

Learn more about your ad choices. Visit megaphone.fm/adchoices

links11