Skip to content
Artwork for AI Explained
AI Explained · Today · 23 min

ChatGPT's Achilles' Heel

Time for something different - a tour of ChatGPT getting things wrong, including a whole new category of errors that you might find illuminating, concerning or just entertaining. From investigating whether GPT 4 does indeed have theory of mind, to how easily it is jailbroken, to testing Inflection 1, Bard and Claude on the same puzzle that flummoxes ChatGPT to arguing that GPT 4 will just double down on bad logic, this video showcases GPT getting irrational. Inverse Scaling Paper: https://arxiv.org/pdf/2306.09479.pdf Theory of Mind Perturbations: https://arxiv.org/pdf/2302.08399.pdf Unfaithful Explanations: https://arxiv.org/pdf/2305.04388.pdf Decoding Trust: https://arxiv.org/pdf/2306.11698.pdf Inflection Memo: https://inflection.ai/assets/Inflection-1.pdf Heypi from Inflection: https://heypi.com/talk Jailbreaks Will Always be Possible: https://arxiv.org/pdf/2304.11082.pdf https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/ Learn more about your ad choices. Visit megaphone.fm/adchoices

0:00-23:22

transcript

No transcript — this publisher did not publish one.

show notes

Time for something different - a tour of ChatGPT getting things wrong, including a whole new category of errors that you might find illuminating, concerning or just entertaining.


From investigating whether GPT 4 does indeed have theory of mind, to how easily it is jailbroken, to testing Inflection 1, Bard and Claude on the same puzzle that flummoxes ChatGPT to arguing that GPT 4 will just double down on bad logic, this video showcases GPT getting irrational.


Inverse Scaling Paper: https://arxiv.org/pdf/2306.09479.pdf
Theory of Mind Perturbations: https://arxiv.org/pdf/2302.08399.pdf
Unfaithful Explanations: https://arxiv.org/pdf/2305.04388.pdf
Decoding Trust: https://arxiv.org/pdf/2306.11698.pdf
Inflection Memo: https://inflection.ai/assets/Inflection-1.pdf
Heypi from Inflection: https://heypi.com/talk
Jailbreaks Will Always be Possible: https://arxiv.org/pdf/2304.11082.pdf


https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/

Learn more about your ad choices. Visit megaphone.fm/adchoices

links10