Skip to content
Artwork for Breach Please
Breach Please · August 11 · 38 min

S0E11 - Using AI for patching and inflight shenanigans.

In this episode of Breach Please, Jake and Jess talk about new research showing that AI isn't actually that good at generating patches, highlighting objective rates of failure. Turns out, frontier models only generate the correct patch without introducing issues in about 25% of cases. In almost 5% of cases, the AI introduces new vulnerabilities. We also talk about some shenanigans on a Delta flight home from DEFCON. We discuss how time is a flat circle and reminisce Chris Roberts' issues with in-flight hacking from 2015. Show links: https://1password.com/blog/why-ai-generated-patches-still-require-human-review https://www.defendersinitiative.com/p/reviewing-initial-research-on-using https://www.insideflyer.com/posts/hackers-spoofed-delta-wi-fi-on-las-vegas-flight/

0:00-38:12

transcript

No transcript — this publisher did not publish one.

show notes

In this episode of Breach Please, Jake and Jess talk about new research showing that AI isn't actually that good at generating patches, highlighting objective rates of failure. Turns out, frontier models only generate the correct patch without introducing issues in about 25% of cases. In almost 5% of cases, the AI introduces new vulnerabilities. We also talk about some shenanigans on a Delta flight home from DEFCON. We discuss how time is a flat circle and reminisce Chris Roberts' issues with in-flight hacking from 2015.

Show links:

https://1password.com/blog/why-ai-generated-patches-still-require-human-review https://www.defendersinitiative.com/p/reviewing-initial-research-on-using https://www.insideflyer.com/posts/hackers-spoofed-delta-wi-fi-on-las-vegas-flight/