Skip to content
Artwork for The Human in the Loop
The Human in the Loop · September 20 · 22 min

It Stopped This Time

Your test environment can probably reach more than you think. Gemini is the example this week. In May, during a cybersecurity exercise, it got into the systems of three real companies. It guessed one password and found other credentials in a public repository. The exercise was supposed to be sealed off. Internet access was on by accident. And the fictional company in the test shared a name with a real one. The model stopped once it realized what it had done. Google confirmed it this week. Most coverage reads the stopping as the good news. I have not run a breakout test myself, so I won't tell you what your controls should look like. But I have been asking myself one question. What can my agents actually reach right now? I know what I meant to give them. I am less sure what they can get to from other places. I go through all of it in this week's episode of The Human in the Loop. #AIAgents #AgentSecurity #TheHumanInTheLoop

0:00-22:04

transcript

No transcript — this publisher did not publish one.

show notes

Your test environment can probably reach more than you think.

Gemini is the example this week. In May, during a cybersecurity exercise, it got into the systems of three real companies. It guessed one password and found other credentials in a public repository.

The exercise was supposed to be sealed off. Internet access was on by accident. And the fictional company in the test shared a name with a real one.

The model stopped once it realized what it had done. Google confirmed it this week.

Most coverage reads the stopping as the good news.

I have not run a breakout test myself, so I won't tell you what your controls should look like. But I have been asking myself one question.

What can my agents actually reach right now?

I know what I meant to give them. I am less sure what they can get to from other places.

I go through all of it in this week's episode of The Human in the Loop.

#AIAgents #AgentSecurity #TheHumanInTheLoop