Skip to content
Artwork for The Neuron: AI Explained
The Neuron: AI Explained · Friday · 54 min

Where Does AI Agent Security Actually Live?

AI companies spend enormous effort making models safer, but the model tested in the lab isn't necessarily the system a company eventually deploys. Alice CEO and co-founder Noam Schwartz joins Corey and Grant to explain why prompts, tools, memory, permissions, data, and agent-to-agent interactions create an entirely new security surface. They dig into the growing “trust gap” around enterprise AI, why prompt injection may become a permanent cat-and-mouse game, what open-weight models change for defenders, and why Schwartz believes the real security boundary has to exist at every layer of an AI system. The bigger takeaway: as AI moves from answering questions to taking actions, traditional cybersecurity may need to merge with fraud prevention, threat intelligence, and trust and safety. OpenAI security incident: https://openai.com/index/hugging-face-model-evaluation-security-incident/ Alice: https://alice.io/ Alice on agentic AI security: https://alice.io/blog/key-security-risks-posed-by-agentic-ai-and-how-to-mitigate-them Alice open-weight research: https://alice.io/blog/okay-here-is-how-to-build-a-bomb-millions-download-dangerous-llms Subscribe to The Neuron newsletter: https://theneuron.ai Sponsored by Dell Technologies and NVIDIA. Learn more at https://www.techrepublic.com/hubs/the-enterprise-guide-to-scalable-ai/

0:00-54:50

transcript

No transcript — this publisher did not publish one.

show notes

AI companies spend enormous effort making models safer, but the model tested in the lab isn't necessarily the system a company eventually deploys.


Alice CEO and co-founder Noam Schwartz joins Corey and Grant to explain why prompts, tools, memory, permissions, data, and agent-to-agent interactions create an entirely new security surface.


They dig into the growing “trust gap” around enterprise AI, why prompt injection may become a permanent cat-and-mouse game, what open-weight models change for defenders, and why Schwartz believes the real security boundary has to exist at every layer of an AI system.


The bigger takeaway: as AI moves from answering questions to taking actions, traditional cybersecurity may need to merge with fraud prevention, threat intelligence, and trust and safety.


OpenAI security incident: https://openai.com/index/hugging-face-model-evaluation-security-incident/

Alice: https://alice.io/

Alice on agentic AI security: https://alice.io/blog/key-security-risks-posed-by-agentic-ai-and-how-to-mitigate-them

Alice open-weight research: https://alice.io/blog/okay-here-is-how-to-build-a-bomb-millions-download-dangerous-llms


Subscribe to The Neuron newsletter: https://theneuron.ai


Sponsored by Dell Technologies and NVIDIA. Learn more at https://www.techrepublic.com/hubs/the-enterprise-guide-to-scalable-ai/