
Unveiling AI Infrastructure Vulnerabilities - BTS #85
n this episode, the hosts and special guest Jesse Michael discuss new research on AI infrastructure security, focusing on vulnerabilities in Data Processing Units (DPUs) and Baseboard Management Controllers (BMCs). They explore the implications of IOMMU settings, the performance-security trade-offs, and the complex architecture of AI systems. The conversation highlights attack paths and methods for manipulating AI models, emphasizing the need to understand these vulnerabilities in the evolving AI landscape. The speakers also discuss advanced techniques for manipulating AI models, including memory manipulation, model behavior modification, and fine-tuning tools. They discuss how these techniques affect trust and security in AI systems, highlighting the importance of partnerships in strengthening AI infrastructure security. Chapters 00:00 Introduction to AI Infrastructure Security Research 02:02 Exploring the DPU and Its Capabilities 05:07 Understanding IOMMU and Its Security Implications 08:02 Performance vs. Security: The Trade-offs 11:05 The Complex Architecture of AI Infrastructure 14:04 Vulnerabilities in BMC and IPMI 17:01 Accessing the DPU: Attack Paths and Methods 20:07 Manipulating AI Models: Techniques and Risks 25:53 Exploring Memory Manipulation Techniques 31:01 Modifying Model Behavior and System Prompts 35:06 Tools for Model Manipulation and Fine-Tuning 40:37 Trusting AI Models and Security Concerns 45:20 Partnerships and Advancements in AI Security


















