Skip to content
Artwork for Platform Engineering Playbook Podcast
Platform Engineering Playbook Podcast · March 27 · 18 min

Your Kubernetes Stack Is Why AI Isn’t Shipping

**Why do 87% of AI models never reach production? It's not the AI - it's the infrastructure underneath.** In this deep dive episode of Platform Engineering Playbook, we tackle the critical challenge of building cloud-native platforms that can actually support AI workloads at scale. While everyone's talking about model performance, the real bottleneck is happening at the infrastructure layer. **What You'll Learn:** • Why traditional Kubernetes setups fail with AI workloads • How to architect platforms for GPU-intensive applications • Real-world strategies from teams successfully running AI in production • Practical steps to prepare your platform for the AI transformation **Episode Breakdown:** 00:00 Cold Open: The AI production problem 02:30 Today's platform engineering news roundup 08:45 Deep Dive Act 1: AI workloads are breaking Kubernetes 18:20 Deep Dive Act 2: How successful teams handle AI infrastructure **Today's News:** • CNCF adds 21 new silver members focused on AI infrastructure • Critical Grafana security vulnerabilities (CVE-2026-27876 & CVE-2026-27880) • GitHub Actions 2026 security roadmap • AWS launches new AI development tools • Aurora PostgreSQL joins AWS Free Tier Perfect for platform engineers, SREs, and infrastructure teams navigating the AI infrastructure challenge. **Sources & References:** - https://www.cncf.io/blog/2026/03/26/the-platform-under-the-model-how-cloud-native-powers-ai-engineering-in-production/ - https://www.cncf.io/announcements/2026/03/25/cncf-welcomes-21-new-silver-members-as-global-demand-surges-for-observability-ai-and-secure-cloud-native-infrastructure/ - https://grafana.com/blog/grafana-security-release-critical-and-high-severity-security-fixes-for-cve-2026-27876-and-cve-2026-27880/ - https://github.blog/news-insights/product-news/whats-coming-to-our-github-actions-2026-security-roadmap/ - https://aws.amazon.com/about-aws/whats-new/2026/03/agent-plugin-aws-serverless/ - https://aws.amazon.com/about-aws/whats-new/2026/03/amazon-aurora-postgresql-aws-free-tier/ #PlatformEngineering #DevOps #CloudNative #Kubernetes

0:00-18:56

transcript

No transcript — this publisher did not publish one.

show notes

**Why do 87% of AI models never reach production? It's not the AI - it's the infrastructure underneath.**

In this deep dive episode of Platform Engineering Playbook, we tackle the critical challenge of building cloud-native platforms that can actually support AI workloads at scale. While everyone's talking about model performance, the real bottleneck is happening at the infrastructure layer.

**What You'll Learn:**
• Why traditional Kubernetes setups fail with AI workloads
• How to architect platforms for GPU-intensive applications
• Real-world strategies from teams successfully running AI in production
• Practical steps to prepare your platform for the AI transformation

**Episode Breakdown:**
00:00 Cold Open: The AI production problem
02:30 Today's platform engineering news roundup
08:45 Deep Dive Act 1: AI workloads are breaking Kubernetes
18:20 Deep Dive Act 2: How successful teams handle AI infrastructure

**Today's News:**
• CNCF adds 21 new silver members focused on AI infrastructure
• Critical Grafana security vulnerabilities (CVE-2026-27876 & CVE-2026-27880)
• GitHub Actions 2026 security roadmap
• AWS launches new AI development tools
• Aurora PostgreSQL joins AWS Free Tier

Perfect for platform engineers, SREs, and infrastructure teams navigating the AI infrastructure challenge.

**Sources & References:**
- https://www.cncf.io/blog/2026/03/26/the-platform-under-the-model-how-cloud-native-powers-ai-engineering-in-production/
- https://www.cncf.io/announcements/2026/03/25/cncf-welcomes-21-new-silver-members-as-global-demand-surges-for-observability-ai-and-secure-cloud-native-infrastructure/
- https://grafana.com/blog/grafana-security-release-critical-and-high-severity-security-fixes-for-cve-2026-27876-and-cve-2026-27880/
- https://github.blog/news-insights/product-news/whats-coming-to-our-github-actions-2026-security-roadmap/
- https://aws.amazon.com/about-aws/whats-new/2026/03/agent-plugin-aws-serverless/
- https://aws.amazon.com/about-aws/whats-new/2026/03/amazon-aurora-postgresql-aws-free-tier/

#PlatformEngineering #DevOps #CloudNative #Kubernetes