Skip to content
Artwork for The Stack Overflow Podcast
The Stack Overflow Podcast · August 18 · 28 min

Building an agentic SDLC with a QA engineering mindset

Ryan welcomes Suneet Malhotra, Senior Manager of Test Engineering at Motorola Solutions, to chat about building end-to-end agentic SDLC pipelines using MCPs, using Cohen’s kappa to evaluate multiple LLMs-as-judges, and how you can improve requirements by shifting QA left through a specification enrichment stage immediately after the design phase. Episode notes: You can learn more about Suneet’s five-agent SDLC (and see the companion code) on his GitHub. Read the papers discussed: Cross-Layer Observability for LLM-Assisted Test Automation: A Reference Architecture and Web Feasibility Study and Cross-Layer Observability for LLM-Assisted Test Automation — Reference Implementation and Evaluation Data (v1.5.2, JSS In-Practice). Connect with Suneet on LinkedIn and see more of his work on his website. Congrats to user Sanjay for winning a Great Question badge for asking What does it mean to fork on GitHub?. See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

0:00-28:55

transcript

No transcript — this publisher did not publish one.

show notes

Ryan welcomes Suneet Malhotra, Senior Manager of Test Engineering at Motorola Solutions, to chat about building end-to-end agentic SDLC pipelines using MCPs, using Cohen’s kappa to evaluate multiple LLMs-as-judges, and how you can improve requirements by shifting QA left through a specification enrichment stage immediately after the design phase.

Episode notes:

You can learn more about Suneet’s five-agent SDLC (and see the companion code) on his GitHub

Read the papers discussed: Cross-Layer Observability for LLM-Assisted Test Automation: A Reference Architecture and Web Feasibility Study and Cross-Layer Observability for LLM-Assisted Test Automation — Reference Implementation and Evaluation Data (v1.5.2, JSS In-Practice).

Connect with Suneet on LinkedIn and see more of his work on his website

Congrats to user Sanjay for winning a Great Question badge for asking What does it mean to fork on GitHub?.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

links9