Skip to content
Artwork for The Big Unlock
The Big Unlock · July 28 · 23 min

Episode 218 – Using Multimodal Foundations and Ambient AI to Scale Clinical Impact

The Big Unlock · Umesh Rustogi, General Manager, HLS Dragon & Platform, Microsoft In this episode, Umesh Rustogi, General Manager, Healthcare & Life Sciences Dragon & Platform at Microsoft, explains that meaningful AI outcomes depend on combining unified multimodal data foundations with clinician-centered design to achieve healthcare’s quadruple aim: improving care quality, patient experience, operational efficiency, and workforce well-being. Addressing the severe nursing shortage and turnover driven by administrative burnout, Umesh details how Microsoft co-innovated with nine major health systems to deploy Dragon Copilot for Nursing, a clinical assistant that works alongside nurses. By leveraging ambient AI on mobile devices, the solution helps nurses capture flow sheet documentation for their review and maintains a running cognitive memory across shifts, significantly lowering cognitive load and enabling nurses to be truly present with their patients. Umesh also emphasizes that enterprise-scale success requires far more than model selection. It demands responsible AI governance, transparent audit capabilities, deep workflow customization, and robust change management, including nurse leader sponsorship and dedicated unit champions. He envisions smart hospital rooms, multimodal AI, wearable integration, and agentic workflows transforming clinical operations by delegating non-patient-facing tasks so caregivers can focus on delivering better care. Take a listen. This guest appearance was facilitated through conversations initiated at HIMSS.

0:00-23:05

transcript

No transcript — this publisher did not publish one.

show notes

The Big Unlock · Umesh Rustogi, General Manager, HLS Dragon & Platform, Microsoft

In this episode, Umesh Rustogi, General Manager, Healthcare & Life Sciences Dragon & Platform at Microsoft, explains that meaningful AI outcomes depend on combining unified multimodal data foundations with clinician-centered design to achieve healthcare’s quadruple aim: improving care quality, patient experience, operational efficiency, and workforce well-being.

Addressing the severe nursing shortage and turnover driven by administrative burnout, Umesh details how Microsoft co-innovated with nine major health systems to deploy Dragon Copilot for Nursing, a clinical assistant that works alongside nurses. By leveraging ambient AI on mobile devices, the solution helps nurses capture flow sheet documentation for their review and maintains a running cognitive memory across shifts, significantly lowering cognitive load and enabling nurses to be truly present with their patients.

Umesh also emphasizes that enterprise-scale success requires far more than model selection. It demands responsible AI governance, transparent audit capabilities, deep workflow customization, and robust change management, including nurse leader sponsorship and dedicated unit champions. He envisions smart hospital rooms, multimodal AI, wearable integration, and agentic workflows transforming clinical operations by delegating non-patient-facing tasks so caregivers can focus on delivering better care. Take a listen.

This guest appearance was facilitated through conversations initiated at HIMSS.

links3