Skip to content
Artwork for The Road to Accountable AI
TechnologyBusiness

The Road to Accountable AI

Kevin Werbach

Artificial intelligence is changing business, and the world. How can you navigate through the hype to understand AI's true potential, and the ways it can be implemented effectively, responsibly, and safely? Wharton Professor and Chair of Legal Studies and Business Ethics Kevin Werbach has analyzed emerging technologies for thirty years, and created one of the first business school course on legal and ethical considerations of AI in 2016. He interviews the experts and executives building accountable AI systems in the real world, today.

Play
  • 20 episodes
  • Avg 33 min
  • English
  • S5 · E16
    June 25 · 33 min

    Harish Peri (Okta): When the Thing Accessing Your Systems Has a Brain

    In the final episode of our series on governing AI agents, Kevin Werbach speaks with Harish Peri, SVP and General Manager for AI Security at Okta. Peri frames agent governance as the natural next chapter of what Okta has done for two decades: standing in the middle of people accessing technology. The twist is that the new "software" is a non-deterministic agent with a brain, which imposes a much higher security bar. He argues that agents live at the application layer, where the real question is one of authorization: is this agent allowed to take this action or access this data, at this moment, on behalf of this user, given all available signals? Much of the conversation explores why a neutral, independent control plane separate from the frontier models and agent runtimes matters from a cybersecurity standpoint, spreading risk across multiple layers rather than concentrating it in one place. Peri notes that while awareness of rogue AI is universal, roughly 20% of agents carry about 80% of the risk. He distinguishes security threats like prompt injection and poisoned skill files from "intent mismatch," where an under-specified instruction such as "clean this up" gets read as "delete," and explains how coarse-grained limits, fine-grained context-based authorization, and selectively applied human-in-the-loop checks each play a role in agent governance. Harish Peri is the SVP and General Manager for AI Security at Okta, where he leads product, go-to-market, and commercial strategy for securing agentic AI. He has more than 20 years of experience across engineering, product management, marketing, and general management, spanning financial services, technology, and human capital management, with prior roles at Salesforce, ADP, and Proxyclick. He holds an MBA from the Haas School of Business at UC Berkeley. Transcript The Future of AI Security: The Right Architecture for Agents Secure Your Business Against AI Agents

    • Transcript
  • S5 · E15
    June 18 · 33 min

    Logan Kelly (Waxell): The Accidental Agent Governance Company

    Logan Kelly never set out to build an AI governance solution. Waxell spun out of CallSine, an AI-native sales engagement platform, when the team realized that agents that could act on their own produced a cascade of problems: burning through tokens, accessing databases, creating data-quality issues, and generally doing things no one had explicitly approved. Unable to find existing tooling that addressed the problems effectively, the team built a control plane for agents, which became the foundation of Waxell. In this episode in our series on governing AI agents, CEO Logan Kelly emphasizes that governance should be legible to finance, legal, and compliance teams, not just developers. As he explains, agent governance is less about exotic AI risks than about visibility and control over things companies already care about, such as cost, data access, and who's allowed to do what. Kelly makes the case that the worst outcome isn't an agent misbehaving but companies losing trust in agents altogether and missing their value—arguing that every major technology, from cloud computing onward, arrived with new risks that good governance ultimately made manageable. Looking ahead, he bets that flexible, general-purpose governance will win out over locked-in "walled garden" platforms, as the pace of change in AI keeps accelerating.. Logan Kelly is the Co-Founder and CEO of Waxell, an AI governance and agent observability company that provides a control plane for operating autonomous AI agents in production. The company entered public beta in early 2026. Transcript

    • Transcript
  • S5 · E14
    June 11 · 32 min

    Nadav Cornberg (Eve Security): Interrogating Agents Before They Act

    Kevin Werbach speaks with Nadav Cornberg, co-founder and CEO of Eve Security, about securing agentic AI where it counts: at the moment an agent actually does something. He recounts how customers upended his own assumptions that AI agent security should focus on visibility and after-the-fact detection. Buyers insisted on runtime enforcement first, reasoning that learning a production database was deleted after the fact helps no one. With Eve's "interrogation" approach, when an agent attempts an anomalous, high-risk action, Eve's agent-in-the-loop pauses and questions it about its intent, before approving, blocking, or escalating to a human. Cornberg describes building a deterministic enforcement layer on top of inherently non-deterministic models, with the system minting explicit rules from observed behavior so that the large majority of everyday requests resolve deterministically. Ultimately, the consequenes are the same whether an unintended action originates in a prompt injection or a simple hallucination. On the perennial human-in-the-loop question, Cornberg argues that escalating everything would drown security teams as the agentic workforce scales, so the platform automatically handles lower-risk cases with justification and reserves human review for the genuinely critical. He closes predicting that "agentic security" will fragment into distinct segments much as endpoint, network, and cloud security once did, and that intent is fast becoming the field's organizing idea. Nadav Cornberg is the co-founder and CEO of Eve Security, an Austin-based agentic AI observability and policy-enforcement company whose platform governs how AI agents interact with an organization's most critical systems. He brings roughly two decades in product development and engineering, including an early decade in cybersecurity at RSA and Check Point and later work in physical access security across gaming and hospitality before returning to security for the agentic era. Transcript Founders' blog: Why We Started Eve Security

    • Transcript
  • S5 · E13
    June 4 · 33 min

    Venkat Siva (Compfly): Governing Agents at the Execution Boundary

    Kevin Werbach speaks with Venkat Siva, co-founder and CEO of CompFly AI, about why governing autonomous agents requires a fundamentally different approach than securing traditional software. Siva argues that agents create a genuinely new control problem. Because they decide at runtime which tools to call and which actions to take, governance cannot simply be bolted onto existing MLOps or security platforms built for fixed, deterministic workflows. Instead, control has to move to the "execution boundary" — the point where an agent's decision turns into a real-world action. And agent safety is much more than just model safety. In practical terms, Siva makes the case for giving every enterprise agent a distinct, cryptographically verifiable identity using decentralized identifiers (DIDs) and verifiable credentials. He addresses the growing problem of "shadow agents," pointing to employees experimenting with powerful open-source autonomous tools inside enterprises, and explains discovery techniques like intercepting traffic to model APIs and watching for who requests LLM keys. He offers the concept of an "autonomy budget": classify actions by reversibility and financial, regulatory, and customer impact, so an agent might autonomously issue a small refund but require human approval for a large one. Drawing on his time at the electric automaker Rivian, Siva closes by contrasting recoverable digital failures with the irreversible stakes of agents embedded in physical systems, arguing that governance there must borrow from safety engineering. Venkat Siva is the co-founder and CEO of CompFly AI, an early-stage company building a control plane to discover, validate, secure, and govern autonomous agents from code to production. Before founding CompFly with Anand Salodkar, he spent more than two decades building enterprise platform products that help organizations adopt new technology safely and at scale, including work at the electric vehicle maker Rivian. Transcript The Architecture of Trust (Compfly Manifesto) CoSAI Model Context Protocol Security white paper

    • Transcript
  • S5 · E12
    May 28 · 31 min

    Munmun De Choudhury (Georgia Tech): Conversational AI and Mental Health

    Conversational AI is increasingly being used as a source of emotional support, even though general-purpose chatbots were never designed for that purpose. Concerns about AI's mental health impact, up to and including suicides, have moved onto the public policy agenda. Munmun De Choudhury, who has been studying the intersection of digital technology and mental health longer than almost anyone, walks through what researchers know, what they don't, and why the answers keep moving. The conversation centers on the difficulty of governing technologies whose capabilities and patterns of use are both changing every few weeks. De Choudhury invokes the cautionary tale of Google Flu Trends as a warning: any framework that assumes user behavior is fixed will eventually break. She argues that the harms and benefits of conversational AI are not just person-dependent but task-dependent, which makes general-purpose chatbots fundamentally harder to evaluate than the narrow medical AI systems researchers built for decades. She lays out a multi-stakeholder agenda to address AI's mental health risks, and argues that foundation models need to take into account principles from psychotherapy. Dr. Munmun De Choudhury is the J.Z. Liang Professor in the School of Interactive Computing at Georgia Tech, where she founded and directs the Social Dynamics and Wellbeing Lab (SocWeB). She is one of the most cited researchers in digital mental health and is widely credited with pioneering the computational use of social media data to study mental health outcomes. She co-leads the Patient-Centered Care Delivery research pillar at the Children's Healthcare of Atlanta Pediatric Technology Center, serves on the advisory board for the Australian government's eSafety panel, and was inducted into the SIGCHI Academy in 2024. Her honors include the 2023 SIGCHI Societal Impact Award and the 2021 ACM-W Rising Star Award. Transcript Benefits and Harms of Large Language Models in Digital Mental Health From Lived Experience to Insight: Unpacking the Psychological Risks of Using AI Conversational Agents

    • Transcript
  • S5 · E11
    May 21 · 32 min

    Emre Kazim (Holistic AI): Why AI Governance is Like Cybersecurity

    Holistic AI was one of the first companies built specifically to govern, audit, and red team AI systems. As co-founder and co-CEO Emre Kazim explains, its original thesis was that AI governance would mirror data governance: a compliance-driven regime. He now believes the better analogy is cybersecurity: a more technical, incident-driven discipline where best practices emerge from real-world events and propagate across industry, rather than descending from abstract regulatory frameworks. Kazim argues this shift has significant implications for who owns AI governance inside enterprises, what skills they need, and why documentation-and-reporting vendors are unlikely to capture the core of the market. Kazim also makes the case that human-in-the-loop oversight, long treated as the default answer to AI risk, has become untenable as systems grow more dynamic and agentic. He distinguishes between two enterprise adoption patterns: a democratic model in which every employee has a copilot, and a vanguard model in which a small number of mission-critical agentic systems drive most of the value and demand most of the governance attention. Finally, he argues that meaningful research capacity will be the price of entry for AI governance firms going forward. Dr. Emre Kazim is the co-founder and co-CEO of Holistic AI, an AI governance platform company spun out of University College London in 2020. He previously served as a Research Fellow in UCL's Department of Computer Science. Kazim has published more than 50 peer-reviewed articles on AI ethics and governance, serves as a member of the OECD's Network of Experts on AI, and is involved with the NIST AI Safety Institute. Transcript Towards Algorithm Auditing (Royal Society Open Science, 2024) What is AI Governance? (Holistic Blog, February 2026)

    • Transcript
  • S5 · E10
    May 14 · 35 min

    Rumman Chowdhury (Humane Intelligence): The Need for Discernment

    Kevin Werbach speaks with long-time responsible AI leader Rumman Chowdhury the current environment, in which substantive standards and oversight efforts for AI are taking shape amid a larger anti-regulation wave. Chowdhury distinguishes sharply between frontier labs, where the posture is largely "AI at all costs," and the non-tech enterprises she works with, who are wrestling with how to scale governance bodies that originally reviewed single AI implementations to hundreds of systems, third-party procurement questions, and agentic workloads. She describes the current evaluations market as immature on nearly every dimension, and explains why generic benchmarks rarely translate to enterprise contexts like insurance or auto manufacturing. The conversation then turns to AI's impact on work and education. Her concern is that companies pursuing short-term efficiency by cutting entry-level hiring will face what MIT researchers Caosun and Aral call the "augmentation trap," in which workers' cognitive skills atrophy while new workers never develop them. She offers "discernment" as her 2026 word of the year, discribing the skill -- more than just critical thinking -- we must cultivate and defend. Her new podcast and forthcoming book, Thinking About Thinking, argues that our notion of intelligence was built for an Industrial Revolution workforce we are now automating away. Dr. Rumman Chowdhury is the founder of Humane Intelligence PBC, building modular, tool-agnostic AI evaluation infrastructure for enterprise and real-world contexts. She co-founded the nonprofit Humane Intelligence in 2022 and served as its CEO until 2025. She previously was Director of the Machine Learning Ethics, Transparency, and Accountability team at Twitter, founder of the algorithmic audit platform Parity, and Global Lead of Responsible AI at Accenture, where she built one of the first enterprise-level bias detection tools. She has served as U.S. Science Envoy for AI and as a Responsible AI Fellow at Harvard's Berkman Klein Center, and holds a doctorate in political science from the University of California, San Diego. Transcript Virginia SB 384 / HB 797 — Independent Verification Organization legislation (Fathom) The Augmentation Trap: AI Productivity and the Cost of Cognitive Offloading Open to Debate: Will AI Make Work Obsolete? Why AI evals need to reflect the real world (Transformer)

    • Transcript
  • S5 · E9
    May 7 · 29 min

    Var Shankar: AI Governance for Smaller Organizations

    Var Shankar makes the case that most AI governance guidance is built for large, sophisticated, multifunctional global enterprises — and that this leaves out the roughly half of American workers employed at organizations with fewer than 500 people. Through the Council on AI Governance, the nonprofit he leads with Alexis Cook, he is trying to fill that gap with open, current, and pragmatic resources, including an AI Governance Playbook organized around four focus areas: strategy, risk and compliance, workforce literacy, and operational management. He tells Kevin that the case for AI governance no longer needs to be made; what smaller organizations now need is help asking vendors the right questions and clarifying who owns what internally when a few people are doing many jobs. The conversation then turns to the parts of the field Var thinks are most undercooked. Workforce literacy, he argues, is the focus area most often neglected because it functions as a vitamin rather than a painkiller — long-term, hard to resource, and easy to reduce to a training module when what is actually needed is hands-on involvement in pilots and documentation. He explains why healthcare offers an unusually strong foundation for AI assurance, with its existing regulatory architecture, comfort with use-case variability, and tradition of post-deployment monitoring, and he describes assurance itself as the connective tissue between an organization and the outside world — distinct from regulation and from internal governance, not a substitute for either. Drawing on a pilot he co-authored on with the Standards Council of Canada testing system-level certification at a Canadian bank, he highlights two surprising lessons: that even simplified certification criteria get interpreted differently by different actors, and that even one of the world's most forward-thinking public standards bodies lacked the technical capacity to play standard-setter for something as dynamic as an AI system. He closes with practical advice for risk and compliance professionals: start with the positive vision of what the organization is trying to do with AI, observe how existing IT, data, and security governance already work, and identify which standards ecosystems the organization is already plugged into. Var Shankar is Executive Director of the Council on AI Governance, an independent nonprofit developing open AI governance resources for organizations of all sizes. He previously served as Executive Director of the Responsible AI Institute and as Chief AI and Privacy Officer at Enzai, a regtech AI compliance startup. An attorney by training and a graduate of Harvard Law School, he practiced law at Cravath, Swaine & Moore and earlier worked on the Clinton Global Initiative and with the government of British Columbia on digital government and COVID response. He teaches AI governance at Purdue, where he has helped develop a master's-level AI auditing program, and serves on the OECD Network of Experts on AI, the World Economic Forum's AI Governance Alliance, and the Brookings Forum for Cooperation on AI. He co-developed Kaggle's Intro to AI Ethics course with Alexis Cook. Transcript Council on AI Governance: AI Governance Playbook Context-specific certification of AI systems: a pilot in the financial industry (AI and Ethics, 2025) Standards Council of Canada AI accreditation pilot

    • Transcript
  • S5 · E8
    April 30 · 37 min

    Katie Fowler (Thomson Reuters Foundation): How 3,000 Companies Approach AI Governance

    Good data about how companies are implementing AI governance programs is essential both for organizations to benchmark their efforts, and for observers to understand the state of development. In this episode, Katie Fowler, Director of Responsible Business at the Thomson Reuters Foundation, joins Kevin Werbach to discuss the findings of Responsible AI in Practice, a new report drawing on a global dataset of roughly 3,000 companies across 13 sectors. Fowler unpacks the report's central finding: an enormous gap between corporate AI ambition and operational governance, with 44 percent of companies reporting an AI strategy but only 13 percent publicly committing to a formal governance framework. She argues that the gap is structural rather than just a disclosure failure, noting that AI expertise often sits deep within technical teams rather than at the leadership levels responsible for organization-wide rollout. She points to striking regional variation in workforce protections, the EU AI Act's emergence as a de facto global reference framework even outside Europe, and pushes back on the narrative that regulation stifles innovation. Looking forward, she discusses how investors are using transparency as a proxy for risk management in the absence of mature responsible AI metrics, and outlines the long-term vision of building a dataset robust enough to support a responsible AI index tied to financial materiality. Katie Fowler is Director of Responsible Business at the Thomson Reuters Foundation, the independent charity affiliated with Thomson Reuters. She leads initiatives including the Workforce Disclosure Initiative (a global platform collecting survey data on how companies treat workers across their direct operations and supply chains) and the AI Company Data Initiative, launched in partnership with UNESCO. Before joining the Foundation, Fowler held leadership roles at The Social Innovation Partnership and Chance for Childhood. Transcript Responsible AI in Practice: 2025 Global Insights from the AI Company Data Initiative Why a Companywide Effort Is Key to Responsible and Trustworthy AI Adoption (Katie Fowler, techUK guest blog, 2025)

    • Transcript
  • S5 · E7
    April 23 · 38 min

    Henry Ajder, Latent Space Advisory: Deepfakes and the Crisis of Digital Trust

    AI-generated deepfakes are exploding in volume and quality, posing frightening challenges for public discourse, security, safety, and more. My guest, Henry Ajder, has been mapping the deepfake landscape since before most people had heard the term. In this conversation, he describes the dramatic changes in realism, efficiency, accessibility, and functionality of synthetic media tools since he published the first comprehensive census of deepfakes in 2019. Ajder describes the current moment as one of "epistemic nihilism," where people cannot reliably distinguish real from synthetic content and the available technological responses are not yet at a level of categorical trust. He introduces a framework of "deception, doubt, and degradation" for understanding deepfake harms, and draws a distinction between the clearly malicious, the clearly beneficial, and a vast unsettling middle ground of uses that society has not yet figured out how to evaluate. On the response side, Ajder warns that media literacy advice is not just outdated but actively harmful, because it gives people false confidence in their ability to spot fakes. Detection tools, watermarking, and content provenance standards like C2PA, while valuable, each have real limitations. Ajder's practical advice for organizations centers on red-teaming, understanding what your tool is actually for and who it serves, and recognizing that authenticity is a strategic asset in a synthetic age. Henry Ajder is the founder of Latent Space Advisory and one of the world's foremost experts on deepfakes and generative AI. He authored the landmark 2019 State of Deepfakes report, and has since advised organizations including Meta, Adobe, the UK Government, the EU Commission, the US FTC, and the World Economic Forum. He co-leads the University of Cambridge's Generative AI in Business programme, and sits on Meta's Reality Labs Advisory Council. Transcript Latent Space Advisory The State of Deepfakes: Landscape, Threats, and Impact (2019) The Future Will Be Synthesised (BBC Radio 4 Documentary Series, 2022)

    • Transcript
  • S5 · E6
    April 16 · 30 min

    Phil Dawson, Armilla AI: Insurance for AI Risks

    Could a private insurance market play a significant role in compensating for AI-related harms and incentivizing companies to engage in more effective AI governance? Phil Dawson of Armillla AI explains why AI insurance is emerging as a distinct product category, why traditional policies aren't effective at addressing AI risks, and what AI insurance actually covers. Dawson details Armilla's journey from AI testing platform assurance provider to, managing general agent for AI insurance policies, arguing that the company's AI audit experience gave it the risk data and evaluation capabilities needed to underwrite AI systems. A key turning point, he says, was realizing that as companies received reports showing how their models performed or underperformed, they became more concerned about risk, and insurance emerged as the next logical step to build trust. Dawson identifies the absence of claims data as the central challenge for AI underwriting, which forces insurers to rely on proxy signals. He argues that policymakers can help by incentivizing transparency, disclosure, and third-party assessment. Drawing on lessons from cyber insurance, Dawson contends that risk-based pricing must be grounded in system-level governance evaluation. He also describes Armilla's partnership program, which connects insured companies with AI governance platforms, auditing firms, and certification bodies, ultimately driving improved AI governance maturity across the sector. Philip Dawson is Head of AI Policy and Partnerships at Armilla AI, an MGA and Lloyd's cover holder that provides dedicated AI insurance products. A lawyer and public policy adviser, he has spent nearly a decade working on AI governance, including early involvement in the drafting of the OECD AI Principles and roles at Element AI, the United Nations, and the Harvard Kennedy School's Carr Center for Human Rights Policy. Transcript Ready or Not: The Impact of Artifician Intelligence on Insurance Risks (Armilla AI and Lockton, February 2026) Armilla AI Raises Lloyd's-Backed Coverage to $25M as Traditional Insurers Retreat from AI Risk (Fintech Finance News, January 22, 2026) Gen AI Risks for Businesses: Exploring the Role for Insurance (Geneva Association, October 2, 2025)

    • Transcript
  • S5 · E5
    April 9 · 32 min

    Walter Haydock, StackAware: In Search Of AI Governance Certification

    Walter Haydock draws a direct line from military risk management to the enterprise AI challenge. His argues that organizations need to stop doing "math with colors," and move toward quantitative assessment that assigns dollar values to potential AI failures. Much of the conversation in this episode focuses on ISO 42001, the global standard for AI management systems, which Haydock has championed and which his own firm has gone through. He draws a three-part taxonomy of AI governance frameworks: legislation you either comply with or don't, voluntary self-attestable frameworks like the NIST AI RMF, and externally certifiable standards like ISO 42001 that bring independent verification. Haydock outlines a forward-looking vision in which certification, insurance, and legal safe harbors reinforce one another. Machine-readable audit data will eventually allow insurers to make informed underwriting decisions about AI risk, reducing uncertainty for both enterprises and their customers. Though, as he acknowledges, we are still far from that environment, with AI audits today still roughly 90% manual. Walter Haydock is the founder of StackAware, which helps AI-powered companies manage security, compliance, and privacy risk. Before entering the private sector, he served as a reconnaissance and intelligence officer in the U.S. Marine Corps, as a professional staff member for the Homeland Security Committee of the U.S. House of Representatives, and as an analyst at the National Counterterrorism Center. He is a graduate of the United States Naval Academy, Georgetown University's School of Foreign Service, and Harvard Business School. Transcript Deploy Securely (Haydock's Substack)

    • Transcript
  • S5 · E4
    April 2 · 33 min

    Richa Kaul, Complyance: Asking the Right Questions

    Richa Kaul breaks down the AI risk landscape for enterprises, and argues that the key to managing all of them is resisting the urge to sensationalize. Kaul offers a candid assessment of where enterprise AI governance committees are falling short, noting that many lack the technical fluency to ask vendors the right questions, such as where customer data goes, whether it trains other clients' models, and what specific steps reduce hallucination. She suggests that market-driven security standards like SOC-2 and ISO 27001 often matter more in practice than government regulation, creating a "beautiful ecosystem" where risk management runs ahead of the law. Looking forward, she addresses the growing challenge of agentic AI systems that make decisions autonomously, offering a deceptively simple prescription: Map every action an agent can take, know where your highest risk sits, identify the critical decision points, and demand human sign-off at each one/ Richa Kaul is the founder and CEO of Complyance, an AI-native enterprise governance, risk, and compliance (GRC) platform. Before founding Complyance, she was Chief Strategy Officer at ContractPodAi, a legal technology company, and previously served as Managing Director at the Virginia Economic Development Partnership and as a management consultant at McKinsey. Transcript Complyance Raises $20M to Help Companies Manage Risk and Compliance (TechCrunch, February 11, 2026)

    • Transcript
  • S5 · E3
    March 26 · 33 min

    Michael Horowitz, UPenn: Governing AI That's Designed to Kill

    How AI is, could, and shouldn't be used in military and other national security contexts is a topic of growing importance. Recent conflicts on the battlefield, and between the U.S. military and a major AI lab, are forcing conversations about legal, ethical, and appropriate business limitations for increasingly powerful AI tools. Michael Horowitz, a Political Science professor and Director of Perry World House at the University of Pennsylvania, is one of the world's leading experts on military AI and autonomous weapons. In this episode, drawing on his two stints in the U.S. Department of Defense, Horowitz walks through the major buckets of military AI use. He explains why militaries are, in some ways, more incentivized than any other institution to get AI governance right, but genuine tensions among speed, effectiveness, and meaningful human control can make responsible military AI difficult in practice. We cover Anthropic's recent dispute with the Pentagon as a case study in the fragile and increasingly consequential relationship between Silicon Valley and the defense establishment. Michael C. Horowitz is the Richard Perry Professor of Political Science and Director of Perry World House at the University of Pennsylvania, and a Senior Fellow for Technology and Innovation at the Council on Foreign Relations. From 2022 to 2024, he served as U.S. Deputy Assistant Secretary of Defense for Force Development and Emerging Capabilities, where he was the principal author of the U.S. Political Declaration on Responsible Military Use of AI and Autonomy. He is the author of The Diffusion of Military Power: Causes and Consequences for International Politics and co-author of Why Leaders Fight. Transcript Battles of Precise Mass: Technology Is Remaking War — and America Must Adapt (Foreign Affairs, 2024) The Ethics & Morality of Robotic Warfare: Assessing the Debate over Autonomous Weapons (Daedalus, 2016) Rules of Engagement (Penn Gazette, 2025)

    • Transcript
  • S5 · E2
    March 19 · 33 min

    Tanvi Singh, Ekta AI: The Case for Sovereign AI

    Tanvi Singh draws on over two decades of building and governing AI systems inside global banks to make a provocative case: you cannot be accountable for decisions you do not control. Enterprises are consuming intelligence through models they don't own, can't explain, and didn't train. Singh reframes sovereignty beyond data center locations and infrastructure, to control across the entire stack, so that an organization's AI reflects its own values, laws, and culture. Whlile frontier LLMs will continue to dominate the consumer and retail market, she argues that domain-specific models will be important for enterprise and regulated use cases, offering better accuracy at dramatically lower cost. The conversation also touches on Singh's engagement with the Vatican's Pontifical Academy of Sciences around AI ethics, which has worked on benchmarks that reflect institutional values rather than defaulting to the cultural norms baked into large internet-trained models. Tanvi Singh is the Co-Founder and CEO of Ekta Inc., a sovereign AI platform company building domain-specific foundation models for governments and regulated industries. She previously served as Group Head of AI, Data & Analytics at UBS and held senior technology leadership roles at Credit Suisse, GE, and Monsanto. She is the founder and managing partner of Nirmata-ai Ventures, a Zurich-based deep-tech venture fund, and serves as a board member of the Global Blockchain Business Council and GirlsCanCode. Transcript Sovereign AI: Why States and Institutions Have to Take Back Their Digital Intelligence (HSToday, co-authored with Thomas Cellucci) Ekta AI

    • Transcript
  • S5 · E1
    March 12 · 32 min

    Ray Eitel-Porter, Co-Author of Governing the Machine: The Confidence to Use AI

    Ray Eitel-Porter, former Global Lead for Responsible AI at Accenture and co-author of the new book, Governing the Machine, discusses how enterprises can move from abstract AI principles to practical governance. He emphasizes that organizations can only realize AI's benefits if responsibility is embedded into everyday business processes rather than treated as a standalone compliance exercise. Drawing on his experience leading global data and AI programs, Eitel-Porter explains how the release of ChatGPT transformed enterprise attitudes toward AI, accelerating adoption while exposing risks such as hallucinations, reliability failures, and reputational harm. Effective governance has evolved from static principles to operational controls, including workflow checkpoints, red teaming, and technical guardrails, particularly for generative AI systems with inherently probabilistic outputs. On risk, he stresses that not all AI use cases require the same level of scrutiny; governance should scale with potential impact and harm, focusing on what an AI system is intended to do so that non-technical teams can surface high-risk use cases without incentives to downplay risk. On regulation, Eitel-Porter notes that despite uncertainty around the EU AI Act, many multinational companies are treating it as a global baseline, similar to GDPR, while contrasting this with more deregulatory signals from the United States and questioning the global influence of the UK's middle-ground approach. He also shares insights from Governing the Machine, co-authored with Miriam Bogle and Paul Donkhan, emphasizing that AI governance is not a barrier to innovation but the foundation that allows organizations to deploy AI at scale with confidence and control. Ray Eitel-Porter is a Senior Advisor at Accenture and the former Global Lead for Responsible AI, where he designed and scaled AI governance programs for multinational organizations. He previously led Accenture's data and AI practice in the UK and has over a decade of experience advising companies on responsible AI, data governance, and emerging technology risk. Eitel-Porter is the co-author of Governing the Machine: How to Navigate the Risks of AI and Unlock Its True Potential (Bloomsbury, 2025) and has led multi-year programs across public and private sectors, including global banks, retailers, and health brands. Transcript Governing the Machine (Bloomsbury 2025) Lessons from the Frontline – Designing and Implementing AI Governance (AI Journal)

    • Transcript
  • S4 · E15
    Dec 18, 2025 · 38 min

    Alexandru Voica: Responsible AI Video

    Alexandru Voica, Head of Corporate Affairs and Policy at Synthesia, discusses how the world's largest enterprise AI video platform has approached trust and safety from day one. He explains Synthesia's "three C's" framework—consent, control, and collaboration: never creating digital replicas without explicit permission, moderating every video before rendering, and engaging with policymakers to shape practical regulation. Voica acknowledges these safeguards have cost some business, but argues that for enterprise sales, trust is competitively essential. The company's content moderation has evolved from simple keyword detection to sophisticated LLM-based analysis, recently withstanding a rigorous public red team test organized by NIST and Humane Intelligence. Voica criticizes the EU AI Act's approach of regulating how AI systems are built rather than focusing on harmful outcomes, noting that smaller models can now match frontier capabilities while evading compute-threshold regulations. He points to the UK's outcome-focused approach—like criminalizing non-consensual deepfake pornography—as more effective. On adoption, Voica argues that AI companies should submit to rigorous third-party audits using ISO standards rather than publishing philosophical position papers—the thesis of his essay "Audits, Not Essays." The conversation closes personally: growing up in 1990s Romania with rare access to English tutoring, Voica sees AI-powered personalized education as a transformative opportunity to democratize learning. Alexandru Voica is the Head of Corporate Affairs and Policy at Synthesia, the UK's largest generative AI company and the world's leading AI video platform. He has worked in the technology industry for over 15 years, holding public affairs and engineering roles at Meta, NetEase, Ocado, and Arm. Voica holds an MSc in Computer Science from the Sant'Anna School of Advanced Studies and serves as an advisor to MBZUAI, the world's first AI university. Transcript Audits, Not Essays: How to Win Trust for Enterprise AI (Transformer) Synthesia's Content Moderation Systems Withstand Rigorous NIST, Humane Intelligence Red Team Test (Synthesia) Computerspeak Newsletter

    • Transcript
  • S4 · E14
    Dec 11, 2025 · 33 min

    Blake Hall: Safeguarding Identity in the AI Era

    In this episode, Blake Hall, CEO of ID.me, discusses the massive escalation in online fraud driven by generative AI, noting that attacks have evolved from "Nigerian prince" scams to sophisticated, scalable social engineering campaigns that threaten even the most digital-savvy users. He explains that traditional knowledge-based verification methods are now obsolete due to data breaches, shifting the security battleground to biometric and possession-based verification. Hall details how his company uses advanced techniques—like analyzing light refraction on skin versus screens—to detect deepfakes, while emphasizing a "best of breed" approach that relies on government-tested vendors. Beyond the threats, Hall outlines a positive vision for a digital wallet that functions as a user-controlled "digital twin," allowing individuals to share only necessary data (tokenized identity) rather than overexposing personal information. He argues that government agencies must play a stronger role in validating core identity attributes to stop synthetic fraud and suggests that future AI "agents" will rely on cryptographically signed credentials to act on our behalf securely. Ultimately, he advocates for a model where companies "sell trust, not data," empowering users to control their own digital identity across finance, healthcare, and government services. Blake Hall is the Co-Founder and CEO of ID.me, a digital identity network with over 150 million members that simplifies how individuals prove and share their identity online. A former U.S. Army Ranger, Hall led a reconnaissance platoon in Iraq and was awarded two Bronze Stars, including one for valor, before earning his MBA from Harvard Business School. He has been recognized as CEO of the Year by One World Identity and an Entrepreneur of the Year by Ernst & Young for his work in pioneering secure, user-centric digital identity solutions. Transcript He Once Hunted Terrorists in Iraq. Now He Runs a $2 Billion Identity Verification Company (Inc., November 11, 2025) "No Identity Left Behind": How Identity Verification Can Improve Digital Equity (ID.me)

    • Transcript
  • S4 · E13
    Dec 4, 2025 · 32 min

    Mitch Kapor: AI Gap-Closing

    Legendary entrepreneur and investor Mitch Kapor draws on his decades of experience to argue that while AI represents a massive wave of disruptive innovation, it also represents an opportunity to avoid mistakes made with social media and the early internet. In this episode, he contends that technologists tend toward over-optimism about technology solving human problems while underestimating downsides. Self-regulation by large AI companies like OpenAI and Anthropic is likely to fail, he suggests, because incentives to aggregate power and wealth are too strong, requiring external pressure and oversight. Kapor explains that his responsible investing approach at his venture capital firm, Kapor Capital, focuses on gap-closing rather than diversity for its own sake, funding startups that address structural inequalities in access, opportunity, or outcomes, regardless of founder demographics. He discusses the Humanity AI initiative and argues that philanthropy needs to develop AI literacy and technical capacity, with some foundations hiring chief technology officers to effectively engage with these issues. He believes targeted interventions can create meaningful change without matching the massive investments of the major AI labs. Kapor expresses hope that a younger generation of leaders in tech and philanthropy can step up to make positive differences, emphasizing that his generation should empower them rather than occupying seats at the table. Mitch Kapor is a pioneering technology entrepreneur, investor, and philanthropist who founded Lotus Development Corporation and created Lotus 1-2-3, the breakthrough spreadsheet software that helped establish the PC software industry in the 1980s. He co-founded the Electronic Frontier Foundation to advocate for digital rights and civil liberties, and later established Kapor Capital with his wife Freada Kapor Klein to invest in startups that close gaps of access, opportunity, and outcome for underrepresented communities. Kapor recently completed a masters degree at the MIT Sloan School focused on gap-closing investing, returning to finish what he started 45 years earlier when he left MIT to pursue his career in Silicon Valley. He serves on the steering committee of Humanity AI, a $500 million initiative to ensure AI benefits society broadly.

    • Transcript
  • S4 · E12
    Nov 20, 2025 · 34 min

    Brad Carson: Sharing AI's Bounty

    Former Congressman and Pentagon official Brad Carson discusses his organization, Americans for Responsible Innovation (ARI), which seeks to bridge the gap between immediate AI harms like and catastrophic safety risks, while bringing deep Capitol Hill expertise to the AI conversation . He argues that unlike previous innovations such as electricity or the automobile, AI has been deeply unpopular with the public from the start, creating a rare bipartisan alignment among those skeptical of its power and impacts. This creates openings for productive discussions about AI policy. Drawing on his military experience, Carson suggests that while AI will shorten the kill chain, it won't fundamentally change the human nature of warfare, and he warns against the US military's tendency to seek technical solutions to human problems . The conversation covers current policy debates, highlighting the necessity of regulating the design of models rather than just their deployment, and the importance of export controls to maintain the West's advantage in compute . Ultimately, Carson emphasizes that for AI to succeed politically, the "bounty" of this technology must be shared broadly to avoid tearing apart the social fabric Brad Carson is the founder and president of Americans for Responsible Innovation (ARI), an organization dedicated to lobbying for policy that ensures artificial intelligence benefits the public interest. A former Rhodes Scholar, Carson has had a diverse career in public service, having served as a U.S. Congressman from Oklahoma, the Undersecretary of the Army, and the acting Undersecretary of Defense for Personnel and Readiness . He also served as a university president and deployed to Iraq in 2008 . Transcript Former TU President Brad Carson Pushes for Strong AI Guardrails

    • Transcript
Showing 1–20 of 20 episodes