Skip to content
Artwork for Tried and Tested Podcast

Tried and Tested Podcast

PSI Services

Welcome to PSI’s Tried and Tested Podcast, hosted by Isabelle Gonthier. Tune in every other Thursday for expert conversations on testing, credentialing, and assessment. Each episode explores industry trends, practical insights, and the real work behind high stakes testing, featuring leaders and practitioners shaping the future of the assessment industry.

Play
  • 21 episodes
  • fortnightly
  • Avg 36 min
  • English
Counted on this page — what you have heard stays on this device, so it is not something the list can be paged by.
  • September 3 · 44 min

    From School to Skills: Rethinking Assessment, Credentials, and Workforce Readiness with Chad Buckendahl

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP speaks with Chad Buckendahl, PhD, ICE-CCP, Managing Partner at ACS Ventures, about how assessment, credentials, and workforce readiness can be better connected across the learner journey. Drawing on his work in program design, evaluation, standard setting, policy, legal issues, and validation studies across credentialing and education, Chad explores why school, work, and professional credentialing should not be treated as separate systems. As more education and credentialing leaders look for ways to connect classroom learning with future careers, Chad explains why durable skills, quantitative reasoning, data interpretation, and career-connected credentials deserve closer attention. The conversation covers credentials as checkpoints across lifelong learning, the role of high school in building workforce-ready skills, the risks of siloed systems, the importance of validity, reliability, and fairness, and why AI literacy should start with being a critical consumer of new technologies. What you’ll learn: How credentials can serve as checkpoints across a lifelong learning pathway Why school, workforce, and professional credentialing systems need stronger connections What durable skills, including reading, communication, and quantitative reasoning, mean for career readiness Why data interpretation may be one of the most important skills students need for work and life How high school credentials can help students explore career pathways without narrowing opportunity What education and credentialing leaders should consider before adding workforce credentials to school programs Why AI literacy should focus on critical thinking, source credibility, and responsible use How multidisciplinary learning can help people adapt as work, technology, and assessment continue to evolve Who should listen: Education and assessment leaders connecting school outcomes to workforce readiness Credentialing and certification professionals exploring earlier career pathways K-12 and secondary education leaders evaluating workforce-related credentials Employers and workforce development teams focused on durable skills and talent pipelines Psychometricians and program evaluators working across education and credentialing Policy and program leaders responsible for validity, fairness, and quality assurance Organizations thinking about how AI and technology should shape future-ready skills About the guest: Chad Buckendahl, PhD, ICE-CCP, is a Managing Partner with ACS Ventures, LLC with an emphasis in program design, evaluation, standard setting, policy, and legal issues. Dr. Buckendahl has designed and led development and validation studies for programs in credentialing and education. He regularly contributes thought leadership through professional conference presentations, white papers, journal articles, and book chapters. He currently serves on the joint committee for the revision of the Standards for Educational and Psychological Testing, technical advisory committees in the United States, Canada, and the United Kingdom for diverse licensure, certification, and education programs; and previously served on volunteer committees for the Association of Test Publishers (ATP), Institute for Credentialing Excellence (I.C.E.), International Test Commission (ITC), and National Council on Measurement in Education (NCME).

  • August 20 · 33 min

    Start Small, Build Trust, Scale Up: WPI’s Approach to AI in Credentialing

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP speaks with Haley Vanness, CAE, ICE-CCP, CMP, AAiP, Vice President of Water Professionals International, about WPI’s journey toward building trust in AI adoption. Drawing on her work leading certification programs for water and wastewater professionals, Haley shares how WPI approached AI intentionally, starting with a practical use case that could support candidates, engage subject matter experts, and build confidence with the board and stakeholders. As credentialing organizations explore where AI can responsibly fit into program strategy, Haley explains why WPI began with practice exam development before expanding into broader operational opportunities. The conversation covers board confidence, stakeholder communication, SME review and oversight, candidate preparation, AI governance, application and renewal workflows, exam development, and why successful AI adoption depends on solving real problems, staying transparent, and scaling only after trust has been built. What you’ll learn: Why WPI chose practice exam development as a practical starting point for AI adoption How board oversight, stakeholder expectations, and public trust shaped WPI’s approach Why AI adoption should begin with a real program need, not a technology announcement How subject matter experts supported item development, rationales, references, and review What changes when SMEs move from manual creation toward validation, refinement, and oversight How AI-supported practice tools can help candidates understand concepts, not just answer questions Where AI can support operations such as communications, applications, renewals, and candidate support Why governance, transparency, and human oversight are essential as AI use expands Who should listen: Credentialing and certification leaders exploring AI adoption Program owners balancing innovation, governance, and stakeholder trust Assessment professionals involved in item development, practice tests, or exam preparation Subject matter expert committees adapting to AI-supported workflows Licensure and certification organizations serving public safety professions Operations and product teams looking for responsible ways to use AI Organizations moving from small AI pilots toward broader program strategy About the Guest: Haley Vanness is the Vice President of Water Professionals International (WPI), where she leads strategic initiatives and oversees the development and growth of certification programs serving water and wastewater professionals worldwide. During her tenure, she has played a key role in expanding WPI’s in-house certification programs, enhancing their value, improving operational efficiency, and increasing engagement across the industry. Her work focuses on advancing workforce development, modernizing credentialing practices, and integrating innovative solutions—including artificial intelligence—into certification and program operations. Haley collaborates closely with industry partners, subject matter experts, and organizational leadership to ensure programs remain relevant, data-driven, and aligned with evolving workforce needs. With a background in neuroscience, psychology, and credentialing, she brings a unique, analytical approach to program design and strategic decision-making. Haley is passionate about building sustainable systems, strengthening professional pathways, and supporting the continued growth and recognition of water professionals.

  • August 6 · 37 min

    Taking the Future of Credentialing from Conversation to Practice with Pam Young Brown

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP speaks with Pam Young Brown, a product strategy consultant working at the intersection of skills assessment, credentialing, and workforce development. Drawing on her experience leading certification and learning products at Amazon Web Services and the Graduate Management Admission Council, Pam shares a practical perspective on where credentialing is headed and what it takes to build programs that remain meaningful as skills, technology, and workforce expectations evolve. As organizations move from talking about the future of credentialing to actually building it, Pam explains why modernization must start with customer needs, clear outcomes, and a realistic view of organizational risk. The conversation covers shorter skill shelf lives, lifelong learning, microcredentials and badges, employer trust, technology-enabled assessment experiences, the role of AI in exam development and security, and how credentialing organizations can balance innovation, speed, rigor, and credibility. What you’ll learn: Why the pace of change is forcing credentialing organizations to rethink how quickly programs evolve How shorter skill shelf lives are reshaping certification, microcredentials, and lifelong learning Why credentialing should tell a broader story about a person’s skills, experience, and growth What learners and employers need in order to understand and trust newer credentialing models How technology can improve exam development, security, and candidate experience when tied to a clear strategy Why speed and efficiency should not come at the expense of quality, validity, or reliability How organizations can balance incremental improvements with more disruptive innovation Where to start when moving from future-of-credentialing conversations to practical action Who should listen: Credentialing and certification leaders modernizing their programs Assessment professionals balancing innovation, rigor, and trust Product leaders building skills assessment or workforce learning solutions Workforce development teams focused on upskilling and future-ready talent Organizations exploring microcredentials, badges, or new skill recognition models Employers and talent leaders evaluating how credentials signal capability Teams trying to move from strategy discussions to practical implementation About the guest: Pam Young Brown is a product strategy consultant working at the intersection of skills assessment, credentialing, and workforce development. She was previously the product leader for the certification program at Amazon Web Services and director of product management at the Graduate Management Admission Council. At AWS, Pam revamped the AWS Certification portfolio, expanding into AI certifications, accelerating time to market, and introducing new microcredentials to meet the evolving needs of tech learners. At GMAC, she led the digital transformation of the test prep product portfolio, forging new partnerships and launching digital learning offerings to support candidates preparing for graduate management education. With over a decade of experience shaping credentialing products at two of the most recognized names in assessment, Pam brings a practitioner's perspective on where the industry is headed and what it takes to build credentials that are meaningful and future-ready.

  • July 23 · 33 min

    AI and the New Challenges Facing Educational Testing with UMass Amherst’s Stephen Sireci

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP speaks with Stephen G. Sireci, Ph.D., Distinguished Professor and Executive Director of the Center for Educational Assessment at the University of Massachusetts Amherst, about AI and the new challenges facing educational testing. Drawing on his work in psychometrics, validity, fairness, educational measurement, and test development, Stephen explores how AI is reshaping what assessment professionals can do, and what they must continue to scrutinize carefully. As generative AI becomes part of test development, scoring, translation, accessibility, reporting, and candidate preparation, this conversation examines what should change and what must remain foundational. Stephen discusses how assessment can better support learning, why AI outputs still require human interrogation, and what personalization means for long-standing ideas of standardization. He also explores validity evidence in AI-supported workflows, cultural and linguistic fairness, micro-credentials, and why validity research remains essential to the future of the testing profession. What you’ll learn: How AI is expanding what assessment professionals can do across the testing lifecycle Why assessments are increasingly being used to support learning, not only measure it What personalized assessment models could mean for validity, fairness, and traditional ideas of standardization Why AI outputs need to be interrogated, evaluated, and supported by evidence How AI may affect test development, scoring, alignment, translation, and accessibility What candidate use of AI means for defining the construct being assessed Where cultural and linguistic context matters when applying AI in assessment Why validity research remains central as testing programs adopt new technologies Who should listen: Educational testing and assessment leaders evaluating AI-enabled change Psychometricians and measurement professionals focused on validity and fairness Test developers exploring AI-supported item development, scoring, or alignment Credentialing and certification leaders considering AI’s impact on workforce skills Language assessment and multilingual testing professionals Researchers and graduate students working in educational measurement Organizations balancing innovation, defensibility, and public trust in testing About the guest:Stephen G. Sireci, Ph.D. is Distinguished Professor and Executive Director of the Center for Educational Assessment in the College of Education, University of Massachusetts Amherst. He earned his Ph.D. in psychometrics from Fordham University and his master and bachelor degrees in psychology from Loyola College Maryland. Before UMass, he was Senior Psychometrician at GED Testing Service, Psychometrician for the CPA Exam and Research Supervisor of Testing for the Newark NJ Board of Education. He is known for his research in validity and fairness of educational tests, and for innovations in test development. He currently serves/has served on several advisory boards including the National Board of Professional Teaching Standards, Duolingo English Test, and technical advisory committees for Florida, Maryland, New Hampshire, New York, Montana, Puerto Rico, and Texas. He is a Fellow of American Educational Research Association and of Division 5 of American Psychological Association, and a lifetime member of the National Academy of Education. He is a past President of International Test Commission, Northeastern Educational Research Association, and National Council on Measurement in Education. His UMass honors include School of Education’s Outstanding Teacher Award, Conti Faculty Fellowship, Public Engagement Fellowship, Outstanding Accomplishments in Research and Creative Activity Award, and the Chancellor’s Medal. He also received the Messick Memorial Lecture Award from Educational Testing Service/International Language Testing Association.

  • July 9 · 38 min

    Global Learning, AI, and the Future of Workforce Readiness with Maria Spies of HolonIQ and QS

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP, speaks with Maria Spies, Co-Founder of HolonIQ and Chief Innovation Officer at QS, about global learning, AI, and the future of workforce readiness. Drawing on more than 25 years in post-secondary education, workforce learning, and education technology, Maria explores how demographic change, technology, and shifting workforce needs are reshaping the way learners build skills and how organizations recognize them. As governments, employers, and education providers respond to rapid change, Maria explains why assessment and credentialing leaders need to think beyond traditional models of learning and proof. The conversation covers micro-credentials, alternative pathways, AI literacy, learning analytics, embedded learning in the flow of work, English language learning for global mobility, and why trusted evidence of skills will become increasingly important across the lifelong learning ecosystem. What you’ll learn: How global education and workforce trends are reshaping assessment and credentialing Why demographic shifts are creating different learning and skills needs across regions What is driving demand for micro-credentials, short courses, and alternative pathways Why proof of skills is becoming more important, and more complex, for learners and employers How technology and data can help make learning more observable without losing sight of design and trust What embedded learning in the flow of work could mean for future assessment models Why English language learning is a useful signal for broader workforce learning trends How leaders can focus innovation by building from their organization’s existing strengths Who should listen: Assessment and credentialing leaders planning for workforce change Education and training organizations building flexible learning pathways Workforce development leaders focused on upskilling and lifelong learning Employers and talent leaders thinking about proof of skills and workforce readiness Edtech, learning science, and product teams designing digital learning experiences Language assessment and English learning professionals tracking global mobility trends Organizations exploring how AI, data, and credentials can support trusted skill recognition

  • June 25 · 43 min

    From Point-in-Time Testing to Continuous Certification: Insights with NBCRNA’s Tim Muckle

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP, speaks with Tim Muckle, PhD, ICE-CCP, Chief Assessment Officer at the National Board of Certification and Recertification for Nurse Anesthetists, about longitudinal assessment and the future of continued professional certification. Drawing on his background in mathematics, psychometrics, healthcare certification, and assessment leadership, Tim explains how NBCRNA is rethinking recertification in a way that supports patient safety, lifelong learning, and trust with certificants. As certification programs look for models that are more continuous, flexible, and relevant, Tim shares how NBCRNA moved from a traditional point-in-time assessment toward the MAC Check, a longitudinal assessment model built around smaller quarterly question sets, immediate feedback, spaced repetition, and ongoing evidence of competence. The conversation also explores stakeholder engagement, change management, the balance between rigor and accessibility, how AI may influence clinical practice and assessment, and why mission alignment is essential when changing maintenance of certification programs. What you’ll learn: How longitudinal assessment differs from traditional point-in-time testing Why continuous certification can better support lifelong learning and professional growth How smaller, periodic question sets can reduce burden while still accumulating evidence of competence What immediate feedback, spaced repetition, and related retake questions add to the assessment experience Why psychometric defensibility alone is not enough to build stakeholder trust How NBCRNA used research, communication, and certificant feedback to support program change Where AI, evolving clinical practice, and expectations for relevance may shape future certification models Why assessment leaders should start with mission before redesigning recertification or maintenance programs Who should listen: Certification and recertification leaders exploring longitudinal assessment Assessment and credentialing professionals responsible for maintenance of certification programs Psychometricians and test developers balancing rigor, feedback, and learner support Licensure and healthcare certification organizations focused on public safety and continuing competence Program owners managing stakeholder trust, communication, and change Organizations rethinking how certification can better support lifelong professional learning About the guest:Dr. Muckle is the Chief Assessment Officer with the National Board of Certification and Recertification for Nurse Anesthetists (NBCRNA), based in Chicago, IL. In his career, Dr. Muckle has been responsible for overseeing the test development and psychometric quality of a variety of credentialing examinations. His work has included the development of innovative assessment formats (such as longitudinal assessment), consultation and steering of testing policy and strategy, and spearheading an assessment-focused research agenda. He brings 25+ years of experience in certification, test development and research to his present role. Tim has published numerous articles in testing-related scientific journals and publications and has been a regular presenter at meetings of the Association of Test Publishers (ATP), and the Institute for Credentialing Excellence, among others. Among his skills and qualifications are: strategic thinking and planning, organizational leadership, statistical analysis, research and publications, team building, innovative assessment formats, and volunteer service to the credentialing industry.

  • June 11 · 36 min

    What AI Changes About Assessment Evidence: Insights with Khan Academy’s Kristen DiCerbo

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP, speaks with Dr. Kristen DiCerbo, Chief Learning Officer at Khan Academy and one of Time’s top 100 people influencing the future of AI in 2024. Drawing on her background in school psychology, learning science, edtech, and assessment design, Kristen explores how AI is changing what assessment professionals can observe, interpret, and use as evidence of what learners know and can do. As assessment programs look for more authentic ways to measure real-world skills, Kristen explains why better tasks are only part of the equation. The conversation covers task models versus evidence models, the importance of closing the inferential distance, lessons from simulation and game-based assessment, Khan Academy’s “Explain Your Thinking” work, and why new measurement approaches should often begin in lower-stakes formative environments before moving into higher-stakes use. What you’ll learn: How AI can surface evidence of learner thinking beyond a single answer Why valid assessment starts with separating tasks from evidence What “closing the inferential distance” means for assessment design Where simulations, games, and open-ended tasks can create noise instead of signal Why new AI measurement approaches should start in low-stakes settings How to balance innovation with structure, validity, and defensibility What multimodal AI and on-device models could mean for future assessment Who should listen: Assessment and credentialing leaders exploring AI Psychometricians and test developers Certification and licensure program owners Edtech and learning science teams Product leaders building digital assessment experiences Educators working with formative or performance-based assessment About the guest:Dr. Kristen DiCerbo is the Chief Learning Officer at Khan Academy, where she leads the content, assessment, design, product management, and community support teams. Time magazine named her one of the top 100 people influencing the future of AI in 2024. Dr. DiCerbo’s career has focused on embedding insights from education research into digital learning experiences. Prior to her role at Khan Academy, she was Vice-President of Learning Research and Design at Pearson, served as a research scientist supporting the Cisco Networking Academies, and worked as a school psychologist. Kristen has a Ph.D. in Educational Psychology from Arizona State University.

  • May 28 · 37 min

    Test Security, Agentic AI, and the Future of Assessment with Paul Muir from risr/

    As assessment programs confront increasingly sophisticated fraud and rapid advances in Artificial Intelligence, protecting trust and integrity has never been more complex. In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP sits down with Paul Muir, Chief Customer Officer at risr/ and Board Chair of the Association of Test Publishers, for a candid conversation recorded live at the ATP Innovations in Testing Conference. With more than 25 years in the assessment industry, Paul shares a front‑line perspective on test security, the rise of agentic AI, and the evolving role of industry collaboration. Together, they explore how assessment leaders can move from reactive security measures to more strategic, forward‑looking approaches, and how ATP is helping guide the community through a period of rapid technological change. What you’ll learn: How the test security threat landscape is evolving, including organized cheating, content harvesting, and increasingly sophisticated fraud techniques Where assessment and credentialing programs remain most vulnerable today, and why keeping pace with fraud is such a challenge What agentic AI means in the context of assessment, and how more autonomous systems introduce both new risks and new opportunities How AI can be used proactively to strengthen test security rather than simply reacting to emerging threats How Paul’s dual perspective as a technology leader and ATP Board Chair informs his view of where assessment is headed The role ATP plays in helping the industry navigate innovation, security, and trust during periods of rapid change Why collaboration and community engagement are critical to protecting the integrity of assessment programs Who should listen: Assessment and credentialing leaders responsible for program integrity Test security, compliance, and risk professionals Education and assessment technology providers Organizations exploring or deploying AI in assessment programs ATP members and professionals engaged in the broader assessment community About the guest:Paul Muir serves as the Chief Customer Officer at risr/ and currently holds the position of Board Chair for the Association of Test Publishers (ATP). With over 25 years of experience in the assessment sector, Paul is an experienced leader and active volunteer, specialising in areas such as test security, assessment reform, technology-enabled assessment, and Artificial Intelligence. Since joining risr/ in 2024, Paul, who is based in the UK, has been responsible for driving thought leadership, developing strategic partnerships, and fostering engagement across the industry, community, and customer base.

  • May 14 · 35 min

    Serious Games and Authentic Assessment with Jenn McNamara from BreakAway Games

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD,- ICE CCP, Chief Assessment Officer at PSI and ETS, sits down with Jenn McNamara, Vice President of Strategic Products and Partnerships at BreakAway Games. Recorded live at the ATP Conference, the conversation explores how serious games are being used to support authentic, performance based assessment across defense, healthcare, and professional credentialing programs. Jenn shares how game based environments can capture real world decision making, reduce traditional test effects, and provide richer evidence of readiness than item based assessments alone. The discussion also covers the role of AI in game design and assessment delivery, the importance of accessibility by design, and what emerging innovation trends signal about the future of assessment. What you’ll learn: How “serious games” are defined and how they differ from surface level gamification Why authenticity, particularly cognitive fidelity, matters more than visual realism in assessment design What immersive, strategy based environments can reveal about real world decision making, stress, and readiness How independent research and validation help make game based assessment credible and defensible in high stakes contexts Where serious games are most effective in assessment programs, and where assessment leaders should be cautious How AI is influencing the future of immersive assessment, including adaptive scenarios and content variation, while maintaining rigor and fairness Who should listen: Credentialing and certification leaders exploring authentic or performance based assessment approaches Assessment professionals seeking new ways to evaluate decision making, judgment, and applied skills Psychometricians and assessment designers interested in emerging item types and validation models Program owners responsible for accessibility, candidate experience, and exam integrity Testing and education technology professionals tracking the role of serious games and AI in assessment About the Guest: Jenn McNamara is Vice President of Strategic Products and Partnerships at BreakAway Games, focused on delivering immersive solutions for education, assessment, and performance support. With over 25 years of experience in cognitive psychology, serious games, and AI-driven systems research and development, Jenn is a recognized leader and trusted partner raising the standard of advanced, technology-driven learning and assessment for defense, healthcare, and corporate sectors. Jenn’s pioneering design and development approaches set the accessibility standard for serious games. She speaks frequently at conferences including I/ITSEC, ATP Innovations in Testing, Serious Play, and Games for Change. In volunteer support of the industry, Jenn also directs the nonprofit Serious Games Showcase & Challenge and serves in leadership roles with the NDIA Human Systems Conference, Serious Play Conference, and ATP Innovations in Testing Conference.

  • April 30 · 36 min

    Libby Rodney from The Harris Poll on the 2026 ETS Human Progress Report: Adaptability, Credentials & Opportunity

    This is our 50th episode of Tried & Tested and we’re marking the milestone with a conversation about what may be one of the biggest questions facing the workforce right now: how do people prove what they can do as change accelerates? Host Isabelle Gonthier welcomes Libby Rodney, Chief Strategy Officer at The Harris Poll, to unpack what “proof” looks like in today’s disrupted environment and why credentials are increasingly tied to confidence, mobility, and opportunity. Drawing on The Harris Poll research behind the 2026 ETS Human Progress Report, Libby Rodney explains how leaders can move beyond noisy narratives and toward signals that actually matter, especially as workers face rapid disruption, shifting skill demands, and rising pressure to demonstrate adaptability. Together, they explore the widening gap between interest and access, the need for clearer employer signals about what’s valued, and why the future of credentialing depends on trust, alignment, and measurable evidence, not just storytelling. What you’ll learn: What “proof of skills” really means in a labor market shaped by constant disruption and why workers are seeking evidence they can carry across roles and industries. How the 2026 ETS Human Progress Report was designed, including the role of benchmarking and how the focus evolved toward adaptability as a cornerstone theme. Why credentials are rising in importance right now, including the connection between workplace anxiety and the need for verifiable evidence of capability. What’s driving the demand vs. access gap (high interest, lower access), and the practical barriers that keep people from pursuing credentials. Why employer clarity is the unlock: what workers need employers to specify about which credentials matter, and why ambiguity discourages investment before cost even enters the picture. How AI is reshaping credential expectations, including why many workers want formal certification to verify AI skills, and why “using AI” isn’t the same as using it well. Who should listen: Credentialing, certification, and assessment leaders designing programs that must earn trust and prove value. Employers, HR, and workforce strategy teams deciding which skills and credentials matter most. Education and training leaders working to close the gap between learning pathways and real-world opportunity. About the guest: A scenario planner, cultural strategist, and navigation expert, Libby Rodney serves as Chief Strategy Officer at The Harris Poll where she helps Fortune 100 executives decode uncertainty and navigate transformational change.  Creator of “The Next Big Think!” substack and co-host of “So Get This” podcast (new on Bubbler/iHeart Radio), her cultural intelligence framework has predicted major shifts including “quiet vacationing,” FOBO (fear of being obsolete), and the “lottery over logic economy.”  Libby has commanded global stages at Davos, Cannes Lions, SXSW, Forbes CMO summit, Ad Week, and CES, establishing her as the go-to cultural decoder for organizations seeking to see around corners.  Libby’s insights have been featured across major media outlets where she has become known for revealing not just what’s trending, but what companies must pay attention to in the next 18 months.

  • April 16 · 31 min

    Closing the Modality Gap: How TOEFL Built Trust in Remote Testing

    As questions around remote testing and test security continue to surface across the assessment landscape, how can programs move beyond perception and focus on evidence? In this episode of Tried and Tested, host Isabelle Gonthier is joined by Paul Gollash, SVP of TOEFL and GRE at ETS, and Wally Dalrymple, Chief Security Officer at PSI and ETS, for a timely conversation on trust, data, and delivery modalities. Together, they explore how the TOEFL program has evolved a layered security model across both test center and remote delivery. The result is measurable outcomes showing that differences between remote and test center delivery have narrowed to a minimal level. From identity verification and fraud indicators to data driven decision making and continuous improvement, this episode offers a practical and credible look at how security, scale, and trust come together in modern assessment programs. What you’ll learn: Why remote testing and test center delivery have distinct risk profiles, and how purpose built security approaches for each modality strengthen overall test integrity How the TOEFL program designed and evolved a layered security model that spans the full assessment lifecycle, from registration and identity verification through delivery, review, and continuous improvement What layered security looks like in practice, including how multiple controls work together to deter fraud, detect risk, and protect score integrity when individual signals alone are insufficient How ETS and PSI measure the real-world impact of specific security controls, including what the data reveals when individual layers are modified or removed Why outcome based measures, such as score patterns and pass rate alignment, provide a more meaningful indicator of trust than incident counts or flagged events alone How operating at global scale enables stronger pattern detection, faster response to emerging threats, and continuous refinement of security strategies across programs and modalities How AI is influencing both sides of the equation, accelerating new forms of fraud while also strengthening detection, analysis, and decision-making within modern test security programs What assessment leaders should consider as trust, security, and delivery models continue to evolve in an environment where risk, technology, and stakeholder expectations are constantly changing Who should listen: Assessment, credentialing, and certification leaders responsible for program integrity and long term trust Test security, fraud prevention, and risk professionals designing or evaluating security models across delivery modalities Higher education institutions, regulators, and score accepting organizations seeking evidence based perspectives on remote testing outcomes Program owners and product leaders balancing access, candidate experience, and rigorous security requirements Organizations navigating concern around the credibility of remote English language testing and other high stakes assessments

  • April 8 · 41 min

    Policy, Partnership, and Access: Massachusetts’ Approach to Adult Education

    In this special HiSET edition of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP welcomes vice president of the HiSET program Tanya Guerrero Haug, who sits down with Wyvonne Stevens‑Carter, Associate Commissioner for Public Adult Education at the Massachusetts Department of Elementary and Secondary Education. Recorded live at the HiSET Boston Roadshow, the conversation highlights how Massachusetts is expanding access to high school equivalency through statewide funding, flexible transcript policies, and partnerships that prioritize learner experience. Isabelle and Tanya also reflect on why the Massachusetts model stands out across the nation. From student ambassadors and staff pipelines to community‑driven innovation, this episode shows what is possible when policies remove barriers and adult learners are invited to lead. It is a compelling look at how assessment can open doors for individuals, families, and entire communities. What you’ll learn: How Massachusetts funds high school equivalency testing statewide and why this increases access for learners. Why the skills gap may actually be an investment gap and what this means for workforce development. How student ambassadors and student‑to‑staff pipelines create new opportunities for adult learners. The role partnerships play in strengthening adult education and supporting diverse learner needs. Key policy decisions that made Massachusetts a national example in high school equivalency access. Who should listen: Adult education leaders, instructors, and administrators Workforce development and policy professionals Credentialing and assessment partners working to improve access Employers seeking to better understand the value adult learners bring Anyone committed to building opportunity through education and assessment About the Guests Tanya Guerrero Haug, Vice President of HiSET, oversees the HiSET Program supporting the 30 states and territories that have adopted the HiSET. In this role, Tanya coordinates with the PSI HiSET Program teams, the HiSET Board, state directors and administrators, adult education providers, test centers, employers, and higher education institutions. Tanya’s team is directly responsible for HiSET contracts and partnerships, the HiSET suite of products, and adult education outreach. She oversees the HiSET webinars and conferences to keep professional development and program updates accessible. For more than 20 years, she has demonstrated her commitment to education by the various positions she has held in the industry and by her active community service. Wyvonne Stevens Carter is a senior education and workforce systems leader with deep expertise in adult education policy, cross agency alignment, and public investment strategy. As Associate Commissioner of Adult and Community Learning Services at the Massachusetts Department of Elementary and Secondary Education, she leads statewide efforts to strengthen adult learning systems that advance economic mobility, workforce readiness, and civic participation. Her work centers on designing and operating large scale public systems, aligning state and federal policy, funding, and accountability to ensure adult learners can access high quality pathways into postsecondary education, credentials, and family sustaining employment. She oversees complex funding portfolios, guides competitive procurements and performance based initiatives, and translates policy into clear operational frameworks that support implementation at scale. She brings particular strengths in state and federal policy implementation across adult education, workforce, and career pathways; systems integration spanning education, workforce development, and economic development; equity driven strategy and governance; fiscal oversight and public investment stewardship; data informed accountability and continuous improvement; and partnership development with government agencies, employers, higher education, and community organizations.

  • March 25 · 41 min

    The Future of Graduate Admissions and Assessment: Insights from GMAC’s Ashok Sarathy

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP, speaks with Ashok Sarathy, Vice President of Assessment Products at GMAC, about the evolving role of assessment in global graduate management education. Drawing on more than two decades in the assessment industry, Ashok shares how GMAC has continuously adapted the GMAT and its broader assessment portfolio to meet changing candidate, institutional, and workforce needs. Recorded live in India during the i-ATP conference, the conversation explores global student mobility, holistic admissions, and the growing pressure on assessments to be more flexible, digital, and candidate-centered, while still maintaining rigor. Ashok discusses how technology and AI can improve preparation, fairness, and efficiency, while also highlighting where caution and strong governance remain essential. What you’ll learn: How GMAC approaches the balance between assessment rigor and candidate experience Why holistic admissions models are reshaping the role of standardized testing Key barriers students face when pursuing global graduate management education How assessments can better reflect real-world and workforce-relevant skills Where AI can enhance personalization, scale, and fairness in assessment design Why human-in-the-loop oversight remains critical when applying AI in testing What the future of admission testing may look like, including lower-stakes pathways Who should listen: Assessment and testing professionals navigating digital and AI-enabled change Higher education leaders involved in admissions and student mobility strategy Credentialing and assessment program owners balancing rigor and experience Test development and product leaders responsible for portfolio strategy Organizations exploring the future of admissions testing and candidate pathways About the Guest: Ashok Sarathy is Vice President, Assessment Products at GMAC and a former Chair of the Board of Directors of the Association of Test Publishers (ATP). At GMAC he is responsible for establishing the Assessment Portfolio Strategy, identifying opportunities for new Assessments and has P&L responsibility of the portfolio. Ashok has spent than 22 years in the assessment industry, initially enabling GMAC to transition the development and the delivery of the GMAT exam to new partners and in the process redefined the digital user experience associated with taking the GMAT exam. He implemented several innovations to improve the integrity of the GMAT Test. Later he launched the Next Generation GMAT exam, adding a new “Integrated Reasoning” section to the exam with input from faculty at business schools. He then assumed a product management role responsible for the P&L of the key products within the council’s assessment portfolio, launching new assessments like the NMAT exam and other candidate-friendly enhancements that enabled test takers to embark on their journey towards a management career. He developed and implemented the strategy to overhaul the supply chain necessary to deliver the portfolio of Assessment Products to drive market relevance, establish core capabilities and drive operational effectiveness. In 2020 he led the move to have GMAC’s suite of Assessment Products (the GMAT, the NMAT and the Executive Assessment) delivered online at the onset of COVID-19. He also evolved the customer care model to drive a timely and more satisfying response to candidate inquiries. Managing the intersection between applicants and management institutions, Ashok is always looking to develop and enhance assessments that are relevant, efficient and offer great test taking experience.

  • March 11 · 36 min

    Reimagining Performance-Based Assessment with Immersive Simulation: A Conversation with SentiraXR’s Jeremy Carter

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP, speaks with Jeremy Carter, CEO of SentiraXR, about immersive simulations and the future of assessment. Jeremy shares how immersive environments can move learners beyond learning about a situation and into performing inside a realistic scenario, allowing assessment teams to observe competency, decision making, reasoning, and communication in real time. Jeremy explains how SentiraXR uses immersive simulation and AI-driven patient avatars to support authentic conversations, standardized scenarios, and detailed data capture. They discuss anytime and anywhere access through browser-based delivery, how rich interaction data can feed rubric-based reporting and learner feedback, and why a human in the loop approach is critical when using AI in assessment. The conversation also covers practical adoption guidance, including starting with one high-value scenario, maintaining sound assessment design principles, and treating implementation as a change management project. What you’ll learn: How immersive simulation differs from traditional e-learning for assessing competency What real-time performance data can reveal, including decisions, reasoning, and communication How AI avatars support more natural, conversation-based assessment scenarios Why standardized virtual scenarios create a more consistent experience for learners How transcription, data capture, and rubrics enable richer feedback for learners and educators What to consider when piloting immersive assessment, including starting with one high-value scenario Why human-in-the-loop review and AI guardrails matter in assessment use cases Where immersive assessment is heading next, including adaptive approaches and psychometrics Who should listen: Credentialing and certification teams exploring performance-based and skills-based assessment Assessment leaders looking for more authentic ways to evaluate communication and real-time decision making Program owners working with practical assessment formats who want more standardized scenarios Assessment designers and SMEs involved in scenario design and rubric development Education and testing technology professionals evaluating XR delivery models, browser-based access, and AI avatars Organizations focused on fairness, consistency, and learner preparation through repeatable practice and feedback About the Guest: Jeremy Carter is CEO and co-founder of Sentira XR, a University of Manchester spin-out developing immersive simulations and AI-enabled tools for education. With over 25 years’ experience in learning and assessment technology, Jeremy has worked with universities, professional bodies and awarding organisations to modernise how skills are taught and evaluated. He regularly speaks about the future of assessment and the role of emerging technologies in supporting authentic learning and skills development. If you found this conversation valuable, subscribe to Tried and Tested for more expert insights on credentialing, assessment, test security, and exam integrity. In This Episode: 00:00 Intro 00:45 Meet Jeremy Carter, CEO of SentiraXR 03:01 Immersive Simulation vs Traditional E-Learning 06:08 How XR Supports Performance-Based Assessment 07:47 Anytime, Anywhere Access to Immersive Assessment 11:20 How Simulation Data Improves Feedback and Evaluation 15:02 Moving from Traditional Exams to Immersive Simulations 19:26 Balancing Assessment Rigor with New Technology 23:11 Accessibility and Fairness in Immersive Simulations 27:39 The Future of Assessment: XR, AI, and Data 31:50 Advice for Assessment Leaders Exploring Immersive Tools 36:03 Closing Thoughts

  • February 26 · 32 min

    The Rising Threat of Biometric Fraud: Insights with Entrust’s Ian Cartledge

    In this episode of Tried and Tested, host Isabelle Gonthier, PhD, ICE-CCP speaks with Ian Cartledge from Entrust about identity verification and the evolving fraud landscape impacting credentialing and high-stakes testing. As online testing and digital registration processes expand, identity verification plays an increasingly important role in protecting exam integrity and ensuring the right candidate is taking the test. Referencing Entrust’s seventh annual Identity Fraud Report, which draws on more than one billion identity verification transactions across 195 countries, Ian discusses the rise in AI-enabled fraud, including deepfakes, injection attacks, and commercially organized fraud operations. The conversation explores how baseline identity verification, biometric and biographic matching, liveness detection, motion analysis, and layered verification approaches can help assessment programs reduce risk while managing friction in the test taker experience. What You’ll Learn How AI-enabled fraud is becoming more organized, commercially accessible, and scalable Why deepfakes are increasing across industries and the implications for online testing What injection attacks are and how synthetic video can be used to bypass identity checks How liveness detection and motion analysis help identify impersonation attempts The importance of establishing a secure baseline identity during registration How layered identity verification tools can be used across the assessment lifecycle Why balancing security controls with reduced friction is critical for candidate experience Who should listen: Credentialing and certification leaders responsible for exam integrity Assessment professionals managing online testing or remote delivery Licensure program directors evaluating identity verification practices Test security and compliance teams monitoring fraud risk Organizations seeking to strengthen identity verification within existing assessment processes Guest: Ian Cartledge, UK Home Office Senior Liaison, Entrust Ian Cartledge is a seasoned executive leader with over 30 years of industry consulting experience delivering complex digital transformation journeys with a special focus on the public sector. He has served as a trusted advisor on numerous large-scale public-private partnerships, applying his deep understanding of market drivers and cross-sector innovation to optimize organizational efficiency and profitability. Currently, as Entrust’s senior liaison with the UK Home Office, Ian plays a pivotal role in strategic government relations for identity verification and digital identity solutions. Ian will provide actionable insights on establishing secure and trusted identity ecosystems between citizens, governments, and global service providers, illustrated with real-world examples. If you found this conversation valuable, subscribe to Tried and Tested for more expert insights on credentialing, assessment security, and exam integrity.

  • February 12 · 36 min

    The Future of Digital Assessment: Innovation, AI & Sustainability with Geoff Chapman

    Discover how digital assessment is evolving through innovation, AI, and sustainable design in this conversation with EdTech consultant Geoff Chapman. What You'll Learn Where AI is reshaping the assessment lifecycle Why sustainable assessment must be built into assessment design How e-assessment impacts infrastructure, energy use, and learner experience Practical considerations for selecting and scaling digital assessment solutions The conversation examines how digitization and AI are reshaping assessment, while also introducing new challenges related to environmental impact, energy use, and system design. Drawing on his experience founding and exiting three education businesses, Geoff discusses growth strategy, solution selection, M&A, and why assessment organizations must better understand the full lifecycle of testing, from item development and psychometrics to delivery infrastructure and learner experience. Geoff also shares why sustainability, benchmarking, and data-driven decision-making should be central to assessment innovation, not afterthoughts. Whether you’re an exam owner, solution provider, or certification leader navigating digital transformation, this episode offers thoughtful insight into how the assessment community can innovate responsibly—while protecting quality, trust, and long-term value for learners worldwide.

  • January 28 · 31 min

    Building Connection and the Business Value of HR Certification

    In this episode of Tried and Tested, host Isabelle Gonthier is joined live from the I.C.E. Conference by Amy Schabacker Dufrane, Ed.D., SPHR, CAE, CEO of HRCI® — HR Certification Institute, to explore how HR certification builds connection, credibility, and measurable value for today’s workforce. As the leader of the world’s premier certifying and learning organization for the HR profession, Amy shares insights shaped by decades of experience across public, private, regulatory, and education sectors. The conversation focuses on the evolving role of certification as a strategic lever for workforce development, organizational performance, and global talent mobility. Amy discusses how HRCI has expanded beyond credentials to support continuous learning, professional community, and internationally aligned standards—while helping organizations upskill and reskill talent in the face of rapid change, including the growing influence of AI and shifting workplace expectations. Amy also reflects on the importance of engagement, thought leadership, and lifelong learning in elevating the HR profession, drawing on her work as a co-author, speaker, and creator of influential HR learning initiatives. Whether you’re a certification leader, HR professional, or credentialing organization seeking to demonstrate ROI, strengthen engagement, or support professionals at a global scale, this episode offers valuable perspective on how certification can drive both individual growth and organizational impact. What You'll Learn: How certification delivers measurable business value How organizations evaluate certification ROI Why certification strengthens trust and career development How it supports global talent mobility and long‑term capability building

  • January 16 · 36 min

    2026 Predictions: What’s Next for Assessment, AI, and Test Security with Janet Garcia

    In this forward-looking episode of Tried and Tested, host Isabelle Gonthier is joined by Janet Garcia, CEO of PSI and President of ETS, for a timely conversation on what’s next for assessment as the profession looks toward 2026. Recorded at PSI’s headquarters in Olathe, Kansas, the discussion reflects on the shifting landscape of credentialing and licensure and the growing responsibility assessment organizations carry in protecting public trust. Janet shares her predictions for the coming year, highlighting how artificial intelligence is reshaping the entire assessment lifecycle—from content development and delivery to how competence itself is defined in an AI-enabled workforce. The conversation explores evolving expectations around relevance, data-driven decision-making, and whether traditional single-point exams can continue to meet the needs of rapidly changing professions. The episode also takes a deep dive into test security, examining how emerging technologies present both new risks and powerful solutions. Janet outlines how AI, advanced identity verification, biometrics, and continuous monitoring are being used to stay ahead of increasingly sophisticated threats while preserving exam integrity at scale. Whether you’re a credentialing leader, testing professional, educator, or regulator, this episode offers practical insight into the trends and decisions that will shape assessment, AI adoption, and test security in 2026 and beyond.

  • January 2 · 40 min

    Reflecting Forward: 2025 Highlights from Tried and Tested

    In this special episode of Tried and Tested, host Isabelle Gonthier opens the new year with a curated look back at the most meaningful moments from the podcast’s 2025 conversations. Featuring standout clips and Isabelle’s personal reflections, this episode revisits the insights, innovations, and expert perspectives that shaped last year’s dialogue across credentialing, licensure, test design, and the evolving test-taker experience. Following a simple, narrative-driven format, Isabelle introduces each featured moment—offering context from the original episode, highlighting key takeaways from her guests, and sharing why the clip still resonates as we move into 2026. From competency models and workforce readiness to emerging technologies and multi-modal testing, this collection showcases the themes that defined 2025 for PSI’s global audience. Whether you’re catching up after the holidays, exploring episodes you missed, or seeking inspiration for the year ahead, this highlight reel delivers a thoughtful, energizing start to 2026—celebrating the conversations that continue to shape the future of testing and credentialing.

  • #41
    Dec 18, 2025 · 31 min

    Evolving Competency Models to Shape the Future of Certification

    In this episode of Tried and Tested, host Isabelle Gonthier sits down with Tony Ellis, Executive Director of the Oncology Nursing Certification Corporation (ONCC), for a deep dive into how competency modeling is reshaping the future of certification and professional development in oncology nursing. Recorded at ONCC’s Pittsburgh offices, Tony shares his unique path into credentialing and the lessons learned across accreditation, competency modeling, and certification program design. Tony discusses ONCC’s innovative approach to aligning competency profiles, role delineation studies, and test content outlines—creating a more cohesive and strategic framework for developing new credentials. He also highlights ONCC’s work on stackable credentials, assessment-based certificates, and the rigorous research guiding decisions about when a certificate should (or should not) evolve into a full certification. The conversation also introduces the ONCC “Runway” program, an onboarding and development pathway supporting new oncology nurses as they build readiness and confidence. Whether you’re refining your own certification programs, exploring modular learning pathways, or navigating how competencies can better serve workforce needs, Tony’s insights offer practical, forward-looking guidance for today’s credentialing leaders.

Showing 1–20 of 21 episodes