Beyond Model Metrics: Evaluating Real-World Impact of AI-Enabled Interventions in Healthcare
Painel | Online
-
Organized by:
Noora Health
About the Event
We will present a practical evaluation approach for AI-assisted systems that integrates:
- Performance metrics with outcome and impact measurement
- Human-in-the-loop evaluation frameworks
- Mixed-method designs (quantitative + qualitative)
- Rapid learning and feedback loops for adaptive systems
The approach is designed for scalable, real-world applications, including mobile and messaging platforms.
Participants will learn how to evaluate AI-enabled interventions beyond technical performance, with a focus on use, outcomes, and decision-making. It will also cover how to systematically integrate user feedback into improving AI models and informing iterative design.
- Performance metrics with outcome and impact measurement
- Human-in-the-loop evaluation frameworks
- Mixed-method designs (quantitative + qualitative)
- Rapid learning and feedback loops for adaptive systems
The approach is designed for scalable, real-world applications, including mobile and messaging platforms.
Participants will learn how to evaluate AI-enabled interventions beyond technical performance, with a focus on use, outcomes, and decision-making. It will also cover how to systematically integrate user feedback into improving AI models and informing iterative design.
Speakers
| Nome | Título | Biography |
|---|---|---|
| Jamie S. Johnston | Research and Evaluation Director, Stanford Center for Health Education, Pediatrics - Infectious Diseases | Her work focuses on the use of technology to improve educational access and health education in under-resourced areas. Jamie completed a PhD in Economics of Education at the Stanford Graduate School of Education in 2017, where she was an Institute of Education Sciences (IES) doctoral fellow. |
| Wilson Lin | Assistant Professor in Information Systems & Analytics at the Santa Clara University Leavey School of Business | Wilson's research focuses on improving human interactions with humans, algorithms, and technologies to enable better outcomes. He uses empirical methods to study such human-centric questions in healthcare management and nonprofit management. Wilson earned his Ph.D. in Business Administration |
| Nikhil | Technical Product Manager, Noora Health | With a background in software engineering and over seven years of experience across engineering and product, he now leads AI product development at Noora Health. His work focuses on building and deploying AI systems that run reliably at scale, currently across India, Bangladesh, Indonesia, and Nepal |
Moderators
| Nome | Título | Biography |
|---|---|---|
| Poornima Sharma | Research Manager, Global Team, Noora Health | Poornima Sharma is a public health researcher at Noora Health with an MPH from the University of Technology Sydney, Australia. She specializes in behaviour change, gender-sensitive evaluation, and AI in healthcare, focusing on translating evidence into equitable, human-centered health system improvements. |