Beyond Model Metrics: Evaluating Real-World Impact of AI-Enabled Interventions in Healthcare
Mesa redonda | En línea
-
Organizado por:
Noora Health
Sobre el evento
We will present a practical evaluation approach for AI-assisted systems that integrates:
- Performance metrics with outcome and impact measurement
- Human-in-the-loop evaluation frameworks
- Mixed-method designs (quantitative + qualitative)
- Rapid learning and feedback loops for adaptive systems
The approach is designed for scalable, real-world applications, including mobile and messaging platforms.
Participants will learn how to evaluate AI-enabled interventions beyond technical performance, with a focus on use, outcomes, and decision-making. It will also cover how to systematically integrate user feedback into improving AI models and informing iterative design.
- Performance metrics with outcome and impact measurement
- Human-in-the-loop evaluation frameworks
- Mixed-method designs (quantitative + qualitative)
- Rapid learning and feedback loops for adaptive systems
The approach is designed for scalable, real-world applications, including mobile and messaging platforms.
Participants will learn how to evaluate AI-enabled interventions beyond technical performance, with a focus on use, outcomes, and decision-making. It will also cover how to systematically integrate user feedback into improving AI models and informing iterative design.
Presentador/a
| Nombre | Título | Biografía |
|---|---|---|
| Jamie S. Johnston | Research and Evaluation Director, Stanford Center for Health Education, Pediatrics - Infectious Diseases | Her work focuses on the use of technology to improve educational access and health education in under-resourced areas. Jamie completed a PhD in Economics of Education at the Stanford Graduate School of Education in 2017, where she was an Institute of Education Sciences (IES) doctoral fellow. |
| Wilson Lin | Assistant Professor in Information Systems & Analytics at the Santa Clara University Leavey School of Business | Wilson's research focuses on improving human interactions with humans, algorithms, and technologies to enable better outcomes. He uses empirical methods to study such human-centric questions in healthcare management and nonprofit management. Wilson earned his Ph.D. in Business Administration |
| Anubhav Arora | Executive Director, Platforms, Noora Health | Anubhav Arora is Executive Director of Platforms at Noora Health, where he leads digital product strategy and development. Previously, he conducted healthcare systems research at MIT, focusing on the future of work in healthcare, and served as a Legislative Fellow with the Indian Parliament. |
Moderador/a
| Nombre | Título | Biografía |
|---|---|---|
| Poornima Sharma | Research Manager, Global Team, Noora Health | Poornima Sharma is a public health researcher at Noora Health with an MPH from the University of Technology Sydney, Australia. She specializes in behaviour change, gender-sensitive evaluation, and AI in healthcare, focusing on translating evidence into equitable, human-centered health system improvements. |