Measuring Impact: How Do We Know AI Is Improving Health Outcomes & Addressing Local Priorities?

Measuring Impact: How Do We Know AI Is Improving Health Outcomes & Addressing Local Priorities?

In this discussion, speakers Jude Kong, Executive Director of the Artificial Intelligence and Mathematical Modelling Lab (AIMM Lab) at the University of Toronto and Executive Director of the Global South AI for Pandemic and Epidemic Preparedness and Response Network (AI4PEP), and Chaitali Sinha, Senior Program Specialist at the International Development Research Centre (IDRC), examine how health systems, governments, and donors can rigorously evaluate the real-world impact of AI tools in healthcare. They explore questions of accountability, data ownership, sovereignty, and evidence generation, while discussing how evaluation frameworks can remain both scientifically rigorous and locally relevant as AI technologies evolve and scale across global health systems. This event is hosted in partnership with the Harvard Medical School Center for Bioethics. Timestamps: 00:03:31 - Reframing AI Evaluation in Global Health: Myths, Assumptions, and Missed Priorities 00:08:22 - Building Ethical and Locally Relevant AI Evaluation Frameworks 00:15:14 - IDRC’s Long-Term Strategy for AI Research Capacity in the Global South 00:21:46 - From Community Priorities to Deployment: Practical Evaluation in AI for Pandemic Preparedness 00:27:57 - Understanding the Four-Level Framework for Evaluating AI in Health Systems 00:32:44 - Responsible AI vs. the Race for Speed: Addressing the Structural Accountability Gap 00:37:32 - Community-Led AI Governance and Evaluation in the Global South 00:42:00 - How Global Funders Are Evolving Their Approach to AI Evaluation and Collaboration 00:44:36 - How Researchers, Students, and Institutions Can Join Global AI Health Networks 00:49:24 - Transition to Discussion on Data Quality and AI Evaluation Resources: Artificial Intelligence for Global Health | IDRC: https://idrc-crdi.ca/en/initiative/artificial-intelligence-global-health Responsible AI in Global Health: Solutions from the Global South: https://publichealth.jhu.edu/center-for-global-digital-health-innovation/responsible-ai-in-global-health-solutions-from-the-global-south Global South AI for Pandemic & Epidemic Preparedness & Response Network: https://ai4pep.org/ The Africa-Canada Artificial Intelligence & Data Innovation Consortium: https://acadic.org/ Decolonizing global AI governance: assessment of the state of decolonized AI governance in Sub-Saharan Africa: https://pubmed.ncbi.nlm.nih.gov/39113766/ The views expressed in this event are those of the speakers and do not represent the positions of the Harvard Global Health Institute or Harvard University. This session aims to foster nuanced, informed discussion and support meaningful dialogue across sectors and ideologies.