Building access to the Regenstrief Institute is currently restricted. More on our coronavirus precautions.
See our coronavirus precautions.
justice scales image with quote from Peter Embi

Algorithms must be tested and continually monitored to assess impact of bias 

Artificial intelligence (AI)-driven healthcare has the potential to transform medical decision-making and treatment, but these algorithms must be thoroughly tested and continuously monitored to avoid unintended consequences to patients 

In a JAMA Network Open Invited Commentary, Regenstrief Institute President and Chief Executive Officer and Indiana University School of Medicine Associate Dean for Informatics and Health Services Research Peter Embí, M.D., M.S., strongly stated the importance of algorithmovigilance to address inherent biases in healthcare algorithms and their deployment. Algorithmovigilance, a term coined by Dr. Embí, can be defined as the scientific methods and activities relating to the evaluation, monitoring, understanding, and prevention of adverse effects of algorithms in healthcare.  

We wouldn’t think of treating patients with a new pharmaceutical or device without first ensuring its efficacy and safety,” said Dr. Embí. “In the same way, we must recognize that algorithms have the potential for both great benefit and harm and, therefore, require studyAlso, compared with drugs or devices, algorithms often have additional complexities and variations, such as how they are deployed, who interacts with them, and the clinical workflows where interactions with algorithms take place.”  

The commentary was in response to a study from IBM scientists evaluating different approaches to debiasing healthcare algorithms developed to predict postpartum depression. He stated the study suggests that debiasing methods can help address underlying disparities represented in the data used to develop and deploy the AI approaches. He also said the study demonstrates that the evaluation and monitoring of these algorithms for effectiveness and equity is necessary and even ethically required.  

“Algorithmic performance changes as it is deployed with different data, different settings and different human-computer interactions. These factors could turn a beneficial tool into one that causes unintended harm, so these algorithms must continually be evaluated to eliminate the inherent and systemic inequities that exist in our healthcare system,” Dr. Embí continued. “Therefore, it’s imperative that we continue to develop tools and capabilities to enable systematic surveillance and vigilance in the development and use of algorithms in healthcare.” 

“Algorithmovigilance—Advancing Methods to Analyze and Monitor Artificial Intelligence–Driven Health Care for Effectiveness and Equity” was published in JAMA Network Open.   

About Peter Embí, M.D., M.S. 

In addition to serving as the president and CEO of Regenstrief Institute, Peter Embí, M.D., M.S. is the Leonard Betley Professor of Medicine and associate dean for informatics and health services research at Indiana University School of Medicine, associate director of informatics with Indiana Clinical and Translational Sciences Institute and vice president for Learning Health Systems with Indiana University Health.  

About Regenstrief Institute

Founded in 1969 in Indianapolis, the Regenstrief Institute is a local, national and global leader dedicated to a world where better information empowers people to end disease and realize true health. A key research partner to Indiana University, Regenstrief and its research scientists are responsible for a growing number of major healthcare innovations and studies. Examples range from the development of global health information technology standards that enable the use and interoperability of electronic health records to improving patient-physician communications, to creating models of care that inform practice and improve the lives of patients around the globe.  

Sam Regenstrief, a nationally successful entrepreneur from Connersville, Indiana, founded the institute with the goal of making healthcare more efficient and accessible for everyone. His vision continues to guide the institute’s research mission.  

About IU School of Medicine

IU School of Medicine is the largest medical school in the U.S. and is annually ranked among the top medical schools in the nation by U.S. News & World Report. The school offers high-quality medical education, access to leading medical research and rich campus life in nine Indiana cities, including rural and urban locations consistently recognized for livability.  

MEDIA CONTACTS:
John Erickson
Regenstrief Institute
prteam@regenstrief.org
(317) 643-2313

Related News

May 07, 2021 • News
Regenstrief researcher wins American Board of Internal Medicine Foundation award for paper
Regenstrief Institute Research Scientist Richard Frankel, PhD, won the 2020 John A. Benson Jr., M.D., Professionalism Article Prize from the American Board of Internal Medicine (ABIM) Foundation. The award recognizes peer-reviewed journal articles that document the impact of medical professionalism on improving healthcare.   Dr. Frankel was the senior author on the paper “If your feelings were hurt, I’m sorry…” How…
Continue Reading >
May 07, 2021 • News
A bridge from classroom to providing actual patient care: A study of the Regenstrief tEMR
Anonymized real-world platform gives learners realistic experience with health IT As electronic medical records (EMRs) are increasingly used across the United States, the next generation of physicians, nurses, social workers, pharmacists and other clinicians need to acquire new knowledge and competencies related to use of EMRs early in their clinical education. But training is not…
Continue Reading >