News
January 17, 2023

Novel framework provides ‘measuring stick’ for assessing patient matching tools

Shaun Grannis, M.D., M.S.

Match accuracy plays critical role in patient safety, quality of care and cost effectiveness

Accurate linking of an individual’s medical records from disparate sources within and between health systems, known as patient matching, plays a critical role in patient safety and quality of care, but has proven difficult to accomplish in the United States, the last developed country without a unique patient identifier. In the U.S., linking patient data is dependent on algorithms designed by researchers, vendors and others. Research scientists led by Regenstrief Institute Vice President for Data and Analytics Shaun Grannis, M.D., M.S., have developed an eight-point framework for evaluating the validity and performance of algorithms to match medical records to the correct patient.

“The value of data standardization is well recognized. There are national healthcare provider IDs. There are facility IDs and object identifiers. There are billing codes. There are standard vocabularies for healthcare lab test results and medical observations – such as LOINC® here at Regenstrief. Patient identity is the last gaping hole in our health infrastructure,” said Dr. Grannis. “We are providing a framework to evaluate patient matching algorithms for accuracy.

“We recognize that the need for patient matching is not going away and that we need standardized methods to uniquely identify patients,” said Dr. Grannis. “Current patient matching algorithms come in many different flavors, shapes and sizes. To be able to compare how one performs against the other, or even to understand how they might interact together, we have to have a standard way of assessment. We have produced a novel, robust framework for consistent and reproducible evaluation. Simply put, the framework we’ve developed at Regenstrief provides a ‘measuring stick’ for the effectiveness of patient matching tools.”

Individuals increasingly receive care from multiple sources. While patient matching is complex, it is crucial to health information exchange. Is the William Jones seen at one healthcare system the same person as the William, Will or Willy Jones or perhaps Bill or Billy Jones receiving care at other facilities? Does Elizabeth Smith’s name appear at different medical offices or perhaps at a physical therapy or a dialysis facility as Liz or Beth? To which Juan J. Gomez do various lab test results belong? Typos, missing information and other data errors as well as typical variations add to the complexity.

The framework’s eight-point approach to the creation of gold standard matching data sets necessary for record linkage encompasses technical areas including data preprocessing, blocking, record adjudication, linkage evaluation and reviewer characteristics. The authors note that the framework “can help record linkage method developers provide necessary transparency when creating and validating gold standard reference matching data sets. In turn, this transparency will support both the internal and external validity of recording linkage studies and improve the robustness of new record linkage strategies.”

Measures and standards are ubiquitous. “When you go to a gas station pump, the measure of how much gas goes through is standardized so that we know exactly how much is flowing. Similarly, we need to have a common way of measuring and understanding how algorithms for patient matching work,” said Dr. Grannis. “Our eight-pronged approach helps to cover the waterfront of what needs to be evaluated. Laying out the framework and specifying the tasks and activities that need to be completed goes a long way toward standardizing patient matching.”

In addition to playing a critical role in patient safety and quality of care, improved patient matching accuracy supports more cost-effective healthcare delivery in a variety of ways including reduction in the number of duplicate medical tests.

Authors, in addition to Dr. Grannis, of “A framework for a consistent and reproducible evaluation of manual review for patient matching algorithms,” are Agrayan K. Gupta, Indiana University; Huiping Xu, PhD, and Xiaochun Li, PhD, of Indiana University School of Medicine; Suranga N. Kasthurirathne (now Kasturi), PhD, formerly Regenstrief Institute; Matthew M. Ruppert, M.S., formerly University of Florida and Christopher A. Harle, PhD, University of Florida and Regenstrief Institute. The paper is published in JAMIA.

This work was supported by Agency for Healthcare Research and Quality grant 5R01HS023808-04.

About Shaun Grannis, M.D., M.S.
In addition to his role as vice president for data and analytics at Regenstrief Institute, Shaun Grannis, M.D., M.S., is the Regenstrief Professor of Medical Informatics and a professor of family medicine at Indiana University School of Medicine.

About Regenstrief Institute
Founded in 1969 in Indianapolis, the Regenstrief Institute is a local, national and global leader dedicated to a world where better information empowers people to end disease and realize true health. A key research partner to Indiana University, Regenstrief and its research scientists are responsible for a growing number of major healthcare innovations and studies. Examples range from the development of global health information technology standards that enable the use and interoperability of electronic health records to improving patient-physician communications, to creating models of care that inform practice and improve the lives of patients around the globe.

Sam Regenstrief, a nationally successful entrepreneur from Connersville, Indiana, founded the institute with the goal of making healthcare more efficient and accessible for everyone. His vision continues to guide the institute’s research mission.

About IU School of Medicine
IU School of Medicine is the largest medical school in the U.S. and is annually ranked among the top medical schools in the nation by U.S. News & World Report. The school offers high-quality medical education, access to leading medical research and rich campus life in nine Indiana cities, including rural and urban locations consistently recognized for livability.

Related News

photo of elderly Asian couple and graph showing that dementia prevelance doubles every five years after age 65

Dementia complicates cancer care, increasing risk of poorer clinical outcome and patient experience

Review authors make recommendations for treatment of cancer in patients with dementia Pre-existing dementia complicates cancer care and increases

Blood sugar monitoring devices pose wearability and use problems for older adults with diabetes and caregivers

A study conducted by Regenstrief Institute research scientists to examine the use, by older adults with Type 1 or

word art image of the effect on health outcomes where ageism and racism intersect

Expanding the national dialogue on healthcare to include the intersection of structural racism and ageism

Advocating for and supporting health equity Regenstrief Institute Research Scientist Kathleen Unroe, M.D., MHA, is a co-author of a

Dr. Shaun Grannis on the need for standardization in U.S. patient data matching

Dr. Shaun Grannis on the need for standardization in U.S. patient data matching

Dr. Shaun Grannis discusses the need to standardize patient identity matching — the last “gaping hole” in the U.S.