Reported Surgical Quality Measures Not Associated With Lower Infection Rates
Case Western Reserve Study Proposes Revision to Surgical Care Improvement Project (SCIP) Reporting
CLEVELAND - A study by investigators at Case Western Reserve University School of Medicine published in this week’s issue of JAMA found that public hospital comparison data reported by the U.S. Department of Health and Human Services does not accurately correlate with a patient’s risk for surgical postoperative infection. The retrospective, cohort study of more than 400,000 patients from 398 hospitals nationwide examined the relationship between reported adherence to six infection prevention Surgical Care Improvement Project (SCIP) measures and the probability of patient postoperative infection.
“The SCIP has done an outstanding job of designing and identifying proper infection prevention measures, but there is still more work to be done,” says Jonah J. Stulberg, MD, PhD, MPH, a recent graduate of Case Western Reserve University School of Medicine, and the lead author of the study. “Our analysis shows that using a multi-measure approach to prevention is associated with a lower probability of patient infection, and that is something I think everyone can appreciate.”
Due to new Value-Based Purchasing (VBP) incentives under the recently passed Health Care Reform Act, Medicare reimbursement will be tied to hospitals’ adherence to SCIP measures. Researchers found that using a composite infection prevention score, one that assesses more than two measures per patient visit, was more accurate in predicting the probability of a patient developing a postoperative infection. It predicted approximately a 15 percent decreased risk of postoperative infection.
Within the current system, Medicare reports performance only on individual SCIP measures. Dr. Stulberg, who will soon begin his residency in the Department of Surgery at University Hospitals Case Medical Center, and his co-authors recommend SCIP require multiple measures be performed and recorded at every single patient visit. They found this will result in a more accurate prediction of whether a patient will develop a postoperative infection.
“Our inability to demonstrate a statistically significant association between individual measures and clinical outcomes at the patient level suggests that the rates, as reported on the Hospital Compare website, do not necessarily infer quality differences between hospitals,” explains Siran Koroukian, PhD, Associate Professor of Epidemiology and Biostatistics at Case Western Reserve University School of Medicine and senior author of the study. “However, the multi-measure model in our study better captures the culture of quality in hospitals.”
The SCIP is a national quality partnership dedicated to reducing the rate of surgical complications. It is the first, and largest, movement to measure the quality of care delivered for surgical patients in the U.S. Comprised of 20 measures covering various discrete elements of patient care, the six measures examined in this study focus on infection prevention efforts, which include:
· Patients who received antibiotics within one hour prior to surgery
· Patients who received the appropriate antibiotic for their specific procedure
· Patients whose antibiotics were discontinued within 24 hours after surgery
· Cardiac surgery patients with a controlled postoperative blood glucose level
· Surgery patients with appropriate surgical site hair removal
· Colorectal surgery patients with immediate postoperative normothermia
Although SCIP prevention measures give a strong indication of postoperative infection complication rates, there are several factors independent of the measures which may play an important role in determining the rates. Other aspects influencing surgical patient outcomes include the skill and knowledge of the surgical team, a safe and clean working environment, and a general culture of quality surrounding patient care are likely to be at least as important to the assessment of hospital quality.
The study “Adherence to Surgical Care Improvement Project Measures and the Association With Postoperative Infections” and an editorial will be published in the June 23/30 issue of JAMA, the Journal of American Medical Association.
Drs. Stulberg and Koroukian’s co-authors include Conor P. Delaney, MD, PhD, Duncan V. Neuhauser, PhD, David C. Aron, MD, MS, and Pingfu Fu, PhD.
About Case Western Reserve University School of Medicine
Founded in 1843, Case Western Reserve University School of Medicine is the largest medical research institution in Ohio and is among the nation's top medical schools for research funding from the National Institutes of Health. The School of Medicine is recognized throughout the international medical community for outstanding achievements in teaching. The School's innovative and pioneering Western Reserve2 curriculum interweaves four themes--research and scholarship, clinical mastery, leadership, and civic professionalism--to prepare students for the practice of evidence-based medicine in the rapidly changing health care environment of the 21st century. Eleven Nobel Laureates have been affiliated with the school.
Annually, the School of Medicine trains more than 800 M.D. and M.D./Ph.D. students and ranks in the top 20 among U.S. research-oriented medical schools as designated by U.S. News &World Report "Guide to Graduate Education."
The School of Medicine's primary affiliate is University Hospitals Case Medical Center and is additionally affiliated with MetroHealth Medical Center, the Louis Stokes Cleveland Department of Veterans Affairs Medical Center, and the Cleveland Clinic, with which it established the Cleveland Clinic Lerner College of Medicine of Case Western Reserve University in 2002.