 |
 |
|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Summaries for Patients are a service provided by Annals to help patients better understand the complicated and often mystifying language of modern medicine.
SUMMARIES FOR PATIENTS
The Reliability of Medical Record Review for Estimating the Frequency of Medical Mistakes
4 June 2002 | Volume 136 Issue 11 | Page I40
Summaries for Patients are presented for informational purposes only. These summaries are not a substitute for advice from your own medical provider. If you have questions about this material, or need medical advice about your own health or situation, please contact your physician. The summaries may be reproduced for not-for-profit educational purposes only. Any other uses must be approved by the American College of Physicians-American Society of Internal Medicine.
The summary below is from the full report titled "The Reliability of Medical Record Review for Estimating Adverse Event Rates." It is in the 4 June 2002 issue of Annals of Internal Medicine (volume 136, pages 812-816). The authors are EJ Thomas, SR Lipsitz, DM Studdert, and TA Brennan.
What is the problem and what is known about it so far?
In 1999, the U.S. Institute of Medicine reported that mistakes in U.S. hospitals are alarmingly frequent. This report relied on studies that used doctors and nurses to review patients' medical records to identify mistakes. In these studies, the doctors and nurses looked at the medical records to first decide whether a patient had experienced a complication. Second, they had to decide whether the complication was related to medical care. Third, they needed to decide whether the complication was an expected side effect or was caused by someone's mistake. Judging whether someone made a mistake can be difficult when you have only the information in the patient medical record.
Why did the researchers do this particular study?
To learn more about the reliability of estimates of medical mistakes determined by medical record review.
What was studied?
500 medical records of patients who had been hospitalized in Utah or Colorado in 1992.
How was the study done?
Three separate doctors reviewed each medical record according to the same set of instructions. The researchers then calculated how frequent mistakes were among the 500 patient records using different definitions. The definitions varied according to the number of reviewers and their level of certainty required to count a complication as a mistake.
What did the researchers find?
The estimated number of mistakes ranged from fewer than 1% (1 in 100) to more than 32% [32 in 100], depending on the rules set by the researchers. The following changes in the review process markedly decreased the estimates of mistakes: 1) increasing the number of reviewers from one to three and 2) requiring reviewers to be highly confident that a complication was due to a mistake.
What were the limitations of the study?
This study involved only three reviewers. The results might vary with a different set of reviewers. Moreover, there was no way to know for certain that a mistake had actually occurred. The number of mistakes found in these records is not an estimate of a patient's risk for being injured in a hospital.
What are the implications of the study?
It is difficult to determine from a review of patient charts whether medical mistakes have occurred. The estimates reported by the Institute of Medicine could be inaccurate.
Related articles in Annals:
This article has been cited by other articles:
|
|
 |
|
  J M Aranaz-Andres, C Aibar-Remon, J Vitaller-Murillo, P Ruiz-Lopez, R Limon-Ramirez, E Terol-Garcia, and the ENEAS work group Incidence of adverse events related to health care in Spain: results of the Spanish National Study of Adverse Events J Epidemiol Community Health, December 1, 2008; 62(12): 1022 - 1029. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 T K Nuckols, D S Bell, S M Paddock, and L H Hilborne Contributing factors identified by hospital incident report narratives Qual. Saf. Health Care, October 1, 2008; 17(5): 368 - 372. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. Ramanath and T. J. Hendra How safe are our hospitals? Age Ageing, May 1, 2008; 37(3): 243 - 245. [Full Text] [PDF]
|
|
|
|
 |
|
 G. S. Takata, W. Mason, C. Taketomo, T. Logsdon, and P. J. Sharek Development, Testing, and Findings of a Pediatric-Focused Trigger Tool to Identify Medication-Related Harm in US Children's Hospitals Pediatrics, April 1, 2008; 121(4): e927 - e935. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P D Mills, J Neily, L M Kinney, J Bagian, and W B Weeks Effective interventions and implementation strategies to reduce adverse drug events in the Veterans Affairs (VA) system Qual. Saf. Health Care, February 1, 2008; 17(1): 37 - 46. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. B.-A. Sari, T. A Sheldon, A. Cracknell, A. Turnbull, Y. Dobson, C. Grant, W. Gray, and A. Richardson Extent, nature and consequences of adverse events: results of a retrospective casenote review in a large NHS hospital Qual. Saf. Health Care, December 1, 2007; 16(6): 434 - 439. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 F. Goulet, A. Jacques, R. Gagnon, P. Racette, and W. Sieber Assessment of Family Physicians' Performance Using Patient Charts: Interrater Reliability and Concordance With Chart-Stimulated Recall Interview Eval Health Prof, December 1, 2007; 30(4): 376 - 392. [Abstract] [PDF]
|
|
|
|
 |
|
 P. N. Gorman Measuring the Care of the Patient in Context Med Decis Making, December 1, 2007; 27(6): 724 - 725. [PDF]
|
|
|
|
 |
|
 P. J. Marang-van de Mheen, E.-J. F. Hollander, and J. Kievit Effects of study methodology on adverse outcome occurrence and mortality Int. J. Qual. Health Care, December 1, 2007; 19(6): 399 - 406. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. Charles, D. Ranson, M. Bohensky, and J. E. Ibrahim Under-reporting of deaths to the coroner by doctors: a retrospective review of deaths in two hospitals in Melbourne, Australia Int. J. Qual. Health Care, August 1, 2007; 19(4): 232 - 236. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. V. Nilsen and M. A. Fotis Developing a model to determine the effects of adverse drug events in hospital inpatients Am. J. Health Syst. Pharm., March 1, 2007; 64(5): 521 - 525. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. Crosby Medical malpractice and anesthesiology: literature review and role of the expert witness: [Fautes medicales et anesthesiologie : revue de la litterature et role du temoin expert] Can J Anesth, March 1, 2007; 54(3): 227 - 241. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Bismark, E. Dauer, R. Paterson, and D. Studdert Accountability sought by patients following adverse events from medical care: the New Zealand experience. Can. Med. Assoc. J., October 10, 2006; 175(8): 889 - 894. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. J. Sharek, J. D. Horbar, W. Mason, H. Bisarya, C. W. Thurm, G. Suresh, J. E. Gray, W. H. Edwards, D. Goldmann, and D. Classen Adverse Events in the Neonatal Intensive Care Unit: Development, Testing, and Findings of an NICU-Focused Trigger Tool to Identify Harm in North American NICUs Pediatrics, October 1, 2006; 118(4): 1332 - 1340. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. J. Anderson Some Thoughts on the Reporting of Adverse Events in Phase II Cancer Clinical Trials J. Clin. Oncol., August 20, 2006; 24(24): 3821 - 3822. [Full Text] [PDF]
|
|
|
|
|
|
M K Szekendi, C Sullivan, A Bobb, J Feinglass, D Rooney, C Barnard, and G A Noskin Active surveillance using electronic triggers to detect adverse events in hospitalized patients. Qual. Saf. Health Care, June 1, 2006; 15(3): 184 - 190. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. C. Williams, A. Watt, S. P. Schmaltz, R. G. Koss, and J. M. Loeb Assessing the reliability of standardized performance indicators Int. J. Qual. Health Care, June 1, 2006; 18(3): 246 - 255. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. Davis, R. Lay-Yee, R. Briant, and A. Scott Modeling Eligibility under National Systems of Compensation for Treatment Injury Journal of Health Politics Policy and Law, April 1, 2006; 31(2): 295 - 319. [Abstract] [PDF]
|
|
|
|
|
|
M M Bismark, T A Brennan, R J Paterson, P B Davis, and D M Studdert Relationship between complaints and quality of care in New Zealand: a descriptive analysis of complainants and non-complainants following adverse events Qual. Saf. Health Care, February 1, 2006; 15(1): 17 - 22. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. R. Mahoney, D. J. Sargent, M. J. O'Connell, R. M. Goldberg, P. Schaefer, and J. C. Buckner Dealing With a Deluge of Data: An Assessment of Adverse Event Data on North Central Cancer Treatment Group Trials J. Clin. Oncol., December 20, 2005; 23(36): 9275 - 9281. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. Jagsi, B. T. Kitch, D. F. Weinstein, E. G. Campbell, M. Hutter, and J. S. Weissman Residents Report on Adverse Events and Their Causes Arch Intern Med, December 12, 2005; 165(22): 2607 - 2613. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 T. A. Brennan, A. Gawande, E. Thomas, and D. Studdert Accidental deaths, saved lives, and improved quality. N. Engl. J. Med., September 29, 2005; 353(13): 1405 - 1409. [Full Text] [PDF]
|
|
|
|
 |
|
 A. Garland Improving the ICU: Part 1 Chest, June 1, 2005; 127(6): 2151 - 2164. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. Garland Improving the ICU: Part 2 Chest, June 1, 2005; 127(6): 2165 - 2179. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M Husch, C Sullivan, D Rooney, C Barnard, M Fotis, J Clarke, and G Noskin Insights from the sharp end of intravenous medication errors: implications for infusion pump technology Qual. Saf. Health Care, April 1, 2005; 14(2): 80 - 86. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. N. Weingart Beyond Babel: prospects for a universal patient safety taxonomy Int. J. Qual. Health Care, April 1, 2005; 17(2): 93 - 94. [Full Text] [PDF]
|
|
|
|
|
|
D. Woods, E. Thomas, J. Holl, S. Altman, and T. Brennan Adverse Events and Preventable Adverse Events in Children Pediatrics, January 1, 2005; 115(1): 155 - 160. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. H. Thrall Quality and Safety Revolution in Health Care Radiology, October 1, 2004; 233(1): 3 - 6. [Full Text] [PDF]
|
|
|
|
|
|
K. M. Mazor, S. R. Simon, and J. H. Gurwitz Communicating With Patients About Medical Errors: A Review of the Literature Arch Intern Med, August 9, 2004; 164(15): 1690 - 1697. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. H. Woolf, A. J. Kuzel, S. M. Dovey, and R. L. Phillips Jr A String of Mistakes: The Importance of Cascade Analysis in Describing, Counting, and Preventing Medical Errors Ann. Fam. Med, July 1, 2004; 2(4): 317 - 326. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. J. Forster, T. R. Asmis, H. D. Clark, G. Al Saied, C. C. Code, S. C. Caughey, K. Baker, J. Watters, J. Worthington, and C. van Walraven Ottawa Hospital Patient Safety Study: incidence and timing of adverse events in patients admitted to a Canadian teaching hospital Can. Med. Assoc. J., April 13, 2004; 170(8): 1235 - 1240. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. Bobb, K. Gleason, M. Husch, J. Feinglass, P. R. Yarnold, and G. A. Noskin The Epidemiology of Prescribing Errors: The Potential Impact of Computerized Prescriber Order Entry Arch Intern Med, April 12, 2004; 164(7): 785 - 792. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. J. Forster, H. D. Clark, A. Menard, N. Dupuis, R. Chernish, N. Chandok, A. Khan, and C. van Walraven Adverse events among medical patients after discharge from hospital Can. Med. Assoc. J., February 3, 2004; 170(3): 345 - 349. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. A. Hayward and T. P. Hofer Adverse Events following Discharge from the Hospital Ann Intern Med, February 3, 2004; 140(3): 232 - 232. [Full Text] [PDF]
|
|
|
|
 |
|
 P. Michel, J. L. Quenon, A. M. de Sarasqueta, and O. Scemama Comparison of three methods for estimating rates of adverse events and rates of preventable adverse events in acute care hospitals BMJ, January 24, 2004; 328(7433): 199. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 F. H. Levy Excess Hospitalization Costs Attributable to Medical Injuries AAP Grand Rounds, January 1, 2004; 11(1): 7 - 8. [Full Text] [PDF]
|
|
|
|
|
|
R J Lilford, M A Mohammed, D Braunholtz, and T P Hofer The measurement of active errors: methodological issues Qual. Saf. Health Care, December 1, 2003; 12(90002): ii8 - 12. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. A. Brennan and M. M. Mello Patient Safety and Medical Malpractice: A Case Study Ann Intern Med, August 19, 2003; 139(4): 267 - 273. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 L. Berlin The Miasmatic Expert Witness Am. J. Roentgenol., July 1, 2003; 181(1): 29 - 35. [Full Text] [PDF]
|
|
|
|
|
|
G. Suresh Don't Believe Everything You Read in the Patient's Chart Pediatrics, May 1, 2003; 111(5): 1108 - 1109. [Full Text] [PDF]
|
|
|
|
 |
|
 J. H. Gurwitz, T. S. Field, L. R. Harrold, J. Rothschild, K. Debellis, A. C. Seger, C. Cadoret, L. S. Fish, L. Garber, M. Kelleher, et al. Incidence and Preventability of Adverse Drug Events Among Older Persons in the Ambulatory Setting JAMA, March 5, 2003; 289(9): 1107 - 1116. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. Classen Medication Safety: Moving From Illusion to Reality JAMA, March 5, 2003; 289(9): 1154 - 1156. [Full Text] [PDF]
|
|
|
|
|
|
R. A. Gabel, R. A. Hayward, L. L. Leape, D. M. Berwick, and D. W. Bates Counting Deaths Due to Medical Errors JAMA, November 20, 2002; 288(19): 2404 - 2405. [Full Text] [PDF]
|
|
|
|
|
|
Correction: The Reliability of Medical Record Review for Estimating Adverse Event Rates Ann Intern Med, July 16, 2002; 137(2): 147 - 147. [Full Text] [PDF]
|
|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Article
