Summaries for Patients are a service provided by Annals to help patients better understand the complicated and often mystifying language of modern medicine.
SUMMARIES FOR PATIENTS
Choice of Statistical Analysis Can Change the Results of Studies of the Relationship between Hospital and Surgeon Volume and Outcomes of Cancer Surgery
21 October 2003 | Volume 139 Issue 8 | Page I-44
Summaries for Patients are presented for informational purposes only. These summaries are not a substitute for advice from your own medical provider. If you have questions about this material, or need medical advice about your own health or situation, please contact your physician. The summaries may be reproduced for not-for-profit educational purposes only. Any other uses must be approved by the American College of Physicians.
The summary below is from the full report titled "The Effect of Clustering of Outcomes on the Association of Procedure Volume and Surgical Outcomes." It is in the 21 October 2003 issue of Annals of Internal Medicine (volume 139, pages 658-665). The authors are K.S. Panageas, D. Schrag, E. Riedel, P.B. Bach, and C.B. Begg.
What is the problem and what is known about it so far?
![]()
An increasing number of studies suggest that patients who have surgery at hospitals or by surgeons performing a high number of the particular procedure they need (high-volume providers) do better than patients who have surgery at hospitals or by surgeons doing fewer procedures (low-volume providers). These types of studies are known as "volumeoutcome studies" because they look for associations between the volume of surgeries performed and patient outcomes. Volumeoutcome studies are complicated, and there is disagreement about whether high volume is truly related to better outcomes. It is difficult to sort out whether outcomes differ because of provider experience or because patients of high-volume providers are just healthier or otherwise better off than patients of low-volume providers. Also, factors that have little to do with experience may account for the better outcomes seen with high-volume providers. Such factors could explain why not all high-volume providers have good outcomes. Another complicating factor is a statistical issue called "clustering." Clustering refers to the fact that outcomes of one provider's patients will tend to be more like one another than like the outcomes of a different provider's patients. When this is the case, studies must include many more patients to be able to detect real differences in the care of high- and low-volume providers.
Why did the researchers do this particular study?
![]()
To see whether the results of volumeoutcome studies change when statistical methods account for clustering.
Who was studied?
![]()
The researchers reanalyzed data from 3 of their own previous studies, including 24,166 colon cancer surgeries, 10,737 prostate cancer surgeries, and 2603 rectal cancer surgeries.
How was the study done?
![]()
The researches analyzed the data in the way most published volumeoutcome studies have done and again using 2 different methods to adjust for clustering. They compared the results of each analysis.
What did the researchers find?
![]()
When the researchers used methods that accounted for clustering, high volume was not as strongly or as consistently associated with better outcomes.
What were the limitations of the study?
![]()
This study reanalyzed only data from 3 specific studies that all focused on cancer surgery. The results may not apply to other conditions.
What are the implications of the study?
![]()
While studies suggest that surgical patients fare best with providers (hospitals and surgeons) that perform a high volume of procedures, most have not accounted for the tendency of patients of one provider to have similar outcomes (clustering). When outcomes of individual patients are clustered, more patients are required to prove that providers' outcomes differ from one another. Planners considering regionalizing surgery and patients making decisions about where to go for surgery should remember that volumeoutcome studies that have not accounted for clustering may exaggerate the statistical significance of differences in outcomes by provider.
Related articles in Annals:
This article has been cited by other articles:
![]() |
K. Y. Bilimoria, D. J. Bentrem, J. M. Feinglass, A. K. Stewart, D. P. Winchester, M. S. Talamonti, and C. Y. Ko Directing Surgical Quality Improvement Initiatives: Comparison of Perioperative Mortality and Long-Term Survival for Cancer Surgery J. Clin. Oncol., October 1, 2008; 26(28): 4626 - 4633. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. J. Petrelli Not Just Another Article on Cancer Surgery Volume and Patient Outcomes J. Clin. Oncol., October 1, 2008; 26(28): 4530 - 4531. [Full Text] [PDF] |
||||
![]() |
L. Lecuyer, S. Chevret, B. Guidet, P. Aegerter, P. Martel, B. Schlemmer, and E. Azoulay Case volume and mortality in haematological patients with acute respiratory failure Eur. Respir. J., September 1, 2008; 32(3): 748 - 754. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Y. Bilimoria, D. J. Bentrem, H. Nelson, S. J. Stryker, A. K. Stewart, N. J. Soper, T. R. Russell, and C. Y. Ko Use and Outcomes of Laparoscopic-Assisted Colectomy for Cancer in the United States Arch Surg, September 1, 2008; 143(9): 832 - 840. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Y. Bilimoria, M. S. Talamonti, J. D. Wayne, J. S. Tomlinson, A. K. Stewart, D. P. Winchester, C. Y. Ko, and D. J. Bentrem Effect of Hospital Type and Volume on Lymph Node Evaluation for Gastric and Pancreatic Cancer Arch Surg, July 1, 2008; 143(7): 671 - 678. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Y. Bilimoria, C. M. Balch, D. J. Bentrem, M. S. Talamonti, C. Y. Ko, J. R. Lange, D. P. Winchester, and J. D. Wayne Complete Lymph Node Dissection for Sentinel Node-Positive Melanoma: Assessment of Practice Patterns in the United States Ann. Surg. Oncol., June 1, 2008; 15(6): 1566 - 1576. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. S. Carey, J. P. Parker, C. Brandeau, and Z. Li The "occasional open heart surgeon" revisited. J. Thorac. Cardiovasc. Surg., June 1, 2008; 135(6): 1254 - 1260. [Abstract] [Full Text] [PDF] |
||||
![]() |
M F Dawwas, A E Gimson, J D Lewsey, L P Copley, J H P van der Meulen, and on behalf of the UK and Ireland Liver Transplant A Survival after liver transplantation in the United Kingdom and Ireland compared with the United States Gut, November 1, 2007; 56(11): 1606 - 1613. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. H. Livingston, A. C. Elliott, L. S. Hynan, and E. Engel When Policy Meets Statistics: The Very Real Effect That Questionable Statistical Analysis Has on Limiting Health Care Access for Bariatric Surgery Arch Surg, October 1, 2007; 142(10): 979 - 987. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Saposnik, A. Baibergenova, M. O'Donnell, M. D. Hill, M. K. Kapral, V. Hachinski, and On behalf of the Stroke Outcome Research Canada (S Hospital volume and stroke outcome: Does it matter? Neurology, September 11, 2007; 69(11): 1142 - 1151. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. K. Hollenbeck, Hong Ji, Zaojun Ye, and J. D. Birkmeyer Misclassification of Hospital Volume With Surveillance, Epidemiology, and End Results Medicare Data Surgical Innovation, September 1, 2007; 14(3): 192 - 198. [Abstract] [PDF] |
||||
![]() |
G. J. Chang, M. A. Rodriguez-Bigas, J. M. Skibber, and V. A. Moyer Lymph Node Evaluation and Survival After Curative Resection of Colon Cancer: Systematic Review J Natl Cancer Inst, March 21, 2007; 99(6): 433 - 441. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. K Mayer, S. Purkayastha, T. Athanasiou, and A. W Darzi Redefining quality of care J R Soc Med, March 1, 2007; 100(3): 122 - 124. [Full Text] [PDF] |
||||
![]() |
M. A. Gilligan, J. Neuner, X. Zhang, R. Sparapani, P. W. Laud, and A. B. Nattinger Relationship Between Number of Breast Cancer Operations Performed and 5-Year Survival After Treatment for Early-Stage Breast Cancer Am J Public Health, March 1, 2007; 97(3): 539 - 544. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. K. Hollenbeck, R. L. Dunn, D. C. Miller, S. Daignault, D. A. Taub, and J. T. Wei Volume-Based Referral for Cancer Surgery: Informing the Debate J. Clin. Oncol., January 1, 2007; 25(1): 91 - 96. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Pronovost, D. Needham, S. Berenholtz, D. Sinopoli, H. Chu, S. Cosgrove, B. Sexton, R. Hyzy, R. Welsh, G. Roth, et al. An Intervention to Decrease Catheter-Related Bloodstream Infections in the ICU N. Engl. J. Med., December 28, 2006; 355(26): 2725 - 2732. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Khan, A. Campbell, T. Wallington, and M. Gardam The impact of physician training and experience on the survival of patients with active tuberculosis. Can. Med. Assoc. J., September 26, 2006; 175(7): 749 - 753. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. K. Rex, C. J. Kahi, B. Levin, R. A. Smith, J. H. Bond, D. Brooks, R. W. Burt, T. Byers, R. H. Fletcher, N. Hyman, et al. Guidelines for Colonoscopy Surveillance after Cancer Resection: A Consensus Update by the American Cancer Society and US Multi-Society Task Force on Colorectal Cancer. CA Cancer J Clin, May 1, 2006; 56(3): 160 - 167. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. K. Lindenauer, R. Behal, C. K. Murray, W. Nsa, P. M. Houck, and D. W. Bratzler Volume, quality of care, and outcome in pneumonia. Ann Intern Med, February 21, 2006; 144(4): 262 - 269. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Lipscomb Transcending the Volume-Outcome Relationship in Cancer Care J Natl Cancer Inst, February 1, 2006; 98(3): 151 - 154. [Full Text] [PDF] |
||||
![]() |
D. Schrag, C. Earle, F. Xu, K. S. Panageas, K. R. Yabroff, R. E. Bristow, E. L. Trimble, and J. L. Warren Associations Between Hospital and Surgeon Procedure Volumes and Patient Outcomes After Ovarian Cancer Resection J Natl Cancer Inst, February 1, 2006; 98(3): 163 - 171. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. K. Nallamothu, K. A. Eagle, V. A. Ferraris, and R. M. Sade Should Coronary Artery Bypass Grafting Be Regionalized? Ann. Thorac. Surg., November 1, 2005; 80(5): 1572 - 1581. [Full Text] [PDF] |
||||
![]() |
B. K. Edwards, M. L. Brown, P. A. Wingo, H. L. Howe, E. Ward, L. A. G. Ries, D. Schrag, P. M. Jamison, A. Jemal, X. C. Wu, et al. Annual Report to the Nation on the Status of Cancer, 1975-2002, Featuring Population-Based Trends in Cancer Treatment J Natl Cancer Inst, October 5, 2005; 97(19): 1407 - 1427. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Durairaj, J. C. Torner, E. A. Chrischilles, M. S. Vaughan Sarrazin, J. Yankey, and G. E. Rosenthal Hospital Volume-Outcome Relationships Among Medical Admissions to ICUs Chest, September 1, 2005; 128(3): 1682 - 1689. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Moscucci, D. Share, D. Smith, M. J. O'Donnell, A. Riba, R. McNamara, T. Lalonde, A. C. Defranco, K. Patel, E. Kline Rogers, et al. Relationship Between Operator Volume and Adverse Outcome in Contemporary Percutaneous Coronary Intervention Practice: An Analysis of a Quality-Controlled Multicenter Percutaneous Coronary Intervention Clinical Database J. Am. Coll. Cardiol., August 16, 2005; 46(4): 625 - 632. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. P. Gross, J. Herrin, N. Wong, and H. M. Krumholz Enrolling Older Persons in Cancer Trials: The Effect of Sociodemographic, Protocol, and Recruitment Center Characteristics J. Clin. Oncol., July 20, 2005; 23(21): 4755 - 4763. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. G. Barker II, W. T. Curry Jr., and B. S. Carter Surgery for primary supratentorial brain tumors in the United States, 1988 to 2000: The effect of provider caseload and centralization of care Neuro-oncol, January 1, 2005; 7(1): 49 - 63. [Abstract] [PDF] |
||||
![]() |
A. V. Joshi and L.-A. Miller Hospital Procedure Volume and Outcomes Ann Intern Med, June 15, 2004; 140(12): 1061 - 1062. [Full Text] [PDF] |
||||
![]() |
Association Between Procedure Volume and Patient Outcome Is Challenged Journal Watch Gastroenterology, November 12, 2003; 2003(1112): 3 - 3. [Full Text] |
||||
![]() |
C. Laine and H. C. Sox Does Practice Really Make Perfect? Ann Intern Med, October 21, 2003; 139(8): 696 - 698. [Full Text] [PDF] |
||||
Read all Rapid Responses
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||