Skip to main content
  • Research article
  • Open access
  • Published:

The impact of surgical experience and frequency of practice on perioperative outcomes in pancreatic surgery

Abstract

Objective

We aimed to determine the impact of surgical experience and frequency of practice on perioperative morbidity and mortality in pancreatic surgery.

Methods

1281 patients that underwent pancreatic resections from 1993 to 2013 were retrospectively analyzed using logistic regression models. All cases were stratified according to the surgeon’s level of experience, which was based on the number of previously performed pancreatic resections and the extent of received supervision (novice: n <  20 / intensive; intermediate: n = 21–90 / decreasing; and experienced surgeon: n > 90 / none). Additional stratification was based on the frequency of practice (sporadic: 3 resections > 6 weeks, frequent: 3 resections ≤6 weeks).

Results

The novice and experienced categories were related to a decreased risk of postoperative pancreatic fistulas (odds ratio [OR] 0.46, 95% confidence interval [CI] 0.26–0.82 and 0.54, 95% CI 0.36–0.82) and in-hospital mortality (OR 0.45, 95% CI 0.17–1.16 and 0.42, 95% CI 0.21–0.83) compared to the intermediate category. Frequent practice was associated with a significantly lower risk of delayed gastric emptying (OR 0.56, 95% CI 0.38–0.83), postpancreatectomy hemorrhage (OR 0.64, 95% CI 0.42–0.98) and in-hospital mortality (OR 0.45, 95% CI 0.24–0.87).

Conclusions

Our results emphasize the importance of supervision within a pancreatic surgery training program. In addition, our data underline the need of a sufficient patient caseload to ensure frequent practice.

Peer Review reports

Background

Several studies have found an inverse relationship between hospital volume and perioperative outcomes in complex surgery [1,2,3,4]. There is evidence that such associations also exist between the annual surgeon volume and operative mortality [5,6,7]. A population-based study examining the level of surgical skill and clinical outcomes in bariatric surgery found that greater skill was associated with fewer postoperative complications [8]. The growing body of outcomes research has yielded to changes in health care that are indirectly interfering with the traditional model of surgical training in general surgery. Consequently, a debate regarding the best manner for surgeons to acquire surgical competency in an increasingly outcome-oriented environment has been triggered. Concurrently, in recent years, there has been a paradigm shift in surgical education, with a movement of the acquisition phase of surgical skills from the operation room to the surgical skills laboratory [9]. But achieving competence in complex pancreatic surgery is a demanding process that involves surgical skills that cannot be acquired by surgical simulation. Therefore, surgical training in pancreatic surgery is still dependent on the traditional model of surgical training through apprenticeship [10]. Several studies have examined the impact of surgical experience on perioperative outcomes or explored the existence of a learning curve in pancreatic surgery [7, 11,12,13]. However, the impact of surgical experience and frequency of practice on perioperative outcomes has not been sufficiently evaluated in the context of pancreatic surgery training.

To address this issue, we conducted a retrospective study of all cases of pancreatic resections stratified according to the operating surgeon’s level of experience and frequency of practice in pancreatic surgery. We postulated three hypotheses for the current study of pancreatic surgery training: 1) Stringent case selection and intensive supervision will result in comparable postoperative morbidity of novices and experienced surgeons. 2) Reduction of supervision and less stringent case selection will impair outcomes. 3) Frequent practice of pancreatic resections will improve perioperative outcomes.

Methods

Data

We retrospectively analyzed patients who underwent pancreatic resections from 1993 to 2013 at the Department of Visceral, Thoracic and Vascular Surgery of the University Hospital Dresden. We used the institutional database that included information on the composition of the surgical team (e.g. operating surgeon and assisting surgeon). From 1993 to 2013, only surgeons that passed residency training for general surgery were eligible to start pancreatic surgery training. The pancreatic surgery training curriculum mandated full-time supervision by an experienced surgeon and patient cases of low surgical difficulty for at least 20 resections. Thereafter, supervision was decreased according to the trainees’ proficiency and the surgical difficulty of the individual patient case.

In accordance with the guidelines for human subject research, approval was obtained from the ethics committee at the Carl Gustav Carus University Hospital (decision number EK 404102018).

Definition of surgical experience and frequency of practice

Prior to the statistical analysis, we generated a heat map that cross-examined the distribution of all cases according to the time interval between the last three resections and the total number of previously performed pancreatic resections of the operating surgeon (Fig. 1 in Appendix). This heat map was used to determine the definitions of surgical experience and frequency of practice, as we assumed that an increasing experience will essentially yield in a higher rate of surgical case assignment and vice versa.

Subsequently, each operative case was stratified according to the operating surgeon’s experience level and frequency of practice in pancreatic surgery at the time of resection (Table 6 in Appendix). Pancreatic surgery novices were defined as surgeons with a total of less than 20 pancreatic resections, as predetermined by the training curriculum of our department. Intermediate experienced surgeons were those who had performed their 21st - 90th pancreatic resection. With an increasing degree of proficiency, these surgeons received a decreasing degree of supervision by an experienced surgeon, while being assigned to cases with increasing surgical difficulty. Surgeons with a career volume of more than 90 pancreatic resections were classified experienced.

Surgeons were considered to have had frequent practice if they had performed at least three resections within the last 6 weeks. Surgeons with a caseload of at least three resections in more than 6 weeks were categorized as sporadically trained. A constant frequency of practice of three resections within 6 weeks would correspond to a surgeon volume of at least 26 resections per year.

Outcome measures, risk adjustment and statistical analysis

Patient characteristics were analyzed descriptively according to categories of surgical experience and the frequency of practice in pancreatic surgery. Due to the database structure and the limited ability to reconstruct the post-discharge course of our early patients, we only used outcome measures that were recorded during the hospital stay. In-hospital mortality, defined as death before discharge, was studied as a primary outcome measure. Secondary outcomes were rates of grade B/C delayed gastric emptying (DGE), postpancreatectomy hemorrhage (PPH) and postoperative pancreatic fistula (POPF) according to the International Study Group for Pancreatic Surgery (ISGPS) definitions [14,15,16]. In addition, the rate of patients with a length of stay (LOS) > 14 days was analyzed. Categorical variables were expressed as whole numbers and proportions. To assess the impact of the surgeon’s level of experience and the surgeon’s frequency of practice on these outcome measures, logistic regression models were used. Upon the pooled data of the entire observation period, regression models were fitted for all patients. The models were constructed using variables for risk adjustment including age groups, sex, stage of surgical difficulty and year of treatment. The exact definitions of these variables are given in Table 1. Results from the multivariable analysis were presented as odds ratios (ORs) with corresponding 95% confidence intervals (CI). The level of statistical significance was set to 0.1. Analyses were conducted using STATA Version 11 (STATA Corp).

Table 1 Patient Characteristics According to Level of Experience and Frequency of Practice

Results

Patient characteristics

In the study period of 1993 to 2013, 1335 patients underwent pancreatic resections. Excluded from this cohort were 54 patients (4%) who had incomplete or missing hospital data files due to a flooding of the hospital in 2002. Therefore, a total of 1281 patients were included in the final analysis. There were 25 operating surgeons. As the experience of the surgeons progressed over time, some surgeons were listed in more than one category at least once during the study period.

Overall mortality and overall cumulative morbidity were 3.7 and 22.2%, respectively. Of all resections, experienced surgeons (career volume greater than 90 resections) conducted 50% (n = 641), surgeons of intermediate experience 32.7% (n = 419) and pancreatic surgery novices 17.3% (n = 221), respectively (Table 1). We have previously shown that pancreatic surgery patients aged 70 and older have a higher in-hospital mortality rate than younger patients [17]. In this study, the proportion of patients aged 70 and older was higher in the experienced category compared with intermediate and novice categories (26.8% vs. 25.1% vs. 22.6%). 81.4% of all resections were of increased surgical difficulty (stage 3 and 4). Surgeons with experienced and intermediate expertise performed proportionally more resections with increased surgical difficulty (stage 3 and 4) compared to the novice surgeons (81.9% vs. 83.8% vs. 75.6%).

The frequencies of patient characteristics stratified by the level of surgical experience and frequency of practice are given in Table 1.

Impact of surgical experience

The unadjusted rates of patients with a LOS of more than 14 days were 48.9, 48.4 and 47.1% for the novice, intermediate and experienced category, respectively. The unadjusted rates of cumulative morbidity (grade B/C POPF, PPH and DGE) and mortality were lower in the novice category (17.7 and 2.7%, respectively) as compared to the intermediate (23.9 and 5.5%) or experienced categories (22.6 and 2.8%). All unadjusted rates are given in Table 2.

Table 2 Crude Rates of Length of Stay (> 14 Days), Postoperative Morbidity and Mortality According to Level of Experience and Frequency of Practice

Multivariate regression with adjustment for age, gender, surgical difficulty and year of surgery showed that the risk of LOS and DGE was not significantly associated to the level of surgical experience (Table 3). Compared to intermediate experience, the novice category was associated with a reduced risk of POPF (OR 0.46; 95% CI 0.26–0.82), PPH (OR 0.51; 95% CI 0.25–1.05) and in-hospital mortality (OR 0.45; 95% CI 0.17–1.16). The experienced category was associated with a reduced risk of POPF (OR 0.54; 95% CI 0.36–0.82) and in-hospital mortality (OR 0.42; 95% CI 0.21–0.83) compared to the level of intermediate experience.

Table 3 Risk-adjusted Odds Ratios of Length of Stay, Morbidity and In-hospital Mortality According to the Surgeon’s Level of Experience

Impact of Surgeon’s frequency of practice

Surgeons with frequent operating exposure had lower observed rates of cumulative morbidity and in-hospital mortality (Table 2). Independent from the level of experience, frequency of practice was associated with a significantly lower risk of DGE (OR 0.56, 95% CI 0.38–0.83), PPH (OR 0.64, 95% CI 0.42–0.98) and in-hospital mortality (OR 0.45, 95% CI 0.24–0.87) (Table 4).

Table 4 Risk-adjusted Odds Ratios of Length of Stay, Morbidity and In-hospital Mortality according to the Surgeon’s Frequency of Practice

Upon the combined inclusion of surgical experience and frequency of practice into our regression models, we found a significantly reduced risk of DGE for frequently trained novice, intermediate and experienced surgeons compared to sporadic trained intermediates (Table 5). We also detected significantly reduced ORs of POPF in sporadic and frequently trained novices and experienced surgeons compared to sporadic trained intermediates. In addition, the category of frequently trained experienced surgeons was associated with significantly reduced rates of in-hospital mortality, whereas frequently trained novices had significantly reduced rates of PPH. There was no mortality in the category of frequently trained beginners, which did not allow for calculation of OR.

Table 5 Risk-adjusted Odds Ratios of Length of Stay, Morbidity and In-hospital Mortality according to the Surgeon’s Level of Experience and Frequency of Practice

Notably, inclusion of frequency of practice seemed to enforce the effect of the level of experience on DGE, POPF and in-hospital mortality, when the frequently trained novice and experienced surgeons were compared to rarely trained intermediates (e.g. experienced surgeons: ORexperience: 0.42 vs. ORexperience and frequency of practice: 0.29).

Discussion

Today, the way we consider surgical training has changed. Due to the rapid evolution of new techniques, the apprenticeship model is in desperate need of augmentation. The overwhelming evidence supporting the transfer of skills from the simulation laboratory to the operating room has led to the acceptance of simulation training in surgery. This, in turn, enabled research into educational concepts for technical skills previously described in domains outside medicine, such as deliberate practice and mental practice [18]. However, in the foreseeable future supervised hands-on training will remain a critical part of training in complex surgery. Therefore, in addition to new educational concepts and innovations in simulation, a better understanding of associations between training status and patient outcomes is needed to improve the classical training model. Our study demonstrates that pancreatic surgery training with stringent case selection and intensive supervision enables trainee surgeons to achieve perioperative outcomes comparable to those of experienced surgeons. These findings are supported by studies that have already implied that supervised trainees do not jeopardize patient outcomes in pancreatic surgery [13, 19]. Nevertheless, it appears reasonable that an increasing trainee autonomy may be associated with higher complications rates. Notably, our study shows that reduction of supervision and less stringent case selection in the intermediate level impair outcomes. Moreover, there are other studies that revealed learning curves in resident and fellowship training [12, 20], which is also in line with our data showing a significant improvement of outcomes between the intermediate and experienced categories. In view of these data we believe that there is a transitional period between surgical training and the gaining of profound expertise that is associated with impaired perioperative results. In this regards, adequate case selection and prolonged supervision may be recommended even for surgeons that are competent to perform pancreatic resections on their own but are still within their learning curve (= intermediate level).

Numerous studies have identified annual surgeon caseload as significant a independent variable of death following pancreatic surgery [5, 21, 22]. Instead of using surgeon volume per year, we applied a novel concept using a short time interval of 6 weeks and a threshold of at least three resections to differentiate between sporadic and frequent practice in the short term. This definition ensured that surgeons meeting these criteria had constantly trained or repeated pancreatic resections in advance of the procedure of interest. Our analysis shows that frequent practice improves rates of in-hospital mortality and pancreatic surgery – specifically morbidity. It is worth noting that this effect is present in every level of surgical experience. To our knowledge, this is the first study examining the frequency of practice in the short term, thereby showing that frequent repetitions of a procedure have a significant impact on perioperative morbidity independent from the level of experience. We conclude from these results that training programs for pancreatic surgery should be reserved to institutions having the necessary patient caseload.

This study has several limitations that need to be appropriately taken into consideration. Firstly, although the data were extracted from a prospective database, this was a retrospective study with all of the associated bias risks. In this regard, the distribution of cases between novice and expert surgeons have probably been subject to a selection bias. Secondly, our database encompasses only data from a single institution, possibly limiting the ability for the broad generalization of our findings to all institutions with a training program for pancreatic surgery. Thirdly, with increasing proficiency, intermediately experienced surgeons were likely to be assigned to cases with increasing surgical difficulty. We, therefore, ranked surgical procedures according to the stage of difficulty and added this variable into our regression models. Lastly, we were unable to determine the amount of preexisting hands-on experience in general surgery of pancreatic surgery trainees. Due to the increasing trend of sub-specialization, today’s trainees may have less operative exposure when performing their first pancreatic resection compared to their predecessors. In addition, changes of practice may have occurred during the analysed time period of 20 years. We, therefore, included the year of surgery into our multivariate regression models to reduce the confounding effect of time-related changes.

Conclusions

Our study demonstrates that surgical training with intensive supervision ensures patient safety, whereas the reduction of supervision based upon the progression of surgical competency may have unfavorable effects on surgical outcomes. These results emphasize the importance of supervision of surgeons that are competent to perform pancreatic resections on their own but are still within their learning curve. The fact that frequent practice improves perioperative outcomes in every level of experience underlines the need of a sufficient patient caseload to ensure frequent hands-on practice.

Availability of data and materials

The datasets used and analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

CI:

Confidence interval

DGE:

Delayed gastric emptying

LOS:

Length of stay

OR:

Odds ratio

POPF:

Postpoperative pancreatic fistula

PPH:

Postoperative pancreatic hemorrhage

References

  1. McPhee JT, Hill JS, Whalen GF, Zayaruzny M, Litwin DE, Sullivan ME, et al. Perioperative mortality for pancreatectomy: a national perspective. Ann Surg. 2007;246(2):246–53.

    Article  Google Scholar 

  2. Reames BN, Ghaferi AA, Birkmeyer JD, Dimick JB. Hospital volume and operative mortality in the modern era. Ann Surg. 2014 Aug;260(2):244–51.

    Article  Google Scholar 

  3. Finks JF, Osborne NH, Birkmeyer JD. Trends in hospital volume and operative mortality for high-risk surgery. N Engl J Med. 2011;364(22):2128–37.

    Article  CAS  Google Scholar 

  4. Krautz C, Nimptsch U, Weber GF, Mansky T, Grützmann R. Effect of hospital volume on in-hospital morbidity and mortality following pancreatic surgery in Germany. Ann Surg. 2018;267(3):411–17.

    Article  Google Scholar 

  5. Birkmeyer JD, Stukel TA, Siewers AE, Goodney PP, Wennberg DE, Lucas FL. Surgeon volume and operative mortality in the United States. N Engl J Med. 2003;349(22):2117–27.

    Article  CAS  Google Scholar 

  6. Eppsteiner RW, Csikesz NG, McPhee JT, Tseng JF, Shah SA. Surgeon volume impacts hospital mortality for pancreatic resection. Ann Surg. 2009;249(4):635–40.

    Article  Google Scholar 

  7. Schmidt CM, Turrini O, Parikh P, House MG, Zyromski NJ, Nakeeb A, et al. Effect of hospital volume, surgeon experience, and surgeon volume on patient outcomes after pancreaticoduodenectomy: a single-institution experience. Arch Surg Am Med Assoc. 2010;145(7):634–40.

    Article  Google Scholar 

  8. Birkmeyer JD, Finks JF, O'Reilly A, Oerline M, Carlin AM, Nunn AR, et al. Surgical skill and complication rates after bariatric surgery. N Engl J Med. 2013;369(15):1434–42.

    Article  CAS  Google Scholar 

  9. de Montbrun S, MacRae H. Simulation in surgical education. Clin Colon Rectal Surg. 2012;25(03):156–65.

    Article  Google Scholar 

  10. Cameron JL. William Stewart Halsted. Our surgical heritage. Ann Surg. 1997;225(5):445–58.

    Article  CAS  Google Scholar 

  11. Tseng JF, Pisters PWT, Lee JE, Wang H, Gomez HF, Sun CC, et al. The learning curve in pancreatic surgery. Surgery. 2007;141(4):456–63.

    Article  Google Scholar 

  12. Hardacre JM. Is there a learning curve for pancreaticoduodenectomy after fellowship training? HPB Surg Hindawi. 2010;2010(3):230287–4.

    Google Scholar 

  13. Shirai Y, Shiba H, Horiuchi T, Saito N, Furukawa K, Sakamoto T, et al. Assessment of outcome after Pancreaticoduodenectomy by junior surgeons. Anticancer Res. 2016;36(7):3505–10.

    PubMed  Google Scholar 

  14. Wente MN, Bassi C, Dervenis C, Fingerhut A, Gouma DJ, Izbicki JR, et al. Delayed gastric emptying (DGE) after pancreatic surgery: a suggested definition by the international study Group of Pancreatic Surgery (ISGPS). Surgery. 2007;142(5):761–8.

    Article  Google Scholar 

  15. Wente MN, Veit JA, Bassi C, Dervenis C, Fingerhut A, Gouma DJ, et al. Postpancreatectomy hemorrhage (PPH): an International Study Group of Pancreatic Surgery (ISGPS) definition. Surgery. 2007;142(1):20–5.

    Article  Google Scholar 

  16. Bassi C, Dervenis C, Butturini G, Fingerhut A, Yeo C, Izbicki J, et al. Postoperative pancreatic fistula: an international study group (ISGPF) definition. Surgery. 2005;138(1):8–13.

    Article  Google Scholar 

  17. Nimptsch U, Krautz C, Weber GF, Mansky T, Grützmann R. Nationwide in-hospital mortality following pancreatic surgery in Germany is higher than anticipated. Ann Surg. 2016 Dec;264(6):1082–90.

    Article  Google Scholar 

  18. Singh P, Darzi A. Surgical training. Br J Surg. 2013;100(3):307–9.

    Article  CAS  Google Scholar 

  19. Wamser P, Stift A, Passler C, Goetzinger P, Sautner T, Jakesz R, et al. How to pass on expertise: Pancreatoduodenectomy at a teaching hospital. World J Surg. 2014;26(12):1458–62.

    Article  Google Scholar 

  20. Relles DM, Burkhart RA, Pucci MJ, Sendecki J, Tholey R, Drueding R, et al. Does resident experience affect outcomes in complex abdominal surgery? Pancreaticoduodenectomy as an example. J Gastrointest Surg. 2013;18(2):279–85.

    Article  Google Scholar 

  21. Mamidanna R, Ni Z, Anderson O, Spiegelhalter SD, Bottle A, Aylin P, et al. Surgeon volume and Cancer Esophagectomy, gastrectomy, and pancreatectomy. Ann Surg. 2016;263(4):727–32.

    Article  Google Scholar 

  22. Nathan H, Cameron JL, Choti MA, Schulick RD, Pawlik TM. The volume-outcomes effect in Hepato-Pancreato-biliary surgery: hospital versus surgeon contributions and specificity of the relationship. ACS Am Coll Surg. 2009;208(4):528–38.

    Article  Google Scholar 

Download references

Acknowledgements

This study was presented at the International Conference on Pancreatic Cancer 2018 in Baltimore (Pancreatology 18(4):S161).

Funding

None.

Author information

Authors and Affiliations

Authors

Contributions

CK and EH outlined and performed the data analysis and contributed to the writing of the manuscript. CK performed the literature search. HDS, RG and GW contributed to the data interpretation and the writing of the manuscript. MD and ME contributed to the writing of the introduction and discussion sections. All authors have read and approved the final version of the manuscript.

Corresponding author

Correspondence to Christian Krautz.

Ethics declarations

Ethics approval and consent to participate

In accordance with the guidelines for human subject research, approval was obtained from the ethics committee at the Carl Gustav Carus University Hospital (decision number EK 404102018).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

Fig. 1
figure 1

Heat map of Case Distribution According to the Surgeon’s Level of Experience and Frequency of Practice

Table 6 Definition of the Surgeon’s Training Status

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Krautz, C., Haase, E., Elshafei, M. et al. The impact of surgical experience and frequency of practice on perioperative outcomes in pancreatic surgery. BMC Surg 19, 108 (2019). https://0-doi-org.brum.beds.ac.uk/10.1186/s12893-019-0577-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12893-019-0577-6

Keywords