What Is Known: Examining the Empirical Literature in Resident Work Hours Using 30 Influential Articles

PhD, MBA
Online Publication Date: 01 Dec 2016
Page Range: 795 – 805
DOI: 10.4300/JGME-D-16-00642.1
Save
Download PDF

ABSTRACT

Background 

Examining influential, highly cited articles can show the advancement of knowledge about the effect of resident physicians' long work hours, as well as the benefits and drawbacks of work hour limits.

Objective 

A narrative review of 30 articles, selected for their contribution to the literature, explored outcomes of interest in the research on work hours—including patient safety, learning, and resident well-being.

Methods 

Articles were selected from a comprehensive review. Citation volume, quality, and contribution to the evolving thinking on work hours and to the Accreditation Council for Graduate Medical Education standards were assessed.

Results 

Duty hour limits are supported by the scientific literature, particularly limits on weekly hours and reducing the frequency of overnight call. The literature shows declining hours and call frequency over 4 decades of study, although the impact on patient safety, learning, and resident well-being is not clear. The review highlighted limitations of the scientific literature on resident hours, including small samples and reduced generalizability for intervention studies, and the inability to rule out confounders in large studies using administrative data. Key areas remain underinvestigated, and accepted methodology is challenged when assessing the impact of interventions on the multiple outcomes of interest.

Conclusions 

The influential literature, while showing the beneficial effect of work hour limits, does not answer all questions of interest in determining optimal limits on resident hours. Future research should use methods that permit a broader, collective examination of the multiple, often competing attributes of the learning environment that collectively promote patient safety and resident learning and well-being.

Introduction

Resident work hours have been considered important to the learning and professional socialization of physicians, in an industry where patient needs are not met during the standard workday. Yet these long hours also are of concern for patients and residents, due to the association between sleep loss, medical errors for patients, and risks to residents themselves, including motor vehicle accidents, occupational injuries, and negative effects on well-being. Ideally, decisions regarding work hour limits for resident physicians should be based on the relevant scientific literature regarding approaches that optimize patient safety, resident learning, and resident safety and well-being.

The Accreditation Council for Graduate Medical Education (ACGME) work hour standards, which include the early standards that predate the 2003 common program requirements and the standards that went into effect in 2011, were guided by the available scientific evidence generally gleaned from published studies.1,2 The aim of this selective, narrative review is to present the seminal articles over the past 4 decades that shaped the community's and the ACGME's thinking about resident hours, including highlighting themes and controversies in this literature. An additional aim is to identify areas where relevant literature is lacking, and suggest directions for future research.

Methods

The review encompasses 30 well-cited, influential articles published in US peer-reviewed journals between 1971 and 2013. Articles were selected from a comprehensive review of the literature on resident work hours and related dimensions. These were compiled by the author for an ACGME Task Force that was charged with a revision of Section VI (Resident Duty Hours in the Learning and Working Environment) of the Common Program Requirements. This compilation consisted of more than 1050 original articles. To be included in this narrative review, a study had to examine resident hours or limits on them, and had to be a frequently cited article that addressed an aspect of resident work hours, such as medical errors, resident safety and well-being, and resident learning, or the positive or negative consequences of work hour limits. Articles also had to meet a basic quality criterion.

Citation volume was assessed independently using Google Scholar. For quantitative studies, quality was examined using the Medical Education Research Study Quality Instrument (MERSQI).3 The MERSQI assesses design, sampling, type of data, validity, data analysis, and outcomes, for a maximum score of 18 and an average score of 9.95 for medical education studies. To be included, studies had to score 11 or above, and the scores for the 28 quantitative articles ranged from 11.4 to 17, with many of the older studies scoring lower on the metric. MERSQI data are not reported individually, and a number of studies have separate scores for different outcome variables, such as the external collection of safety data versus the self-reporting of work hours or educational outcomes. The 2 purely qualitative studies in the analysis scored high on a quality assessment tool for qualitative research.4 The organization of the review highlights the historical evolution of the community's knowledge and understanding about resident hours, the focus on several constant themes throughout the 4 decades, and the emerging focus on new outcomes of interest.

Results

As shown in the table, many of the articles included in this review are among the most highly cited articles in this vast literature, with the most cited study garnering nearly 1500 citations.411,1330,3234 In contrast, 2 important qualitative studies included in the analysis12,31 received fewer citations.

table Study Findings and Contributions to/Impact of the Knowledge About Work Hour Limits

          
            table

The major themes in the early literature on work hours begin the discussion of the impact of long hours on residents' clinical and cognitive performance,4,8 resident safety and well-being,5,17,18,23,24,26 and resident driving safety after call or night shifts.14,16,21 A second theme encompasses the risks to patients associated with resident work,10,20,22,3224 including higher risks for night admissions9 and problems with cross-coverage of patients.13 In contrast, data on the impact of duty hour limits on resident learning and professional development are scarce, and studies generally are limited to assessing the impact on board and in-training examination performance and resident self-reporting of educational impact.8,29,30

In 1989, New York became the first state to regulate resident hours; thus, the third theme is the impact of limits on resident hours on the quality and safety of care. Studies of the impact of New York State's regulation of resident hours predate studies of limits at the national level. These early studies produced some mixed results, including delayed test ordering and increased complications in medical residents' patients,10 as well as residents reporting conflict between their desire to comply with the regulations and their obligation to patients and colleagues.12 While these early studies clearly highlight the need for limits on resident work, beginning with that by Friedman and colleagues,4 they also present conflicting findings, with no apparent impact of long hours for surgical residents7 and an increased number of errors for surgical patients under the New York State limits.22 This marked the beginning of a 3-decades–long debate about differences in the impact of work hour limits in medical versus surgical specialties. Studies of the effect of 2003 ACGME standards generally suggest a benefit of these limits, particularly the 80-hour weekly limits and standards reducing the frequency of overnight call. However, some studies produced mixed findings or suggested no impact on quality and safety of care. For example, 2 large studies using administrative data showed no significant differences in outcomes for medical28 or surgical26,28 patients.

Several studies showed that residents' actual hours that were worked routinely exceeded scheduled hours, as residents tend to remain to complete tasks. A high-quality study of internal medicine interns limited to 16 hours in an intensive care unit rotation showed that actual hours worked significantly exceeded scheduled hours during the intervention and control weeks19; 2 studies showed that residents regularly remained beyond scheduled hours to complete clinical tasks12,31; and an early study showed significant differences in resident work styles and efficiency, with longer and more difficult on-call experiences for some, despite comparable objective workloads.11

Data on resident well-being indicate serious consequences of residency to trainees' well-being, and suggest that the intern year is a particularly stressful time.6,18,24 Studies also show a benefit of the 2003 ACGME standards on well-being in both medical and surgical residents.23,26 Research on the 2003 and 2011 limits clearly show that internal medicine residents' weekly hours have declined from more than 85 at the implementation of the 2003 ACGME standards to around 65 hours per week. This reduction in weekly duty hours may be most responsible for the benefits attributed to the 2003 and 2011 common requirements, offering empirical support for the 80-hour weekly limit and limits on the frequency of overnight call. In this context, it is interesting to note that 6 of 22 primary studies included in a systematic review of the benefit of a 16-hour limit35 actually assessed the impact of reductions in call frequency (while retaining 24-hour call), with call patterns and associated hours in the intervention groups approximating the current practice of call every third or fourth night. A concerning finding is that this reduction in weekly hours, and compliance with the work hour limits, appears to have resulted in an increase in clinical demands, increased perceived workload and stress, and reduced participation in educational activities,3234 with 1 study finding an increase in self-reported errors by first-year residents.34

The literature clearly shows the negative effect of sleep loss: several highlight that in a 24-hour/7-day industry, under almost any model of work scheduling, including shift-based approaches, some individuals must work at their circadian nadir, with associated consequences for their performance, safety, and well-being.16,17,20,24 Scheduling may mitigate this decrement, but it is not possible to completely eliminate it. Protected time for napping has been suggested as an intervention; however, 2 studies showed that efforts to “protect” sleep time for on call did not increase sleep, as residents may not use the nap option out of a sense of professionalism and a desire to provide care for their patients.15,25

Studies that offer insight into the educational impact of work hour limits are scant, with 1 study finding a reduction in performance on the certifying examination for neurological surgery residents,30 and several finding reductions in residents' self-reported participation in didactic activities and satisfaction with their education.33,34

Discussion

The utility of this influential literature is limited due to small sample sizes, the short-term nature of many interventions, as well as concerns about the ability to generalize from studies performed in a single specialty and, often, a very specific clinical context, such as an intensive care unit, to all specialties and clinical contexts. In fact, 17 of the 30 influential studies used internal medicine residents, and 12 used solely first-year internal medicine trainees, potentially echoing a critique of the psychology literature and its use of sophomore-level college student subjects.36 Three studies each involved residents across multiple specialties, 3 involved surgery residents, 2 involved medicine and surgery residents, 2 involved pediatrics residents, and 1 each involved residents in emergency medicine, family medicine, and neurological surgery.

Many medical, surgical, and hospital-based specialties are represented in a limited way in the large data set from which these studies were selected. In addition, to date few studies have assessed the large number of additional standards added in 2011, including enhanced standards for supervision, the creation of a safe and professional learning environment, educating residents and faculty on fatigue and alertness management, and resident participation in quality and safety improvement.

It also is important to note that positive or negative changes in any outcomes of interest cannot be unequivocally attributed to the limits. Concurrent with the implementation of the 2 sets of common standards, there has been a substantial increase in a focus on quality and safety in teaching settings, as part of the standards themselves,1,2 through the ACGME's Clinical Learning Environment Review,37 and through a multitude of efforts within the health care sector to enhance the safety and quality of care.38 There also is some indication that the improvement or worsening of quality and safety indicators may be related to greater resident peer or faculty involvement in care. This may enhance patient safety, but it could be problematic for learning. For real learning in a clinical context, residents need to be immersed in systems of patient care, not bobbing gently at the surface in the interest of safety. A letter to the editor on a widely cited trial20 of a 16-hour limit on continuous duty attributed the beneficial outcomes to increased involvement and coverage of first-year residents' work by more senior residents and faculty.39

Efforts to address the negative impact of shortened work hours, particularly the 16-hour limit for first-year residents instituted in 2011, have included night float, improved handoff procedures, and teaching on the night shift, among others. None were universally effective in addressing the negative effects of the work hour limits on patient care or learning.13,25,3224 In fact, some studies have found that night float may produce outcomes inferior to those in other forms of scheduling, and in 1 study night float was terminated early due to concerns about quality and safety of care.33

To deny the negative impact of long work hours, sleep loss, and fatigue in residents is folly, as these physiological demands are very real. At the same time, to have these physiological limits become the major driver of the system to ensure the learning, professional development, and socialization of the next generation of physicians likely is unrealistic as well. While empirical data is scarce, there is a pervasive sense that the ACGME common work hour standards, particularly those implemented in 2011, have resulted in “work compression,” by wringing out lower intensity work and downtime hours at the hospital that were valuable from an educational, professional socialization, and camaraderie perspective. This is not an indictment of the standards, but more likely of how they were implemented in some resource-constrained, resident-dependent hospitals. There also is some suggestion from citation patterns that certain areas initially thought promising have largely been abandoned as areas for study. For example, a high-quality study of a budget-neutral napping intervention, published in a leading medical education journal, received only 3 citations,40 potentially because research priorities have shifted to other interventions with more community buy-in. The work hour reductions instituted in 2003 and 2011 should have brought about changes in the structure of residency training, but this does not appear to have happened in all programs and institutions.

New common work hour standards proposed by the ACGME on November 4, 2016,41 affirmed continued support for an 80-hour weekly limit, 1 day in 7 free of all program duties, and overnight call no more frequently than every third night. The new standards propose the elimination of the 16-hour limit on continuous duty. The decision was based on evidence that a universal, cross-specialty, cross-clinical setting application of a 16-hour limit has not been beneficial. It is important to note that programs and specialties that have found this limit effective, often as “ramp-up” to allow individuals to transition from the relatively limited clinical experience of many medical students, to the 24-hour, 7-day responsibilities of residency and medical practice, will be able to continue to use it. The new standards seek to address work compression and the shifting of clinical and administrative work to non-counted hours, as well as significantly increase the focus on resident and faculty well-being, and finding meaning in work.41

Limitations of this review include the potentially subjective selection of articles by the author, with different individuals curating this literature potentially reaching different conclusions as to what constitutes the most influential studies. While citation volume is a fairly undisputed metric, there are other highly cited articles, and there are no accepted metrics of the practical impact of research. In addition, the MERSQI assesses internal validity, yet its dimensions do not address generalizability. Several of the highest-quality studies were conducted with very small samples, in a single specialty, and often in a specific clinical context, reducing generalizability. The review does not include studies on the impact of work hour limits on operative volume, due to the limitations of this literature and the fact that operative volume is a poor proxy for the quality of surgical education. Finally, a number of highly cited studies were omitted from the review because they used identical methods for slightly different populations (eg, patients in Veterans Affairs hospitals versus Medicare patients in nonfederal hospitals) or providing different publications of analyses of a larger data set.

There are a number of underinvestigated areas, with the most prominent being the impact of work hour limits on resident education. This likely is due to many potential confounding variables, and a dearth of accepted, useful metrics for this outcome. A requirement for safe practice in the future is a competent graduate, and a concern is that the safety of patients receiving care in teaching settings today might be achieved at the expense of the future patients that residents will care for after completing training. This will require more research into evidence-based ways to balance these competing demands. There also is a need for research that addresses continuity in residents' exposure to patients, to allow them to develop an understanding of the progression of disease, a patient's response to treatment, or the diagnosis and management of complications. A second area for future research entails addressing the effect of duty hour limits for surgical programs, as some studies suggest a negative impact in the areas of education and quality of patient care,42 and recent research suggests benefit in reverting to slightly more liberal standards.43 Finally, studies often use historical comparisons that assume that other attributes of the learning environment have remained stable. However, patient acuity, intensity of service, new technology and, particularly, the widespread use of the electronic health record and resulting documentation needs for residents, have changed how residents spend their time, with only a minority of time spent in direct patient care when compared to time and motion studies a decade or more ago.44

Conclusion

Duty hour limits are supported by the scientific literature, particularly limits on weekly hours and reducing the frequency of overnight call. However, many outcomes of interest are underrepresented in the empirical literature. Scientific rigor and established methods have required researchers to restrict their studies to a narrow subset of the large number of variables of interest. These methods are challenged in properly addressing the multiple, often competing, attributes of the learning environment that collectively affect patient safety, resident learning, and resident well-being. Empirically derived limits must be examined for implementation and fit with context and stakeholder buy-in; all limits will benefit from a broader examination of their implementation that allows for a concurrent assessment of several outcomes of interest. Residents may play an important role in this. In addition to being affected, they are an energetic and insightful group, who may see the benefits and drawbacks of approaches in ways their program and institutional leaders and faculty may be blinded to.

References

  • 1
    Philibert I,
    Friedmann P,
    Williams WT;
    ACGME Work Group on Resident Duty Hours. Accreditation Council for Graduate Medical Education. New requirements for resident duty hours. JAMA. 2002;288(
    9
    ):11121114.
  • 2
    Nasca TJ,
    Day SH,
    Amis ES
    Jr; ACGME
    Duty Hour Task Force. The new recommendations on duty hours from the ACGME Task Force. N Engl J Med. 2010;363(
    2
    ):e3.
  • 3
    Reed DA,
    Cook DA,
    Beckman TJ,
    et al.
    Association between funding and quality in published medical education research. JAMA. 2007;298(
    9
    ):10021009.
  • 4
    Friedman RC,
    Bigger JT,
    Kornfeld DS.
    The intern and sleep loss. N Engl J Med. 1971;285(
    4
    ):201203.
  • 5
    Reuben DB.
    Depressive symptoms in medical house officers. Effects of level of training and work rotation. Arch Intern Med. 1985;145(
    2
    ):286288.
  • 6
    Deaconson TF,
    O'Hair DP,
    Levy MF,
    et al.
    Sleep deprivation and resident performance. JAMA. 1988;260(
    12
    ):17211727.
  • 7
    Côté L,
    Turgeon J.
    Appraising qualitative research articles in medicine and medical education. Med Teach. 2005;27(
    1
    ):7175.
  • 8
    Jacques CH,
    Lynch JC,
    Samkoff JS.
    The effects of sleep loss on cognitive performance of resident physicians. J Fam Pract. 1990;30(
    2
    ):223229.
  • 9
    Hillson SD,
    Rich EC,
    Dowd B,
    et al.
    Call nights and patients care: effects on inpatients at one teaching hospital. J Gen Intern Med. 1992;7(
    4
    ):405410.
  • 10
    Laine C,
    Goldman L,
    Soukup JR,
    et al.
    The impact of a regulation restricting medical house staff working hours on the quality of patient care. JAMA. 1993;269(
    3
    ):374378.
  • 11
    Tanz RR,
    Charrow J.
    Black clouds. Work load, sleep, and resident reputation. Am J Dis Child. 1993;147(
    5
    ):579584.
  • 12
    Yedidia MJ,
    Lipkin M Jr,
    Schwartz MD.
    Doctors as workers: work-hour regulations and interns' perceptions of responsibility, quality of care, and training. J Gen Intern Med. 1993;8(
    8
    ):429435.
  • 13
    Petersen LA,
    Brennan TA,
    O'Neil AC,
    et al.
    Does housestaff discontinuity of care increase the risk for preventable adverse events? Ann Intern Med. 1994;121(
    11
    ):866872.
  • 14
    Marcus CL,
    Loughlin GM.
    Effect of sleep deprivation on driving safety in housestaff. Sleep. 1996;19(
    10
    ):763766.
  • 15
    Richardson GS,
    Wyatt JK,
    Sullivan JP,
    et al.
    Objective assessment of sleep and alertness in medical house staff and the impact of protected time for sleep. Sleep. 1996;19(
    9
    ):718726.
  • 16
    Steele MT,
    MA OJ,
    Watson WA,
    et al.
    The occupational risk of motor vehicle collisions for emergency medicine residents. Acad Emerg Med. 1999;6(
    10
    ):10501053.
  • 17
    Parks DK,
    Yetman RJ,
    McNeese MC,
    et al.
    Day-night pattern in accidental exposures to blood-borne pathogens among medical students and residents. Chronobiol Int. 2000;17(
    1
    ):6170.
  • 18
    Bellini LM,
    Baime M,
    Shea JA.
    Variation of mood and empathy during internship. JAMA. 2002;287(
    23
    ):31433146.
  • 19
    Lockley SW,
    Cronin JW,
    Evans EE,
    et al.
    Effect of reducing interns' weekly work hours on sleep and attentional failures. N Engl J Med. 2004;351(
    18
    ):18291837.
  • 20
    Landrigan CP,
    Rothschild JM,
    Cronin JW,
    et al.
    Effect of reducing interns' work hours on serious medical errors in intensive care units. N Engl J Med. 2004;351(
    18
    ):18381848.
  • 21
    Barger LK,
    Cade BE,
    Ayas NT,
    et al.
    Extended work shifts and the risk of motor vehicle crashes among interns. N Engl J Med. 2005;352(
    2
    ):125134.
  • 22
    Poulose BK,
    Ray WA,
    Arbogast PG,
    et al.
    Resident work hour limits and patient safety. Ann Surg. 2005;241(
    6
    ):847856; discussion 856–860.
  • 23
    Gopal R,
    Glasheen JJ,
    Miyoshi TJ,
    et al.
    Burnout and internal medicine resident work-hour restrictions. Arch Intern Med. 2005;165(
    22
    ):25952600.
  • 24
    Rosen IM,
    Gimotty PA,
    Shea JA,
    et al.
    Evolution of sleep quantity, sleep deprivation, mood disturbances, empathy, and burnout among interns. Acad Med. 2006;81(
    1
    ):8285.
  • 25
    Arora V,
    Dunphy C,
    Chang VY,
    et al.
    The effects of on-duty napping on intern sleep time and fatigue. Ann Intern Med. 2006;144(
    11
    ):792798.
  • 26
    Hutter MM,
    Kellogg KC,
    Ferguson CM,
    et al.
    The impact of the 80-hour resident workweek on surgical residents and attending surgeons. Ann Surg. 2006;243(
    6
    ):864871; discussion 871–875.
  • 27
    Singh H,
    Thomas EJ,
    Petersen LA,
    et al.
    Medical errors involving trainees: a study of closed malpractice claims from 5 insurers. Arch Intern Med. 2007;167(
    19
    ):20302036.
  • 28
    Volpp KG,
    Rosen AK,
    Rosenbaum PR,
    et al.
    Mortality among hospitalized Medicare beneficiaries in the first 2 years following ACGME resident duty hour reform. JAMA. 2007;298(
    9
    ):975983.
  • 29
    Arora VM,
    Georgitis E,
    Siddique J,
    et al.
    Association of workload of on-call medical interns with on-call sleep duration, shift duration, and participation in educational activities. JAMA. 2008;300(
    10
    ):11461153.
  • 30
    Jagannathan J,
    Vates GE,
    Pouratian N,
    et al.
    Impact of the Accreditation Council for Graduate Medical Education work-hour regulations on neurosurgical resident education and productivity. J Neurosurg. 2009;110(
    5
    ):820827.
  • 31
    Szymczak JE,
    Brooks JV,
    Volpp KG,
    et al.
    To leave or to lie? Are concerns about a shift-work mentality and eroding professionalism as a result of duty-hour rules justified? Milbank Q. 2010;88(
    3
    ):350381.
  • 32
    McCoy CP,
    Halvorsen AJ,
    Loftus CG,
    et al.
    Effect of 16-hour duty periods on patient care and resident education. Mayo Clinic Proc. 2011;86(
    3
    ):192196.
  • 33
    Desai SV,
    Feldman L,
    Brown L,
    et al.
    Effect of the 2011 vs 2003 duty hour regulation-compliant models on sleep duration, trainee education, and continuity of patient care among internal medicine house staff: a randomized trial. JAMA Intern Med. 2013;173(
    8
    ):649655.
  • 34
    Sen S,
    Kranzler HR,
    Didwania AK,
    et al.
    Effects of the 2011 duty hour reforms on interns and their patients: a prospective longitudinal cohort study. JAMA Intern Med. 2013;173(
    8
    ):657662; discussion 663.
  • 35
    Levine AC,
    Adusumilli J,
    Landrigan CP.
    Effects of reducing or eliminating resident work shifts over 16 hours: a systematic review. Sleep. 2010;33(
    8
    ):10431053.
  • 36
    Henrich J,
    Heine SJ,
    Norenzayan A.
    The weirdest people in the world? Behav Brain Sci. 2010;33(
    2–3
    ):6183.
  • 37
    Wagner R,
    Weiss KB.
    Lessons learned and future directions: CLER National Report of Findings 2016. J Grad Med Educ. 2016;8(
    2 suppl 1
    ):5556.
  • 38
    Leape L,
    Berwick D,
    Clancy C,
    et al; Lucian Leape Institute at the National Patient Safety Foundation.
    Transforming healthcare: a safety imperative. Qual Saf Health Care. 2009;18(
    6
    ):424428.
  • 39
    Pennell NA,
    Liu JF,
    Mazzini MJ.
    Interns work hours. N Engl J Med. 2005;362(
    7
    ):726728.
  • 40
    Shea JA,
    Dinges DF,
    Small DS,
    et al.
    A randomized trial of a three-hour protected nap period in a medicine training program: sleep, alertness, and patient outcomes. Acad Med. 2014;89(
    3
    ):452459.
  • 41
    Nasca TJ.
    Open letter to the GME community. November 4, 2016.
    Chicago, IL
    :
    Accreditation Council for Graduate Medical Education
    . http://www.acgme.org/Portals/0/PDFs/Nasca-Community/NascaLetterToTheCommunity_11-4-16.pdf. Accessed November 11, 2016.
  • 42
    Philibert I,
    Nasca T,
    Brigham T,
    et al.
    Duty-hour limits and patient care and resident outcomes: can high-quality studies offer insight into complex relationships? Annu Rev Med. 2013;64:467483.
  • 43
    Bilimoria KY,
    Chung JW,
    Hedges LV,
    et al.
    National cluster-randomized trial of duty-hour flexibility in surgical training. N Engl J Med. 2016;374(
    8
    ):713727.
  • 44
    Block L,
    Habicht R,
    Wu AW,
    et al.
    In the wake of the 2003 and 2011 duty hours regulations, how do internal medicine interns spend their time. J Gen Intern Med. 2013;28(
    8
    ):10421047.

Author Notes

Corresponding author: Ingrid Philibert, PhD, MBA, Accreditation Council for Graduate Medical Education, 401 N Michigan Avenue, Suite 2000, Chicago, IL 60611, 312.755.5003, iphilibert@acgme.org
  • Download PDF