Factors Associated With Resident Continuity in Ambulatory Training Practices

MD, MPH,
MD,
MD, MPH,
MD,
MD,
MD, and
MD
Online Publication Date: 01 Oct 2016
Page Range: 532 – 540
DOI: 10.4300/JGME-D-15-00755.1
Save
Download PDF

ABSTRACT

Background 

Continuity of care is a critical element of residents' educational experience in primary care programs.

Objective 

We examined how continuity in resident practices compares to nonteaching practices, identified factors associated with increased continuity, and explored the association between continuity and quality measures.

Methods 

We analyzed 117 235 patient visits to 4 resident practices (26 resident teams in internal medicine, pediatrics, family medicine, and medicine-pediatrics) and 270 242 visits to nonteaching community practices between July 2013 and May 2014. We defined continuity from both clinician and patient perspectives, and used logistic regression models to examine the influence of factors on continuity while controlling for postgraduate year, patient age, gender, race, and insurance.

Results 

Continuity was greater at nonteaching sites compared to resident practices (87.3% versus 56.2%, P < .001). Resident continuity ranged from 33.1% to 83.7% among resident sites. Factors associated with improved resident continuity included absence of advanced practice providers (71.5% versus 52.3%); consistent use of scheduling protocols (77.5% versus 33.1%); rescheduling policies (71.5% versus 41.3%); increased faculty clinical time (71.5% versus 46.3%); and dismissal policies for excessive missed appointments (71.5% versus 62.5%, P < .001 for all). Increased continuity was associated with improved rates of diabetic control (62.8% versus 54.6%); hypertension control (82.8% versus 57.5%); screening colonoscopy (69.2% versus 31.9%); and mammography (74.8% versus 38.2%, P < .001 for all).

Conclusions 

Increased clinical faculty time, scheduling protocols, and absence of advanced practice providers were most strongly associated with increasing continuity. Increased continuity was associated with improved quality measures.

Introduction

Continuity of care is a fundamental component of primary care, yet maintaining adequate continuity for patients and residents in academic settings remains a challenge. Continuity has long been associated with improved clinical outcomes, improved satisfaction, and improved adherence to treatment.18 Thus, providing a longitudinal primary care experience has become a key goal of primary care residency training. Many Accreditation Council for Graduate Medical Education Review Committees have stipulated a minimum amount of ambulatory training for that specialty and have stressed the need for continuity. There are, however, many challenges to developing and maintaining continuity in a resident clinic; most notably, residents' division of time between inpatient and outpatient rotations and the inherent complexities of large academic medical centers.913

With the advent of the patient-centered medical home (PCMH), there has been a heightened recognition of the importance of primary care and the need to improve ambulatory experiences.1416 In fact, a recent study found that one of the strongest predictors of entering a primary care specialty was the continuity of relationships formed with patients during training.17 Continuity of care also contributes to patient satisfaction and clinical outcomes.6,8 Despite its importance, studies documenting resident continuity with patients generally illustrate disappointing findings.1821 One study found that pediatrics patients assigned to a resident physician saw their primary physician at only 25% of their visits.22

Although past studies have demonstrated varied levels of continuity in resident teaching practices, factors that may improve continuity have not been evaluated. Our objectives were to (1) examine how continuity in resident practices compares to nonteaching practices for both provider continuity and patient continuity; (2) identify discrete factors associated with increased continuity in resident practices; and (3) examine the association between resident continuity and quality measures.

Methods

Program Structure and Continuity Data Collection

We examined continuity at 4 ambulatory residency training programs (internal medicine, pediatrics, family medicine, and medicine-pediatrics) in Upstate New York between July 2013 and May 2014. All practices were certified as Level 3 PCMH. Residents spent between 1 and 3 sessions per week in clinic, depending on specialty and postgraduate year status. In total, there were 26 clinical teams composed of a lead attending preceptor, supporting preceptors, and 3 to 8 residents. For each visit, we determined the rendering provider (ie, treating provider), the primary care provider, the primary resident provider, and patient's age, gender, race, and insurance. We also pulled visit data from 30 affiliated nonteaching primary care practices located in the community. All practices shared a common electronic health record.

Continuity Definitions

We defined continuity from both the resident and patient perspectives (table 1). Resident continuity was defined as the percentage of patients seen by residents who were their primary patients. We defined patient continuity based on 2 methods. Patient continuity with his or her resident was defined as the percentage of all patient visits at which the patient was seen by his or her primary resident physician. Patient continuity with his or her primary attending or resident physician was defined as the percentage of all visits at which the patient was seen by either his or her primary resident or team attending. We chose these definitions to prioritize the teaching dyad of the resident-attending pairing that is essential to teaching programs.23,24

table 1 Definitions of Continuity

            
              table 1

Program-Level Data Collection

At each resident practice, we surveyed the residency program director, clinic director, office manager, nurse leader, and chief resident to determine what factors each site used to promote continuity. The survey addressed a number of factors, including (1) the presence of advance practice providers (APPs; nurse practitioners or physician assistants); (2) scheduling protocols; (3) organized patient handoffs between residents; (4) dismissal policies; (5) number of resident sessions per week; and (6) clinical full-time equivalent (FTE) of faculty. Scheduling protocols varied among sites, but stipulated how acute and chronic appointments were scheduled to accommodate continuity. Dismissal policies monitored missed appointments and permitted the dismissal of a patient after 3 missed appointments if approved by the primary care physician. To account for variation in adherences to reported processes, we asked respondents to rate the site's adherence to each process. Adherence to scheduling protocols, patient handoffs, and dismissal policies were measured on a 5-point scale, anchored with “Never” to “Always.” Mean scores were calculated from all respondents at each site and adherence to each measure was reported and analyzed as “Never/rarely,” “Sometimes,” and “Often/always.”

The survey also recorded the number of clinical sessions per week that each resident was assigned in the standard schedule and the clinical FTE of faculty on each of the attending physicians on the 26 teams. The survey recorded the amount of time that each faculty devoted to precepting, clinical care, administration, and research. Clinical FTE ranged from 0.1 to 1.0 FTE and included direct patient care and precepting.

Comparison of Resident Practices and Nonteaching Practices

To provide a broader community context, we compared continuity in resident practices to continuity in nonteaching practices across the community. In addition, all sites were certified as Level 3 PCMH. We examined continuity rates for resident practices, attending practices within teaching sites, and nonteaching community practices. We subsequently determined the resident practices with the highest continuity and compared this “best case” scenario to nonteaching practices.

Quality Metrics

We measured 4 adult-focused quality metrics for each of the applicable resident teams. The quality metrics were based on the 2014 Healthcare Effectiveness Data and Information Set and measured the (1) percentage of diabetic patients aged 18 to 75 years with a HgA1c less than 8%; (2) percentage of hypertensive patients aged 18 to 85 years with a blood pressure less than 140/90 mm Hg; (3) percentage of women aged 40 to 74 years with a mammogram within the last 2 years; and (4) percentage of patients aged 50 to 75 years with a colonoscopy within the last 10 years.

This study was approved by the University of Rochester Research Subjects Review Board.

Statistical Analyses

We performed statistical analyses using SAS version 9.3 (SAS Institute Inc, Cary, NC). We compared continuity rates with chi-square test statistics and used Cochran-Armitage tests to examine trends in binomial proportions. We used logistic regression models to compare resident practices to nonteaching practices and to examine the association of various factors with continuity. We used general linear models to examine the association between resident-team continuity and team quality scores. Models were adjusted for postgraduate year status, patient age, race, gender, and insurance.

Results

Between July 2013 and May 2014, a total of 117 235 visits occurred to the 4 resident teaching programs (26 resident teams) and 270 242 visits to the nonteaching community practices. The sites included 140 resident physicians, 66 faculty physicians, and 134 community physicians. Table 2 shows the characteristics of visits to resident practices and nonteaching practices.

table 2 Characteristics of Patients' Visits to Resident Practices and Nonteaching Practices

          
            table 2

Continuity at Resident Practices Compared to Nonteaching Practices

Table 3 demonstrates continuity at residency practices compared to nonteaching practices. Continuity for physicians was higher in nonteaching community practices (87.3%) compared to resident practices (56.2%) or faculty practices (61.9%, P < .001). Similarly, patient continuity was higher at nonteaching practices compared to residency practices. The residency practices with the highest continuity approached that of nonteaching practices for both resident continuity (83.7% versus 87.3%) and patient continuity (77.5% versus 84%).

table 3 Continuity at Resident Practices and Nonteaching Practices

            
              table 3

Factors Associated With Resident Continuity

Table 4 demonstrates factors associated with resident continuity. Factors associated with improved resident continuity included the consistent use of scheduling protocols (77.5% versus 33.1%, adjusted odds ratio [AOR] = 6.9); absence of APPs (71.5% versus 52.3%, AOR = 3.1); fewer annual visits (83.7% versus 43.1%, AOR = 6.5); rescheduling policies (71.5% versus 41.3%, AOR = 4.4); increased faculty clinical time (71.5% versus 46.3%, AOR = 3.4); policies for handoffs from graduating seniors to interns (52.9% versus 33.1%, AOR = 2.5); and dismissal policies for excessive missed appointments (71.5% versus 62.5%, AOR = 1.8).

table 4 Factors Associated With Resident Continuity and Patient Continuity

            
              table 4
figure 1. Association Between Overall Patient Continuity and Quality MarkersAbbreviations: HgA1c, Hemoglobin A1c; HTN, hypertension.figure 1. Association Between Overall Patient Continuity and Quality MarkersAbbreviations: HgA1c, Hemoglobin A1c; HTN, hypertension.figure 1. Association Between Overall Patient Continuity and Quality MarkersAbbreviations: HgA1c, Hemoglobin A1c; HTN, hypertension.
figure 1 Association Between Overall Patient Continuity and Quality Markers Abbreviations: HgA1c, Hemoglobin A1c; HTN, hypertension.

Citation: Journal of Graduate Medical Education 8, 4; 10.4300/JGME-D-15-00755.1

figure 2. Association Between Resident Team Continuity and Quality MarkersAbbreviation: HgA1c, Hemoglobin A1c. Note: Generalized linear models were adjusted for resident postgraduate year, patient age, gender, race, and insurance.figure 2. Association Between Resident Team Continuity and Quality MarkersAbbreviation: HgA1c, Hemoglobin A1c. Note: Generalized linear models were adjusted for resident postgraduate year, patient age, gender, race, and insurance.figure 2. Association Between Resident Team Continuity and Quality MarkersAbbreviation: HgA1c, Hemoglobin A1c. Note: Generalized linear models were adjusted for resident postgraduate year, patient age, gender, race, and insurance.
figure 2 Association Between Resident Team Continuity and Quality Markers Abbreviation: HgA1c, Hemoglobin A1c. Note: Generalized linear models were adjusted for resident postgraduate year, patient age, gender, race, and insurance.

Citation: Journal of Graduate Medical Education 8, 4; 10.4300/JGME-D-15-00755.1

Factors Associated With Patient Continuity

Table 4 also demonstrates factors associated with patient continuity. The consistent use of scheduling protocols, absence of APPs, rescheduling policies, increased faculty clinical time, dismissal polices, and processes for handoffs were all associated with increased patient continuity (P < .001 for all).

Quality Metrics

Increased resident continuity was associated with improved rates of diabetic control, hypertension control, screening colonoscopy, and screening mammography (figure 1). This association between continuity and quality markers persisted in adjusted regression models (figure 2).

Discussion

We found substantial variation in continuity across training sites and community practices and identified several modifiable factors associated with continuity. The consistent use of scheduling protocols, increased faculty clinical time, and the absence of APPs were most strongly associated with increasing continuity in resident practices. Increased continuity was also associated with improved clinical quality measures in resident practices.

Continuity was lower on average in residency training sites compared to nonteaching community practices, which is consistent with prior literature.25 However, we found significant variability in continuity among residency sites and found that resident practices with the highest continuity approached that of the nonteaching practices in the community. This suggests that, under the right circumstances, residency practices can achieve continuity rates comparable to those of nonteaching practices.

Scheduling protocols and adherence to those protocols were most strongly associated with increased continuity from both resident and patient perspectives. Several tools exist to support designing patient schedules,2628 yet processes will ultimately need to be adapted to individual programs. Overall, our results suggest that the commitment of office staff to prioritize continuity and follow scheduling protocols will enhance continuity. Similarly, a process to transition patients from graduating senior residents to new residents was associated with increased continuity. A previous trial demonstrated similar benefits with sign-out procedures implemented between graduating residents and incoming interns, improving the rate of follow-up of important clinical tasks.29 We also found both scheduling protocols and sign-out strategies offer tangible opportunities for resident practices to improve continuity without expending substantial resources.

The absence of APPs (ie, nurse practitioners or physician assistants) was also strongly associated with both increased resident and patient continuity. Absence of APPs in a resident practice may encourage follow-up with either the resident physician or primary attending. At the same time, not having APPs has the potential to limit access for patients. Thus, there is a potential tradeoff between continuity and patient access that must be balanced within training sites when considering the use of APPs. Team-based care is an integral aspect of PCMHs, but the importance of continuity for residents must be factored into its implementation.

With the passage of the Affordable Care Act in 2010 and progress toward the medical home model, there has been a heightened focus on improving quality metrics, continuity of care, and patient satisfaction.30 We found that increased continuity was associated with improved quality measures for diabetes, hypertension, and cancer screening. Prior literature also suggests that improved continuity may be correlated with improved preventive care, control of chronic conditions, and patient satisfaction.6,31,32 As medicine moves toward value-based care, quality and continuity will become increasingly important in resident practices. Training residents in well-functioning continuity clinics is thus vital for perpetuation of the medical home model.

This study has several limitations. First, it was confined to 4 resident practices, which limited the ability to determine the independent effect of different factors on continuity due to overfitting of regression models and colinearity. Second, for several of the factors evaluated, the sample may have resulted in insufficient power to detect a potentially existing relationship. Third, adherence to clinic policies was determined by subjective survey response. Finally, we provided the comparisons to nonteaching community practices, which included more white, privately insured, and older patients compared to resident practices. Regression models were adjusted for these demographic differences.

Conclusion

This study demonstrates that continuity in a resident practice can approach that of nonteaching community practices. Several factors, including increased clinical faculty time, scheduling protocols, and the absence of APPs, were most strongly associated with increased continuity. Continuity, in turn, was associated with higher quality measures. All of these findings have implications for clinical practice and resident education in primary care.

References

  • 1
    Cabana MD,
    Jee SH.
    Does continuity of care improve patient outcomes? J Fam Pract. 2004;53(
    12
    ):974980.
  • 2
    Delva D,
    Kerr J,
    Schultz K.
    Continuity of care: differing conceptions and values. Can Fam Physician. 2011;57(
    8
    ):915921.
  • 3
    Kerr JR,
    Schultz K,
    Delva D.
    Two new aspects of continuity of care. Can Fam Physician. 2012;58(
    8
    ):e442e449.
  • 4
    Nutting PA,
    Goodwin MA,
    Flocke SA,
    et al.
    Continuity of primary care: to whom does it matter and when? Ann Fam Med. 2003;1(
    3
    ):149155.
  • 5
    Schultz K,
    Delva D,
    Kerr J.
    Emotional effects of continuity of care on family physicians and the therapeutic relationship. Can Fam Physician. 2012;58(
    2
    ):178185.
  • 6
    Saultz JW,
    Albedaiwi W.
    Interpersonal continuity of care and patient satisfaction: a critical review. Ann Fam Med. 2004;2(
    5
    ):445451.
  • 7
    De Maeseneer JM,
    De Prins L,
    Gosset C,
    et al.
    Provider continuity in family medicine: does it make a difference for total health care costs? Ann Fam Med. 2003;1(
    3
    ):144148.
  • 8
    Saultz JW,
    Lochner J.
    Interpersonal continuity of care and care outcomes: a critical review. Ann Fam Med. 2005;3(
    2
    ):159166.
  • 9
    Feddock CA,
    Hoellein AR,
    Griffith CH,
    et al.
    Are continuity clinic patients less satisfied when residents have a heavy inpatient workload? Eval Health Prof. 2005;28(
    4
    ):390399.
  • 10
    Keirns CC,
    Bosk CL.
    Perspective: the unintended consequences of training residents in dysfunctional outpatient settings. Acad Med. 2008;83(
    5
    ):498502.
  • 11
    Mariotti JL,
    Shalaby M,
    Fitzgibbons JP.
    The 4:1 schedule: a novel template for internal medicine residencies. J Grad Med Educ. 2010;2(
    4
    ):541547.
  • 12
    Warm EJ,
    Schauer DP,
    Diers T,
    et al.
    The ambulatory long-block: an Accreditation Council for Graduate Medical Education (ACGME) educational innovations project (EIP). J Gen Intern Med. 2008;23(
    7
    ):921926.
  • 13
    Willet L.
    The paradoxical influence of resident continuity clinic on primary care. J Grad Med Educ. 2012;4(
    4
    ):552.
  • 14
    Association of Program Directors in Internal Medicine ; Fitzgibbons JP, Bordley DR, et al. Redesigning residency education in internal medicine: a position paper from the association of program directors in internal medicine. Ann Intern Med. 2006;144(
    12
    ):920926.
  • 15
    Meyers FJ,
    Weinberger SE,
    Fitzgibbons JP,
    et al.
    Redesigning residency training in internal medicine: the consensus report of the Alliance for Academic Internal Medicine Education Redesign Task Force. Acad Med. 2007;82(
    12
    ):12111219.
  • 16
    Weinberger SE,
    Smith LG,
    Collier VU,
    et al.
    Redesigning training for internal medicine. Ann Intern Med. 2006;144(
    12
    ):927932.
  • 17
    Peccoralo LA,
    Tackett S,
    Ward L,
    et al.
    Resident satisfaction with continuity clinic and career choice in general internal medicine. J Gen Intern Med. 2013;28(
    8
    ):10201027.
  • 18
    Francis MD,
    Zahnd WE,
    Varney A,
    et al.
    Effect of number of clinics and panel size on patient continuity for medical residents. J Grad Med Educ. 2009;1(
    2
    ):310315.
  • 19
    Heist K,
    Guese M,
    Nikels M,
    et al.
    Impact of 4 + 1 block scheduling on patient care continuity in resident clinic. J Gen Intern Med. 2014;29(
    8
    ):11951199.
  • 20
    McBurney PG,
    Moran CM,
    Ector WL,
    et al.
    Time in continuity clinic as a predictor of continuity of care for pediatric residents. Pediatrics. 2004;114(
    4
    ):10231027.
  • 21
    Wieland ML,
    Halvorsen AJ,
    Chaudhry R,
    et al.
    An evaluation of internal medicine residency continuity clinic redesign to a 50/50 outpatient-inpatient model. J Gen Intern Med. 2013;28(
    8
    ):10141019.
  • 22
    Garfunkel LC,
    Byrd RS,
    McConnochie KM,
    et al.
    Resident and family continuity in pediatric continuity clinic: nine years of observation. Pediatrics. 1998;101(1, pt 1):37–42.
  • 23
    Pandhi N,
    Saultz JW.
    Patients' perceptions of interpersonal continuity of care. J Am Board Fam Med. 2006;19(
    4
    ):390397.
  • 24
    Waibel S,
    Henao D,
    Aller MB,
    et al.
    What do we know about patients' perceptions of continuity of care: a meta-synthesis of qualitative studies. Int J Qual Health Care. 2012;24(
    1
    ):3948.
  • 25
    Darden PM,
    Ector W,
    Moran C,
    et al.
    Comparison of continuity in a resident versus private practice. Pediatrics. 2001;108(
    6
    ):12631268.
  • 26
    American College of Physicians Center for Practice Improvement & Innovation. Management tools for internists: designing the patient schedule. 2010. https://www.acponline.org/system/files/documents/running_practice/patient_care/pat_sched.pdf. Accessed July 5, 2016.
  • 27
    Harner A.
    Tips to improve your practice's patient flow. MGMA Connex. 2001;1(
    1
    ):3637.
  • 28
    Backer LA.
    Strategies for better patient flow and cycle time. Fam Pract Manag. 2002;9(
    6
    ):4550.
  • 29
    Garment AR,
    Lee WW,
    Harris C,
    et al.
    Development of a structured year-end sign-out program in an outpatient continuity practice. J Gen Intern Med. 2013;28(
    1
    ):114120.
  • 30
    Weir SS,
    Page C,
    Newton WP.
    Continuity and access in an academic family medicine center. Fam Med. 2016;48(
    2
    ):100107.
  • 31
    Fisher M,
    Sloane P,
    Edwards L,
    et al.
    Continuity of care and hypertension control in a university-based practice. Ethn Dis. 2007;17(
    4
    ):693698.
  • 32
    Dearinger AT,
    Wilson JF,
    Griffith CH,
    et al.
    The effect of physician continuity on diabetic outcomes in a resident continuity clinic. J Gen Intern Med. 2008;23(
    7
    ):937941.
Copyright: 2016
<bold>
  <sc>figure</sc>
  1
</bold>
figure 1

Association Between Overall Patient Continuity and Quality Markers

Abbreviations: HgA1c, Hemoglobin A1c; HTN, hypertension.


<bold>
  <sc>figure</sc>
  2
</bold>
figure 2

Association Between Resident Team Continuity and Quality Markers

Abbreviation: HgA1c, Hemoglobin A1c. Note: Generalized linear models were adjusted for resident postgraduate year, patient age, gender, race, and insurance.


Author Notes

Corresponding author: Robert J. Fortuna, MD, MPH, University of Rochester School of Medicine and Dentistry, Center for Primary Care, Culver Medical Group, 913 Culver Road, Rochester, NY 14609, 585.654.5432, fax 585.288.7871, robert_fortuna@urmc.rochester.edu

Funding: The authors report no external funding source for this study.

Conflict of interest: The authors declare they have no competing interests.

Received: 06 Dec 2015
Accepted: 10 Apr 2016
  • Download PDF