Factors Associated With Resident Continuity in Ambulatory Training Practices
ABSTRACT
Background
Continuity of care is a critical element of residents' educational experience in primary care programs.
Objective
We examined how continuity in resident practices compares to nonteaching practices, identified factors associated with increased continuity, and explored the association between continuity and quality measures.
Methods
We analyzed 117 235 patient visits to 4 resident practices (26 resident teams in internal medicine, pediatrics, family medicine, and medicine-pediatrics) and 270 242 visits to nonteaching community practices between July 2013 and May 2014. We defined continuity from both clinician and patient perspectives, and used logistic regression models to examine the influence of factors on continuity while controlling for postgraduate year, patient age, gender, race, and insurance.
Results
Continuity was greater at nonteaching sites compared to resident practices (87.3% versus 56.2%, P < .001). Resident continuity ranged from 33.1% to 83.7% among resident sites. Factors associated with improved resident continuity included absence of advanced practice providers (71.5% versus 52.3%); consistent use of scheduling protocols (77.5% versus 33.1%); rescheduling policies (71.5% versus 41.3%); increased faculty clinical time (71.5% versus 46.3%); and dismissal policies for excessive missed appointments (71.5% versus 62.5%, P < .001 for all). Increased continuity was associated with improved rates of diabetic control (62.8% versus 54.6%); hypertension control (82.8% versus 57.5%); screening colonoscopy (69.2% versus 31.9%); and mammography (74.8% versus 38.2%, P < .001 for all).
Conclusions
Increased clinical faculty time, scheduling protocols, and absence of advanced practice providers were most strongly associated with increasing continuity. Increased continuity was associated with improved quality measures.
Introduction
Continuity of care is a fundamental component of primary care, yet maintaining adequate continuity for patients and residents in academic settings remains a challenge. Continuity has long been associated with improved clinical outcomes, improved satisfaction, and improved adherence to treatment.1–8 Thus, providing a longitudinal primary care experience has become a key goal of primary care residency training. Many Accreditation Council for Graduate Medical Education Review Committees have stipulated a minimum amount of ambulatory training for that specialty and have stressed the need for continuity. There are, however, many challenges to developing and maintaining continuity in a resident clinic; most notably, residents' division of time between inpatient and outpatient rotations and the inherent complexities of large academic medical centers.9–13
With the advent of the patient-centered medical home (PCMH), there has been a heightened recognition of the importance of primary care and the need to improve ambulatory experiences.14–16 In fact, a recent study found that one of the strongest predictors of entering a primary care specialty was the continuity of relationships formed with patients during training.17 Continuity of care also contributes to patient satisfaction and clinical outcomes.6,8 Despite its importance, studies documenting resident continuity with patients generally illustrate disappointing findings.18–21 One study found that pediatrics patients assigned to a resident physician saw their primary physician at only 25% of their visits.22
Although past studies have demonstrated varied levels of continuity in resident teaching practices, factors that may improve continuity have not been evaluated. Our objectives were to (1) examine how continuity in resident practices compares to nonteaching practices for both provider continuity and patient continuity; (2) identify discrete factors associated with increased continuity in resident practices; and (3) examine the association between resident continuity and quality measures.
Methods
Program Structure and Continuity Data Collection
We examined continuity at 4 ambulatory residency training programs (internal medicine, pediatrics, family medicine, and medicine-pediatrics) in Upstate New York between July 2013 and May 2014. All practices were certified as Level 3 PCMH. Residents spent between 1 and 3 sessions per week in clinic, depending on specialty and postgraduate year status. In total, there were 26 clinical teams composed of a lead attending preceptor, supporting preceptors, and 3 to 8 residents. For each visit, we determined the rendering provider (ie, treating provider), the primary care provider, the primary resident provider, and patient's age, gender, race, and insurance. We also pulled visit data from 30 affiliated nonteaching primary care practices located in the community. All practices shared a common electronic health record.
Continuity Definitions
We defined continuity from both the resident and patient perspectives (table 1). Resident continuity was defined as the percentage of patients seen by residents who were their primary patients. We defined patient continuity based on 2 methods. Patient continuity with his or her resident was defined as the percentage of all patient visits at which the patient was seen by his or her primary resident physician. Patient continuity with his or her primary attending or resident physician was defined as the percentage of all visits at which the patient was seen by either his or her primary resident or team attending. We chose these definitions to prioritize the teaching dyad of the resident-attending pairing that is essential to teaching programs.23,24
Program-Level Data Collection
At each resident practice, we surveyed the residency program director, clinic director, office manager, nurse leader, and chief resident to determine what factors each site used to promote continuity. The survey addressed a number of factors, including (1) the presence of advance practice providers (APPs; nurse practitioners or physician assistants); (2) scheduling protocols; (3) organized patient handoffs between residents; (4) dismissal policies; (5) number of resident sessions per week; and (6) clinical full-time equivalent (FTE) of faculty. Scheduling protocols varied among sites, but stipulated how acute and chronic appointments were scheduled to accommodate continuity. Dismissal policies monitored missed appointments and permitted the dismissal of a patient after 3 missed appointments if approved by the primary care physician. To account for variation in adherences to reported processes, we asked respondents to rate the site's adherence to each process. Adherence to scheduling protocols, patient handoffs, and dismissal policies were measured on a 5-point scale, anchored with “Never” to “Always.” Mean scores were calculated from all respondents at each site and adherence to each measure was reported and analyzed as “Never/rarely,” “Sometimes,” and “Often/always.”
The survey also recorded the number of clinical sessions per week that each resident was assigned in the standard schedule and the clinical FTE of faculty on each of the attending physicians on the 26 teams. The survey recorded the amount of time that each faculty devoted to precepting, clinical care, administration, and research. Clinical FTE ranged from 0.1 to 1.0 FTE and included direct patient care and precepting.
Comparison of Resident Practices and Nonteaching Practices
To provide a broader community context, we compared continuity in resident practices to continuity in nonteaching practices across the community. In addition, all sites were certified as Level 3 PCMH. We examined continuity rates for resident practices, attending practices within teaching sites, and nonteaching community practices. We subsequently determined the resident practices with the highest continuity and compared this “best case” scenario to nonteaching practices.
Quality Metrics
We measured 4 adult-focused quality metrics for each of the applicable resident teams. The quality metrics were based on the 2014 Healthcare Effectiveness Data and Information Set and measured the (1) percentage of diabetic patients aged 18 to 75 years with a HgA1c less than 8%; (2) percentage of hypertensive patients aged 18 to 85 years with a blood pressure less than 140/90 mm Hg; (3) percentage of women aged 40 to 74 years with a mammogram within the last 2 years; and (4) percentage of patients aged 50 to 75 years with a colonoscopy within the last 10 years.
This study was approved by the University of Rochester Research Subjects Review Board.
Statistical Analyses
We performed statistical analyses using SAS version 9.3 (SAS Institute Inc, Cary, NC). We compared continuity rates with chi-square test statistics and used Cochran-Armitage tests to examine trends in binomial proportions. We used logistic regression models to compare resident practices to nonteaching practices and to examine the association of various factors with continuity. We used general linear models to examine the association between resident-team continuity and team quality scores. Models were adjusted for postgraduate year status, patient age, race, gender, and insurance.
Results
Between July 2013 and May 2014, a total of 117 235 visits occurred to the 4 resident teaching programs (26 resident teams) and 270 242 visits to the nonteaching community practices. The sites included 140 resident physicians, 66 faculty physicians, and 134 community physicians. Table 2 shows the characteristics of visits to resident practices and nonteaching practices.
Continuity at Resident Practices Compared to Nonteaching Practices
Table 3 demonstrates continuity at residency practices compared to nonteaching practices. Continuity for physicians was higher in nonteaching community practices (87.3%) compared to resident practices (56.2%) or faculty practices (61.9%, P < .001). Similarly, patient continuity was higher at nonteaching practices compared to residency practices. The residency practices with the highest continuity approached that of nonteaching practices for both resident continuity (83.7% versus 87.3%) and patient continuity (77.5% versus 84%).
Factors Associated With Resident Continuity
Table 4 demonstrates factors associated with resident continuity. Factors associated with improved resident continuity included the consistent use of scheduling protocols (77.5% versus 33.1%, adjusted odds ratio [AOR] = 6.9); absence of APPs (71.5% versus 52.3%, AOR = 3.1); fewer annual visits (83.7% versus 43.1%, AOR = 6.5); rescheduling policies (71.5% versus 41.3%, AOR = 4.4); increased faculty clinical time (71.5% versus 46.3%, AOR = 3.4); policies for handoffs from graduating seniors to interns (52.9% versus 33.1%, AOR = 2.5); and dismissal policies for excessive missed appointments (71.5% versus 62.5%, AOR = 1.8).



Citation: Journal of Graduate Medical Education 8, 4; 10.4300/JGME-D-15-00755.1



Citation: Journal of Graduate Medical Education 8, 4; 10.4300/JGME-D-15-00755.1
Factors Associated With Patient Continuity
Table 4 also demonstrates factors associated with patient continuity. The consistent use of scheduling protocols, absence of APPs, rescheduling policies, increased faculty clinical time, dismissal polices, and processes for handoffs were all associated with increased patient continuity (P < .001 for all).
Quality Metrics
Increased resident continuity was associated with improved rates of diabetic control, hypertension control, screening colonoscopy, and screening mammography (figure 1). This association between continuity and quality markers persisted in adjusted regression models (figure 2).
Discussion
We found substantial variation in continuity across training sites and community practices and identified several modifiable factors associated with continuity. The consistent use of scheduling protocols, increased faculty clinical time, and the absence of APPs were most strongly associated with increasing continuity in resident practices. Increased continuity was also associated with improved clinical quality measures in resident practices.
Continuity was lower on average in residency training sites compared to nonteaching community practices, which is consistent with prior literature.25 However, we found significant variability in continuity among residency sites and found that resident practices with the highest continuity approached that of the nonteaching practices in the community. This suggests that, under the right circumstances, residency practices can achieve continuity rates comparable to those of nonteaching practices.
Scheduling protocols and adherence to those protocols were most strongly associated with increased continuity from both resident and patient perspectives. Several tools exist to support designing patient schedules,26–28 yet processes will ultimately need to be adapted to individual programs. Overall, our results suggest that the commitment of office staff to prioritize continuity and follow scheduling protocols will enhance continuity. Similarly, a process to transition patients from graduating senior residents to new residents was associated with increased continuity. A previous trial demonstrated similar benefits with sign-out procedures implemented between graduating residents and incoming interns, improving the rate of follow-up of important clinical tasks.29 We also found both scheduling protocols and sign-out strategies offer tangible opportunities for resident practices to improve continuity without expending substantial resources.
The absence of APPs (ie, nurse practitioners or physician assistants) was also strongly associated with both increased resident and patient continuity. Absence of APPs in a resident practice may encourage follow-up with either the resident physician or primary attending. At the same time, not having APPs has the potential to limit access for patients. Thus, there is a potential tradeoff between continuity and patient access that must be balanced within training sites when considering the use of APPs. Team-based care is an integral aspect of PCMHs, but the importance of continuity for residents must be factored into its implementation.
With the passage of the Affordable Care Act in 2010 and progress toward the medical home model, there has been a heightened focus on improving quality metrics, continuity of care, and patient satisfaction.30 We found that increased continuity was associated with improved quality measures for diabetes, hypertension, and cancer screening. Prior literature also suggests that improved continuity may be correlated with improved preventive care, control of chronic conditions, and patient satisfaction.6,31,32 As medicine moves toward value-based care, quality and continuity will become increasingly important in resident practices. Training residents in well-functioning continuity clinics is thus vital for perpetuation of the medical home model.
This study has several limitations. First, it was confined to 4 resident practices, which limited the ability to determine the independent effect of different factors on continuity due to overfitting of regression models and colinearity. Second, for several of the factors evaluated, the sample may have resulted in insufficient power to detect a potentially existing relationship. Third, adherence to clinic policies was determined by subjective survey response. Finally, we provided the comparisons to nonteaching community practices, which included more white, privately insured, and older patients compared to resident practices. Regression models were adjusted for these demographic differences.
Conclusion
This study demonstrates that continuity in a resident practice can approach that of nonteaching community practices. Several factors, including increased clinical faculty time, scheduling protocols, and the absence of APPs, were most strongly associated with increased continuity. Continuity, in turn, was associated with higher quality measures. All of these findings have implications for clinical practice and resident education in primary care.

Association Between Overall Patient Continuity and Quality Markers
Abbreviations: HgA1c, Hemoglobin A1c; HTN, hypertension.

Association Between Resident Team Continuity and Quality Markers
Abbreviation: HgA1c, Hemoglobin A1c. Note: Generalized linear models were adjusted for resident postgraduate year, patient age, gender, race, and insurance.
Author Notes
Funding: The authors report no external funding source for this study.
Conflict of interest: The authors declare they have no competing interests.



