The Effect of Paging Reminders on Fellowship Conference Attendance: A Multi-Program Randomized Crossover Study

MD,
MD,
MD, MBA,
MD, and
MD, MA
Online Publication Date: 01 Jul 2016
Page Range: 372 – 377
DOI: 10.4300/JGME-D-15-00487.1
Save
Download PDF

ABSTRACT

 Educational conferences have long served as a foundation of medical education. Sending reminder text pages prior to the start of conferences is a method that may be employed to enhance conference attendance.Background

 The goal of our study was to determine if routine text paging before regularly scheduled conferences improves attendance among fellows in 3 internal medicine programs.Objective

 A prospective, randomized, crossover study included 3 fellowship programs: pulmonary and critical care, cardiovascular disease, and hematology-oncology. The study was performed between October 2014 and March 2015. All fellows were included and randomized to 1 of 2 groups (with subsequent crossover to opposite group): Pages or No Pages. Paging reminders, which included conference title, location, and time, were sent 30 minutes prior to every conference for those in the intervention arm. Attendance was collected through a standard attendance log using self-registration.Methods

 A total of 46 fellows and 156 conferences were included for analysis, with 75 during the first 3 months and 81 during the second 3 months. There were no differences in individual overall attendance between randomized groups for the entire study period (42.9% versus 46.5%, P = .46). Paging reminders had no effect on overall individual attendance (43.7% versus 45.6%, P = .50). In addition, no significant differences were identified for individuals within each fellowship and training year.Results

 Paging reminders prior to a regularly scheduled conference had no effect on overall attendance in this study. Fellows reported that clinical obligations were a major barrier to conference attendance.Conclusions

Introduction

Educational conferences have long served as a foundation for conveying didactic content in medical education, and significant energy is dedicated to organizing and preparing conferences for groups of learners. Conferences at the graduate medical education level often involve a variety of learning styles and employ previous experience as a teaching tool. Despite this, attendance at conferences in graduate training can vary greatly due to the multitude of demands on trainees' time and clinical responsibilities. The literature shows poor attendance at regularly scheduled conferences, with studies reporting average attendance rates ranging from 30% to 50%.14

Previous research has attempted to determine factors associated with attendance at weekly conferences. These studies demonstrate that trainee attendance at conferences is affected by the date within the academic year, the year of training, and performance on United States Medical Licensing Examinations.2 The presence of food at conferences has also been shown to improve resident and fellow attendance.2,5 Regarding faculty attendance, the presence of food does not seem to have the same effect, although continuing medical education credit may improve overall attendance.6,7

Sending reminder text pages to trainees prior to the start of conferences is a method that may be employed to enhance conference attendance. The goal of our study was to determine if routine text paging before regularly scheduled conferences improved attendance among fellows in 3 internal medicine fellowship programs. We hypothesized that reminder pages would improve conference attendance for all fellows.

Methods

We performed a prospective, randomized crossover study that included 3 fellowship programs at our institution: pulmonary and critical care, cardiovascular disease, and hematology-oncology. Each fellowship is 3 years in duration, with the majority of clinical rotations occurring during the first year of training. The study was performed between October 2014 and March 2015. Conference selection included the regularly scheduled key educational conferences, at which attendance is expected within each fellowship. The conferences included for all fellowships were chosen by the investigators based on educational emphasis, previously identified poor attendance, and location and time of each conference. Target conferences included 3 pulmonary, 4 cardiology, and 2 hematology conferences. All active fellows in each program, except study investigators, were included in the study. None of the fellowship programs studied have a mandatory conference attendance requirement for graduation, but conference attendance is tracked in all 3 programs. Deficiencies in attendance are noted in midyear trainee reviews and within the “professionalism” core competency performance for trainees.

Randomization and Groupings

All fellows were randomized to 1 of 2 groups: Pages or No Pages. Given the propensity for greater clinical responsibilities during the first year, a stratified randomization was employed based on year of training. Once all fellows were stratified, a random number generator was used with 1:1 randomization to either group. After the initial 3 months, participants in each group were crossed over to the opposite group (figure 1).

Intervention and Control

Paging reminders, which included conference title, location, and time, were sent 30 minutes before every conference for those in the intervention arm. Those in the control arm did not receive these pages but received the usual weekly reminder e-mails regarding conferences for the following week. They also had access to their respective fellowship's conference calendar.

figure 1. Crossover Study Designfigure 1. Crossover Study Designfigure 1. Crossover Study Design
figure 1 Crossover Study Design

Citation: Journal of Graduate Medical Education 8, 3; 10.4300/JGME-D-15-00487.1

Data Collection

A standard attendance log using self sign-in for each conference was used. These data were subsequently entered into an online data repository by program coordinators not affiliated with the study design and unaware of the groupings.

At the completion of the study, a survey was provided to all fellows included in the study. The survey tool was created and administered through REDCap (Research Electronic Data Capture), which is a secure, web-based application designed to support data capture for research studies (provided as online supplemental material).8 This survey was e-mailed to all participants and available for 1 month after study completion.

The study was approved by the Indiana University–Purdue University Indianapolis Institutional Review Board.

Statistical Analysis

Statistical analysis was performed with the statistical software, SPSS version 22 (IBM Corp, Armonk, NY). Mean attendance between groups was compared using Student t tests. Within each group, a subgroup analysis was performed to assess for differences within the year of training and between fellowship programs. This was performed during each 3-month block. To assess for individual trainee differences, a paired t test was performed comparing mean attendance for each participant while receiving pages and while receiving no pages.

Results

A total of 156 conferences were included for analysis: 75 during the first 3 months and 81 during the second 3 months. There were 84 cardiology conferences, 43 pulmonary conferences, and 29 hematology-oncology conferences. A total of 46 fellows were included in the study: 16 pulmonary, 16 cardiology, and 14 hematology-oncology (table 1). All fellows in each fellowship program (100%) participated in the study. Average attendance for all participants at the selected conferences during the study period was 45%. There were no differences in overall attendance between groups 1 and 2 during either block or the entire study period (table 2).

table 1 Demographics

          
            table 1
table 2 Comparison of Mean Attendance Between Paging Groups

          
            table 2

We found no differences when looking at the effect of paging reminders on overall individual attendance (43.7% versus 45.6%; P = .50; figure 2). On subgroup analysis, we found no difference of paging reminders for individuals based on year of training or fellowship (figures 2 and 3). No significant differences were identified between each fellowship or between the years of training in block 1 or block 2.

At the completion of the study, a survey was provided to all study participants with an overall response rate of 59% (27 of 46 fellows). The majority of fellows found paging reminders to be helpful prior to the conference (70%, 19 of 27; data provided as online supplement material), although almost 60% (16 of 27) of the participants felt that paging had no effect on their overall attendance, and 41% (11 of 27) reported being annoyed by reminder pages. The most common reason for absence from a conference was clinical responsibilities, followed by conference time and location.

figure 2. Comparison of Mean Attendance for all Individuals and by Fellowship Program During the StudyNote: There were no statistically significant differences identified in any groups (P > .05).figure 2. Comparison of Mean Attendance for all Individuals and by Fellowship Program During the StudyNote: There were no statistically significant differences identified in any groups (P > .05).figure 2. Comparison of Mean Attendance for all Individuals and by Fellowship Program During the StudyNote: There were no statistically significant differences identified in any groups (P > .05).
figure 2 Comparison of Mean Attendance for all Individuals and by Fellowship Program During the Study Note: There were no statistically significant differences identified in any groups (P > .05).

Citation: Journal of Graduate Medical Education 8, 3; 10.4300/JGME-D-15-00487.1

Discussion

In this randomized crossover study, we found that for 3 fellowship programs at our institution, paging reminders before a regularly scheduled conference had no effect on overall attendance. To our knowledge, this is the first study to determine the effect of routine paging reminders on conference attendance. The Accreditation Council for Graduate Medical Education previously recommended that residents in internal medicine programs attend an average of 60% of educational teaching conferences,2 and published reports show average attendance rates ranging from 30% to 50%.14 Prior studies have attempted to determine if conference attendance is predictive of performance on training examinations, with mixed results.13

Reminders are popular tools utilized for adult learners. Previous studies have shown reminders to be beneficial for physicians with the implementation of clinical guidelines in preventative care.9,10 Reminders in electronic health record systems have also been shown to be an effective tool, prompting internal medicine residents to perform routine screening in primary care clinics.11 We extrapolated these data in formulating our hypothesis that similar reminders would have a beneficial effect on conference attendance. Our study, however, found no such benefit.

figure 3. Comparison of Mean Attendance for all Individuals by Year of TrainingNote: There were no statistically significant differences identified within groups (P > .05).figure 3. Comparison of Mean Attendance for all Individuals by Year of TrainingNote: There were no statistically significant differences identified within groups (P > .05).figure 3. Comparison of Mean Attendance for all Individuals by Year of TrainingNote: There were no statistically significant differences identified within groups (P > .05).
figure 3 Comparison of Mean Attendance for all Individuals by Year of Training Note: There were no statistically significant differences identified within groups (P > .05).

Citation: Journal of Graduate Medical Education 8, 3; 10.4300/JGME-D-15-00487.1

A possible explanation for our findings is the burnout effect of receiving multiple pages, as 41% of our fellows reported being annoyed by routine paging reminders. Interestingly, 70% of fellows believed the paging reminders were helpful, but almost 60% believed pages did not improve their conference attendance. The most common reason given for conference absence was clinical responsibilities. It is possible that fellows recognized that attendance was expected but believed clinical responsibilities superseded that expectation. Within the pulmonary division, there was disagreement as to whether paging reminders would affect attendance, and some felt fellow-level learners should not be notified with a page before a conference to mimic “real world” obligations and responsibilities.

There are limitations to this study. It was conducted within a single specialty and a limited set of subspecialties at a single institution, which may limit the ability to generalize from the findings. Our sample included only current fellows and not residency-level trainees. Fellowship trainees at our institution have more protected research time compared with internal medicine residents. We attempted to address the potential bias of trainees attending a conference when their colleague received a reminder page, but only 19% (5 of 27) of survey responders reported this occurring.

While paging reminders had no effect on conference attendance, alternative measures should be investigated to improve attendance. Such alternative measures could include implementing teleconference technology, determining the most appropriate time and location for conferences, and providing appropriate support for adult learners with conflicting clinical responsibilities.

Conclusion

This study of internal medicine fellows found that paging reminders seem to have no effect on attendance, and alternative measures may need to be undertaken to improve overall attendance. The majority of fellows reported that clinical responsibilities were a major driver of poor attendance.

References

  • 1
    Cacamese SM,
    Eubank KJ,
    Hebert RS,
    Wright SM.
    Conference attendance and performance on the in-training examination in internal medicine. Med Teach. 2004;26(
    7
    ):640644.
  • 2
    Fitzgerald JD,
    Wenger NS.
    Didactic teaching conferences for IM residents: who attends, and is attendance related to medical certifying examination scores? Acad Med. 2003;78(
    1
    ):8489.
  • 3
    McDonald FS,
    Zeger SL,
    Kolars JC.
    Associations of conference attendance with internal medicine in-training examination scores. Mayo Clin Proc. 2008;83(
    3
    ):449453.
  • 4
    Mueller PS,
    Litin SC,
    Sowden ML,
    Habermann TM,
    LaRusso NF.
    Strategies for improving attendance at medical grand rounds at an academic medical center. Mayo Clin Proc. 2003;78(
    5
    ):549553.
  • 5
    McDonald RJ,
    Luetmer PH,
    Kallmes DF.
    If you starve them, will they still come? Do complementary food provisions affect faculty meeting attendance in academic radiology? J Am Coll Radiol. 2011;8(
    11
    ):809810.
  • 6
    Lefebvre CW,
    Hiestand B,
    Bond MC,
    Fox SM,
    Char D,
    Weber DS,
    et al.
    Increasing faculty attendance at emergency medicine resident conferences: does CME credit make a difference? J Grad Med Educ. 2013;5(
    1
    ):4145.
  • 7
    Segovis CM,
    Mueller PS,
    Rethlefsen ML,
    LaRusso NF,
    Litin SC,
    Tefferi A,
    et al.
    If you feed them, they will come: a prospective study of the effects of complimentary food on attendance and physician attitudes at medical grand rounds at an academic medical center. BMC Med Educ. 2007;7:22.
  • 8
    Harris PA,
    Taylor R,
    Thielke R,
    Payne J,
    Gonzalez N,
    Conde JG.
    Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(
    2
    ):377381.
  • 9
    Dexter PR,
    Perkins S,
    Overhage JM,
    Maharry K,
    Kohler RB,
    McDonald CJ.
    A computerized reminder system to increase the use of preventive care for hospitalized patients. N Engl J Med. 2001;345(
    13
    ):965970.
  • 10
    Loo TS,
    Davis RB,
    Lipsitz LA,
    Irish J,
    Bates CK,
    Agarwal K,
    et al.
    Electronic medical record reminders and panel management to improve primary care of elderly patients. Arch Intern Med. 2011;171(
    17
    ):15521558.
  • 11
    McDonald CJ,
    Hui SL,
    Smith DM,
    Tierney WM,
    Cohen SJ,
    Weinberger M,
    et al.
    Reminders to physicians from an introspective computer medical record: a two-year randomized trial. Ann Intern Med. 1984;100(
    1
    ):130138.
Copyright: 2016
pdf
word
<bold>
  <sc>figure</sc>
  1
</bold>
figure 1

Crossover Study Design


<bold>
  <sc>figure</sc>
  2
</bold>
figure 2

Comparison of Mean Attendance for all Individuals and by Fellowship Program During the Study

Note: There were no statistically significant differences identified in any groups (P > .05).


<bold>
  <sc>figure</sc>
  3
</bold>
figure 3

Comparison of Mean Attendance for all Individuals by Year of Training

Note: There were no statistically significant differences identified within groups (P > .05).


Author Notes

Corresponding author: Joshua Smith, MD, University of Wisconsin School of Medicine and Public Health Medicine, MC 9988, Office 5258, 1685 Highland Avenue, Madison, WI 53705, 608.263.3612, fax 608.263.3104, jrsmith@medicine.wisc.edu

Funding: The authors report no external funding source for this study.

Conflict of interest: The authors declare they have no competing interests.

Editor's Note: The online version of this study contains the survey tool and a table of survey data.

Received: 25 Sept 2015
Accepted: 22 Feb 2016
  • Download PDF