CREOGs Over Coffee: Feasibility of an Ob-Gyn Medical Education Podcast by Residents

MD,
MD,
MD, and
MD
Online Publication Date: 01 Jun 2020
Page Range: 340 – 343
DOI: 10.4300/JGME-D-19-00644.1
Save
Download PDF

ABSTRACT

Background

Podcasts and other digital resources are increasingly popular among medical learners and allow the dissemination of research to larger audiences. Little is known about the feasibility of graduate medical education trainees developing podcasts for their own and others' learning.

Objective

We described the development and implementation of a medical education podcast series by residents for obstetrics and gynecology (Ob-Gyn) resident learning, and demonstrated feasibility, sustainability, and acceptance of this series.

Methods

We used the Council on Resident Education in Obstetrics and Gynecology (CREOG) educational guidelines to create a weekly study podcast for Ob-Gyn residents over 10 months. Costs and donations (for feasibility), downloads over time (for sustainability), and number of reviews on Apple iTunes and followers on Twitter (for acceptability) were measured.

Results

Sixty episodes were released from September 30, 2018, to July 28, 2019 (43 weeks). Initial costs included $3,150 startup and $29 monthly. Online donations through Patreon amounted to $200 a month, which covered 58% of startup costs at 10 months and are projected to cover full costs by 1.5 years. The podcast had 173 995 downloads as recorded through Podbean (39 a month in September, increased to 31 206 a month in July). It gained 644 followers on Twitter and 147 ratings on iTunes, with an average of 4.86 out of 5 stars.

Conclusions

Medical podcasts created by Ob-Gyn residents during their training appear feasible and highly acceptable over a sustained period.

Introduction

Medical trainees have traditionally relied on textbooks, classroom teaching, and review questions to acquire medical knowledge. More recently, online blogs, social media websites, and podcasts have become popular among trainees through the Free Open Access Medical Education (FOAM) movement.1,2 These digital resources are increasingly used within, or as supplements to, formal medical education curricula.39

Prior literature demonstrated that learners may prefer podcasts, as they allow asynchronous engagement, which can reduce stress and anxiety and provide accessibility to learners with different studying habits and learning styles.10,11 Other studies demonstrated podcast learning increased student and resident knowledge and engagement compared with traditional text-based learning.1215 While there are multiple podcasts available in other disciplines, there are currently few podcasts specific to obstetrics and gynecology (Ob-Gyn) residents.1,3,6,13,14 This report aims to describe the development of “CREOGs Over Coffee,” an Ob-Gyn medical education podcast by Ob-Gyn residents, and demonstrate its feasibility, sustainability, and acceptance.

Methods

The podcast was created at a large, urban, academic medical center with 32 Ob-Gyn residents. Two postgraduate year 3 (PGY-3) residents created the podcast during their own time. Podcast content was based on the Council on Resident Education in Obstetrics and Gynecology (CREOG) educational objectives, which are the main drivers of Ob-Gyn resident curricula (provided as online supplemental material).16 Podcast recording was performed in a single take, capturing a conversation between the cohosts, or the hosts and an invited subspecialist guest from our program. The hosts took turns interviewing each other or the guests.

Each podcast episode was reviewed by a board-certified Ob-Gyn or subspecialist, depending on the topic. The identified audience for the podcast was Ob-Gyn residents. The goal of each podcast was to cover a specific Ob-Gyn topic in 10 to 20 minutes. This length of time was chosen to keep listeners engaged and to allow for the podcast to fit into busy lifestyles.

We disseminated the podcast through public hosting via Podbean (http://www.podbean.com), which allowed for synchronous upload to “podcatchers,” which are standard podcast-hosting applications such as Apple Podcasts, Google Play, or Spotify. Listeners accessed episodes on podcatchers by searching for CREOGs Over Coffee or via http://www.creogsovercoffee.com. Refer to the online supplemental material for more details on the podcast implementation framework.

Feasibility markers were measured by the ability to produce weekly podcasts and offset costs through Patreon (http://www.patreon.com) online donations. Sustainability was assessed through Podbean podcast downloads, allowing for tracking of geographic distribution of downloads and number of downloads per episode and month. Podbean did not allow for tracking of download retention, defined as the same user downloading multiple episodes, or repeat downloads, defined as the same user downloading the same episode multiple times. Acceptance was measured by the number of reviews publicly seen on Apple podcasts and the number of followers on Twitter.

This study was declared exempt from review by the Women and Infants Hospital Institutional Review Board, as no human subjects were involved.

Results

Feasibility

We released 60 episodes of the podcast from September 30, 2018, to July 28, 2019, a period of 43 weeks, exceeding our parameter of 1 podcast episode per week. Episodes ranged from 10 to 30 minutes in length. Each episode, from research to publication, took approximately 3 to 4 hours for completion (breakdown provided as online supplemental material). Most podcast episodes involved the 2 PGY-3 hosts as well as their board-certified Ob-Gyn reviewer, and a few podcasts also involved a subspecialty board-certified guest.

Initial startup costs amounted to $3,180, with maintenance costs of $29 per month (table). After 10 months, 58% of these costs were offset by monthly Patreon crowdfunding (15 patrons; $200 per month income). If current funding trends continue, we anticipate that all costs will be fully covered approximately 1.5 years from startup.

table Podcast Expenses

            
              table

Sustainability

The podcast generated 173 995 downloads with listeners from more than 100 different countries, all 50 states in the United States, and 11 of Canada's provinces and territories. The United States (161 205; 93%), Canada (3475; 2%), and Australia (1504; 0.9%) had the most downloads per country. California (13 216; 8%), New York (12 444; 8%), and Texas (11 068; 77%) had the most downloads per state. Downloads increased from 39 per month in September to 31 206 per month in July, with demonstrated sustainability over time (figure).

figure. Podcast Download Numbers by Month (September 2018–July 2019)figure. Podcast Download Numbers by Month (September 2018–July 2019)figure. Podcast Download Numbers by Month (September 2018–July 2019)
figure Podcast Download Numbers by Month (September 2018–July 2019)

Citation: Journal of Graduate Medical Education 12, 3; 10.4300/JGME-D-19-00644.1

Acceptance

Acceptance was assessed through publicly viewable Apple iTunes ratings and reviews, and through the number of Twitter followers. On Apple iTunes, the podcast received 147 ratings, with an average of 4.86 stars (one 3-star, three 4-star, and one hundred forty 5-star ratings). Not all those who rated the podcast left reviews. On Twitter, the podcast has 1183 followers (as of April 15, 2020). All reviews from September 2018 to July 2019 are included as online supplemental material.

Discussion

To our knowledge, this is the first report regarding the feasibility of development of an Ob-Gyn medical education podcast by residents. We demonstrated that a weekly medical education podcast focused on CREOG guidelines was feasible, sustained over 10 months, and acceptable to an international audience.

Our findings support the existing literature with regard to learners' interest for accessible, digestible learning material.1,3,717 Emergency medicine, in particular, has led the charge in FOAM,3,14,16,17 and we demonstrate there is an interest for this in Ob-Gyn. Our findings also support the larger role that social media now plays in disseminating medical knowledge. A study of emergency medicine residents showed that almost 98% used some sort of social media for learning at least 1 hour per week.17

While podcasts and other FOAM learning tools seem to be readily accepted by learners, the literature is sparse on their effectiveness versus traditional forms of learning. One systematic review looking at multiple FOAM mediums (including blogs, Twitter, and podcasts) showed that in general, FOAM interventions did not improve knowledge, and participants using FOAM had equivalent test scores compared with those who did not use FOAM.18 One study reported higher knowledge scores on postintervention tests, but it did not compare participants' scores with those from nonintervention groups.19 However, these studies may suggest that FOAM is not inferior to traditional forms of medical education while being accessible and enjoyable for learners.

Limitations of this study include an inability to assess acceptability from all listeners. Only a limited number of listeners gave ratings and reviews or followed our Twitter account. Those listeners who responded may have been biased toward more favorable opinions about the podcasts. We were also unable to use established implantation design frameworks, such as PRECEDE, due to the difficulty of assessing impact from a podcast that is widely disseminated.20 While the target audience of the podcast was PGY-1 to PGY-4 Ob-Gyn residents, specific download data were not available; thus, we do not know if we reached our target audience. Generalizability of the podcasts' usefulness for other disciplines or health professions is also unknown. Whether listeners learned from the podcasts also was not assessed.

We aim to continue the podcast after residency and to update the website with new materials. Our next steps include a survey for our residency program to assess resident learning and attitudes after listening to our podcast.

Conclusions

A resident-created Ob-Gyn weekly podcast based on CREOG guidelines, with faculty expert review of content, was feasible over a 10-month period. The podcasts appeared highly acceptable and were downloaded nearly 175,000 times by individuals from 100 countries and all 50 states.

References

  • 1
    Cadogan M,
    Thoma B,
    Chan TM,
    Lin M.
    Free open access meducation (FOAM): the rise of emergency medicine and critical care blogs and podcasts (2002–2013). Emerg Med J. 2014;31(
    e1
    ):e76e77. doi:10.1136/emermed-2013-203502.
  • 2
    Lin M,
    Thoma B,
    Trueger NS,
    Ankel F,
    Sherbino J,
    Chan T.
    Quality indicators for blogs and podcasts used in medical education: modified Delphi consensus recommendations by an international cohort of health professions educators. Postgrad Med J. 2015;91(
    1080
    ):546550. doi:10.1136/postgradmedj-2014-133230.
  • 3
    Scott KR,
    Hsu CH,
    Johnson NJ,
    Mamtani M,
    Conlon LW,
    DeRoos FJ.
    Integration of social media in emergency medicine residency curriculum. Ann Emerg Med. 2014;64(
    4
    ):396404. doi:10.1016/j.annemergmed.2014.05.030.
  • 4
    Bahner DP,
    Adkins E,
    Patel N,
    Donley C,
    Nagel R,
    Kman NE.
    How we use social media to supplement a novel curriculum in medical education. Med Teach. 2012;34(
    6
    ):439444. doi:10.3109/0142159X.2012.668245.
  • 5
    Benetoli A,
    Chen TF,
    Aslani P.
    The use of social media in pharmacy practice and education. Res Social Adm Pharm. 2015;11(
    1
    ):146. doi:10.1016/j.sapharm.2014.04.002.
  • 6
    Grajales FJ III,
    Sheps S,
    Ho K,
    Novak-Lauscher H,
    Eysenbach G.
    Social media: a review and tutorial of applications in medicine and health care. J Med Internet Res. 2014;16(
    2
    ):e13doi:10.2196/jmir.2912.
  • 7
    Wang A,
    Sandhu N,
    Wittich C,
    Mandrekar J,
    Beckman T.
    Using social media to improve continuing medical education: a survey of course participants. Mayo Clin Proc. 2012;87(
    12
    ):11621170. doi:10.1016/j.mayocp.2012.07.024.
  • 8
    Ventola CL.
    Social media and health care professionals: benefits, risks, and best practices. P T. 2014;39(
    7
    ):491520.
  • 9
    Bernhardt JM,
    Mays D,
    Kreuter MW.
    Dissemination 2.0: closing the gap between knowledge and practice with new media and marketing. J Health Commun. 2011;16(
    1 suppl
    ):3244. doi:10.1080/10810730.2011.593608.
  • 10
    Pilarski PP,
    Alan Johnstone D, Pettepher CC, Osheroff N. From music to macromolecules: using rich media/podcast lecture recordings to enhance the preclinical educational experience. Med Teach. 2008;30(
    6
    ):630632. doi:10.1080/01421590802144302.
  • 11
    Shantikumar S.
    From lecture theatre to portable media: students' perceptions of an enhanced podcast for revision. Med Teach. 2009;31(
    6
    ):535538. doi:10.1080/01421590802365584.
  • 12
    Back DA,
    von Malotky J,
    Sostmann K,
    Hube R,
    Peters H,
    Hoff E.
    Superior gain in knowledge by podcasts versus text-based learning in teaching orthopedics: a randomized controlled trial. J Surg Educ. 2017;74(
    1
    ):154160. doi:10.1016/j.jsurg.2016.07.008.
  • 13
    Lee SC,
    Huang H,
    Minard CG,
    Schackman J,
    Rajagopalan S.
    The use of podcast videos for airway skills. Clin Teach. 2019;16(
    6
    ):585588. doi:10.1111/tct.12984.
  • 14
    Riddell J,
    Swaminathan A,
    Lee M,
    Abdiwahab M,
    Rogers R,
    Rezaie S.
    A survey of emergency medicine residents' use of educational podcasts. West J Emerg Med. 2017;18(
    2
    ):229234. doi:10.5811/westjem.2016.12.32850.
  • 15
    Matava CT,
    Rosen D,
    Siu E,
    Bould DM. eLearning among Canadian anesthesia residents: a survey of podcast use and content needs. BMC Med Educ. 2013;13:59. doi:10.1186/1472-6920-13-59.
  • 16
    Council on Resident Education in Obstetrics and Gynecology. Educational Objectives: Core Curriculum in Obstetrics and Gynecology. 11th ed.
    Washington, DC
    :
    The American College of Obstetricians and Gynecologists
    ; 2016. https://www.acog.org/education-and-events/creog/curriculum-resources. Accessed April 15, 2020.
  • 17
    Mehta NB,
    Hull AL,
    Young JB,
    Stoller JK.
    Just imagine: new paradigms for medical education. Acad Med. 2013;88(
    10
    ):14181423. doi:10.1097/ACM.0b013e3182a36a07.
  • 18
    Mallin M,
    Schlein S,
    Doctor S,
    Stroud S,
    Dawson M,
    Fix M.
    A survey of the current utilization of asynchronous education among emergency medicine residents in the United States. Acad Med. 2014;89(
    4
    ):598601. doi:10.1097/ACM.0000000000000170.
  • 19
    Cheston CC,
    Flickinger TE,
    Chisolm MS.
    Social media use in medical education: a systematic review. Acad Med. 2013;88(
    6
    ):893901. doi:10.1097/ACM.0b013e31828ffc23.
  • 20
    Gielen AC,
    Eileen MM.
    The PRECEDE-PROCEED planning model. In:
    Glanz K,
    Lewis F,
    Rimer KB,
    eds. Health Behavior and Health Education.
    San Francisco, CA
    :
    Jossey-Bass;
    1996.
Copyright: Accreditation Council for Graduate Medical Education 2020 2020
pdf
<bold>
  <sc>figure</sc>
</bold>
figure

Podcast Download Numbers by Month (September 2018–July 2019)


Author Notes

Editor's Note: The online version of this article contains CREOG learning objectives, the podcast implementation framework, and Apple Podcast reviews.

Funding: The authors report no external funding source for this study.

Conflict of interest: The authors declare they have no competing interests.

The authors would like to thank Dr Beth Cronin for her contributions in reviewing the podcast content and material.

Corresponding author: Fei Cai, MD, Women and Infants Hospital, 101 Dudley Street, Providence, RI 02905, 626.825.2729, fcai@wihri.org
Received: 12 Sept 2019
Accepted: 31 Mar 2020
  • Download PDF