Challenges and Solutions in Running Effective Clinical Competency Committees in the International Context
Last year represented the 10th anniversary of the establishment of ACGME–International (ACGME-I).1 Since Singapore's initial accreditation in 2010, ACGME-I has contributed to global graduate medical education (GME) reform efforts focused on promoting and supporting competency-based medical education (CBME) in various regions, including Asia, the Middle East, the Caribbean, and Central America.1,2 GME in ACGME-I institutions involves the implementation of competency-based training and assessment, as well as the adoption of all ACGME regulations and governance, including a clinical competency committee (CCC), with similar roles and responsibilities as in the United States. The diversity of educational environments, scopes of practice, health care delivery models, and regulatory requirements, in the setting of different social and cultural contexts, have spurred a burgeoning body of literature exploring the need for local adaptation of educational standards.3,4 These initiatives have led to country-specific accreditation criteria and ongoing efforts in adopting international Milestones.5–7
The implementation of ACGME-I accreditation has also standardized governance, infrastructure, and operational processes of accredited GME programs, including the critical role of the CCC as an essential component of trainee assessment.8 CCCs are expected to use a multidimensional approach to assessments to make informed decisions about resident performance and reach a consensus regarding trainee progress and Milestone attainment.9 The efficacy of international CCCs may be influenced by the sociocultural constructs that affect learning, teaching, and communication among faculty and residents, as well as the different mental models that inform faculty and trainee expectations. Despite these challenges, the multiculturalism and diversity of an international faculty can be leveraged to improve CCC functioning by including diverse perspectives to enhance group function and facilitate more information sharing, leading to well-informed judgments.10
Drawing on studies of group decision-making and published literature on CCC effectiveness,11–13 as well as personal experiences in conducting CCC meetings for the past decade at our respective institutions, we review specific challenges that international GME programs may face in assessing residents, providing feedback and running CCCs, and implement evidence-based solutions in the internal arena.
International Challenges Related to CCC Operations
Diversity of Members and Expectations of Trainee Performance
Group decision-making forms the core of CCC meetings.13 The 3 main principles of group decision-making that shape CCC process are: (1) utilizing data from multiple assessment tools, (2) having a shared mental model around a competency framework, and (3) having structured discussions to reach a consensus regarding trainee performance.9,13 It is the latter 2 principles that can pose specific challenges in the international context.
In many ACGME-I-accredited institutions, CCCs consist of faculty members from significantly diverse training backgrounds and health delivery systems, many of whom lack personal experience with a competency-based framework. This lack of experience or familiarity with CBME causes evaluators to rely heavily on their own training, and often shapes their expectations of residents and influences their views on assessments and evaluations, leading evaluators to compare residents against their personal standards and frame of reference, rather than against a standardized competency framework.14 These variations in cultural and training backgrounds can also influence how faculty rate and interpret assessment scores,15 impacting the accuracy of evaluations of resident competence.16 This variability may be compounded at the CCC level, where members assimilate aggregate data into a consensus assessment of resident performance.
Faculty-to-faculty communication affects CCC dynamics. A critical component of successful CCCs is the use of structured open dialogue to facilitate consensus among members.9,13 Research has shown that communication styles differ across cultural contexts.28 For example, many non-Western societies demonstrate a preference for collectivistic communication styles, which avoid disagreement and favor harmonious group relations.28 Diversity in culture also affects assumptions about CCC purpose and how the group's decisions are used to judge trainee performance. In Hofstede's cultural dimensions theory,29 Asian and Middle Eastern countries have a tightly integrated collectivist society. CCC members in some Eastern cultures may, therefore, be less inclined to participate in the sharing of unknown information, open discourse, or voicing unpopular opinions for fear of disrupting the group's harmony or concerns about potentially provoking offense from peers. Another important factor influencing CCC dynamics is the hierarchical structures of some Eastern cultures, which place a high value on professional position and social status. This might impede junior faculty members' ability to openly voice their opinions, speak out of turn, or openly disagree with senior faculty opinions.30
Feedback to Residents
The effectiveness of CCC decisions is closely related to the ability to inform resident performance through effective feedback. These conversations can be complicated if the feedback provider and recipient do not have a shared understanding of the goals of feedback. This challenge is compounded in the international arena where sociocultural factors play an important role and can significantly affect the provision and receipt of feedback.31 In some countries, faculty may be uncomfortable or unwilling to engage in feedback conversations, as they can be challenging. This is especially true when negative feedback is involved, as there is a fear of offending the trainee, leading to rejection of feedback and subsequent damage to the educator-learner relationship.27,31 Conversely, while praise can motivate and reinforce positive behaviors, it may not be given, reflecting a cultural stance of excellence as a minimal expectation.32 In some societies, feedback, irrespective of type, is often taken personally.32 While this may be a universal challenge, it is especially significant in Eastern cultures, where the distinction between professional and personal attributes is often blurred.3,4 These dynamics often result in fear of giving, seeking, and receiving feedback.
Another significant cultural construct affecting feedback in Eastern (particularly Asian) cultures is modesty.32 Individuals who speak highly of themselves and their achievements may be seen as arrogant, self-promoting, or grandiose. As such, during self-assessment of Milestones or self-reflection for CCCs, residents are often observed to rank themselves lower than expected, with a tendency to focus on areas for improvement while downplaying strengths. They may also avoid seeking feedback for fear of appearing to seek praise.27
Tips for CCCs in the International Context
Addressing these challenges within local context, the Table summarizes evidence-based strategies to improving CCC function from the US-based literature and provides potential solutions within international cultural settings.
Conclusions
There is a paucity of published studies on the role and characteristics of CCCs in the international setting. Faculty diversity adds unique perspectives and can facilitate rich and meaningful conversations, but can also create challenges for CCCs. From our experience running CCCs in Singapore and the United Arab Emirates for the past decade, this article represents our insights on the impact of the various factors in the international context that can affect the efficacy of CCCs. Primary areas identified include the role of the social context in feedback on trainee performance and best practices in CCC operations, with a focus on potential international adaptations. We hope that these recommendations serve as a resource to educators involved in ACGME-I reform efforts worldwide. More research on the impact of sociocultural practices and behaviors is needed to better direct and define CCC processes and outcomes in the global arena.
Author Notes



