Measuring patient views of physician communication skills: Development and testing of the Communication Assessment Tool
Introduction
Over the past decade, accreditation, certification, and quality-improvement initiatives in many countries have highlighted the importance of examining the communication skills of physicians-in-training and physicians-in-practice. In the United States, the Accreditation Council for Graduate Medical Education (ACGME) and the American Board of Medical Specialties (ABMS) jointly identified interpersonal and communication skills as one of the six general competencies for physicians [1], [2]. As noted by Duffy and colleagues, “while communication skills are the performance of specific tasks and behaviors by an individual, interpersonal skills are inherently relational and process oriented [3].” Many assessment options are available, but there is no clear guidance on how interpersonal and communication skills should be measured [3].
Patient surveys are a viable option with a long history. However, the scale development process for these surveys is often unclear and items initially developed decades ago may not seem relevant to contemporary patients. Moreover, extant instruments sometimes mix communication items with satisfaction items, bundle multiple communication elements into single items, ask patients to consider communication over a relatively long time-period (e.g., the past 12 months), or have modest internal reliability. With reliability, validity, and feasibility as central goals, we developed and tested a tool that can be used by patients to assess interpersonal and communication skills. Our objective was to create an instrument that captures patient views soon after inpatient or outpatient medical encounters, rather than impressions over a period of time. We reasoned that aggregating these “snapshots” of patient perceptions could provide specialty boards, residency programs, medical schools, and practice plans with the basis for providing focused feedback to physicians-in-practice and physicians-in-training.
Section snippets
Methods
We engaged in a systematic scale development process to obtain a psychometrically sound Communication Assessment Tool (CAT). We then conducted a field test to assess the feasibility of having physicians and patients use the CAT. Data were not connected with physician or patient names, and all aspects of the project were approved by the Northwestern University Institutional Review Board.
Results
A total of 38 of the 40 physicians (95%) were successful in completing the CAT once as a self-assessment as well as having their office staff recruit 25 patients to complete the CAT within 1 day of their visit. Accordingly, a total of 950 patients (i.e., 38 × 25) were involved in the field test (see Table 1). The patient sample included a broad range of ages, from children through patients age 75 and over. Patients sometimes had help with the CAT: 9.8% were completed by family caregivers. As one
Discussion
The 15-item Communication Assessment Tool (CAT) is a reliable and valid instrument for measuring patient perceptions of physician performance in the area of interpersonal and communication skills. Conceptually, it focuses on the achievement of communication tasks rather than prescribing particular ways of accomplishing them. At a very practical level, it is a simple and straightforward tool with discrete items that are accessible to patients across literacy levels. Moreover, the CAT can be
Acknowledgements
This study was supported by the American Board of Medical Specialties Research and Education Foundation, Evanston, Illinois, USA. Results of this research were presented at the International Conference on Communication in Healthcare (Basel, Switzerland, 2006). We thank all of the physicians, patients, and staff who participated in the development and testing process.
References (33)
The SEGUE Framework for teaching and assessing communication skills
Patient Educ Couns
(2001)- et al.
The Four Habits Coding Scheme: validation of an instrument to assess clinicians’ communication behavior
Patient Educ Couns
(2006) - et al.
Communication teaching and assessment in medical education: an international consensus statement
Patient Educ Couns
(1999) - et al.
Health promotion in primary care: physician–patient communication and decision making about prescription medications
Soc Sci Med
(1995) - et al.
Primary care physicians, office-based practice, and the meaning of quality improvement
Am J Med
(2005) - et al.
Outcomes-based evaluation in resident education: creating systems and structured portfolios
Am J Med
(2006) - et al.
General competencies and accreditation in graduate medical education
Health Affair (Millwood)
(2002) Evaluation of clinical competencies: basic certification, subspecialty certification, and recertification
Am J Phys Med Rehab
(2000)- et al.
Assessing competence in communication and interpersonal skills: the Kalamazoo II report
Acad Med
(2004) - et al.
Getting the most out of the clinical encounter: the four habits model
J Med Pract Manage
(2001)
Teaching and learning communication skills in medicine
Skills for communicating with patients
Essential elements of communication in medical encounters: the Kalamazoo consensus statement
Acad Med
Patient-centered medicine: transforming the clinical method
Cited by (291)
Reinforcing the humanity in healthcare: The Glasgow Consensus Statement on effective communication in clinical encounters
2024, Patient Education and CounselingDevelopment of a Tool to Assess Surgical Resident Competence On-Call: The Western University Call Assessment Tool (WUCAT)
2024, Journal of Surgical EducationPatient-Perceived Patient-Centeredness During Pregnancy
2023, Journal of Obstetrics and Gynaecology CanadaThe Value of the Pediatric Urgent Care in Pediatric Resident Education
2023, Academic PediatricsDevelopment of the perceived miscommunication measure in the pediatric intensive care unit
2023, Journal of Pediatric NursingParental communication satisfaction with the clinical team in the paediatric cardiac ICU
2023, Cardiology in the Young