Journal of Continuing Education in the Health Professions



HOME \| SITE MAP \| CONTACT US
Your Location: Home > Volume 23, Issue 1

CURRENT ISSUE BACK ISSUES SUBSCRIBE ADVERTISE ABOUT JCEHP FOR AUTHORS JCEHP AWARD SEARCH (Members only) FULL-TEXT		Volume 23 (1) Volume 23, Issue 1, Winter 2003 J Contin Educ Health Prof 2003; 23(1):4-12 THEORETICAL FOUNDATIONS Multisource Feedback in the Assessment of Physician Competencies Jocelyn Lockyer, PhD A b s t r a c t Multisource feedback (MSF), or 360-degree employee evaluation, is a questionnaire-based assessment method in which rates are evaluated by peers, patients, and coworkers on key performance behaviors. Although widely used in industrial settings to assess performance, the method is gaining acceptance as a quality improvement method in health systems. This article describes MSF, identifies the key aspects of MSF program design, summarizes some of the salient empirical research in medicine, and discusses possible limitations for MSF as an assessment tool in health care. In industry and in health care, experience suggests that MSF is most likely to succeed and result in changes in performance when attention is paid to structural and psychometric aspects of program design and implementation. A carefully selected steering committee ensures that the behaviors examined are appropriate, the communication package is clear, and the threats posed to individuals are minimized. The instruments that are developed must be tested to ensure that they are reliable, achieve a generalizability coefficient of Ep 2 = .70, have face and content validity, and examine variance in performance ratings to understand whether ratings are attributable to how the physician performs and not to factors beyond the physician's control (e.g., gender, age, or setting). Research shows that reliable data can be generated with a reasonable number of respondents, and physicians will use the feedback to contemplate and initiate changes in practice. Performance may be affected by familiarity between rater and rate and sociodemographic and continuing medical education characteristics; however, little of the variance in performance is explained by factors outside the physician's control. MSF is not a replacement for audit when clinical outcomes need to be assessed. However, when interpersonal, communication, professionalism, or teamwork behaviors need to be assessed and guidance given, it is one of the better tools that may be adopted and implemented to provide feedback and guide performance. Lessons for Practice Multisource feedback (MSF) offers another method of providing physicians with feedback about their performance. Instruments used in MSF can be designed to assess Accreditation Council for Graduate Medical Education competencies, including patient care, interpersonal and communication skills, professionalism, and systems-based practice. Medical knowledge and practice-based learning competencies are probably better assessed by other tools. MSF systems can be designed so that they are valid and reliable. Physicians will accept MSF data, and many use it to contemplate and/or initiate change in practice. MeSH Terms: Clinical Competence; Communication; Education, Medical, Continuing; Employee Performance Appraisal; Feedback; Health Services Research; Medical Audit; Outcome Assessment (Health Care); Peer Review, Health Care; Physician's Practice Patterns; Physician-Patient Relations; Questionnaires; Research Design; Support, Non-U.S. Gov't; Total Quality Management
HOME \| SITE MAP \| CONTACT US Copyright © 1996-2012 JCEHP.com & The Journal of Continuing Education in the Health Professions All rights reserved Disclaimer · About This Site · Web Editor · Make JCEHP Your Homepage Information on this site was last updated: 31 January 2012