Kaohsiung Journal of Medical Sciences
Volume 24, Issue 12 , Pages 656-663, December 2008

Setting Pass Scores for Clinical Skills Assessment

  • Min Liu
    • ,
  • Keh-Min Liu

      Affiliations

    • Corresponding Author InformationAddress correspondence and reprint requests to: Dr Keh-Min Liu, College of Medicine, Kaohsiung Medical University, 100 Shin-Chuan 1st Road, Kaohsiung 807, Taiwan

Department of Anatomy, College of Medicine, Kaohsiung Medical University, Kaohsiung, Taiwan

Received 5 January 2009; accepted 22 January 2009.

Article Outline

In a clinical skills assessment, the decision to pass or fail an examinee should be based on the test content or on the examinees' performance. The process of deciding a pass score is known as setting a standard of the examination. This requires a properly selected panel of expert judges and a suitable standard setting method, which best fits the purpose of the examination. Six standard setting methods that are often used in clinical skills assessment are described to provide an overview of the standard setting process.

Key Words:  clinical skills assessment , standard setting

No full text is available. To read the body of this article, please view the PDF online.

 

Back to Article Outline

References 

  1. Harden RM . Assess clinical competence—an overview . Med Teach . 1979;1:289–296
  2. Livingston SA , Zieky MJ . Passing Scores: A Manual for Setting Standards of Performance on Educational and Occupational Tests . Princeton, NJ: Educational Testing Service; 1982;
  3. Kane M . Choosing between examinee-centered and test-centered standard-setting methods . Educ Assess . 1998;5:129–145
  4. Kane MT , Crooks TJ , Cohen AS . Designing and evaluating standard-setting procedures for licensure and certification tests . Adv Health Sci Educ . 1999;4:195–207
  5. Norcini JJ . Setting standards on educational tests . Med Educ . 2003;37:464–469
  6. Downing SM , Tekian A , Yudkowsky R . Procedures for establishing defensible absolute passing scores on performance examinations in health professions education . Teach Learn Med . 2006;18:50–57
  7. Case SM , Swanson DB . Constructing Written Test Questions for the Basic and Clinical Sciences . Philadelphia: National Board of Medical Examiners; 2001;
  8. Boulet JR , De Champlain AF , McKinley DW . Setting defensible performance standards on OSCEs and standardized patient examinations . Med Teach . 2003;25:245–249
  9. Turnbull JM . What is … Normative versus criterionreferenced assessment . Med Teach . 1989;11:145–150
  10. McAleer S . Formative and summative assessment . In:  Dent JA ,  Harden RM editor. Practical Guide for Medical Teachers . 1st edition. Edinburgh: Churchill Livingstone; 2001;p. 293–302
  11. Downing SM , Lieska NG , Raible MD . Establishing passing standards for classroom achievement tests in medical education: a comparative study of four methods . Acad Med . 2003;78:S85–S87
  12. Friedman Ben-David M . AMEE Guide No. 18: Standard setting in student assessment . Med Teach . 2000;22:120–130
  13. Yudkowsky R , Downing SM , Popescu M . Setting standards for performance tests: a pilot study of a three-level Angoff method . Acad Med . 2008;83:S13–S16
  14. Cusimano MD , Rothman AI . The effect of incorporating normative data into a criterion-referenced standard setting in medical education . Acad Med . 2003;78:S88–S90
  15. Cizek GJ . An NCME instructional module on: setting passing scores . Educ Meas: Issues Pract . 1996;15:20–31
  16. Wood TJ , Humphrey-Murto SM , Norman GR . Standard setting in a small scale OSCE: a comparison of the Modified Borderline-Group Method and the Borderline Regression Method . Adv Health Sci Educ . 2006;11:115–122
  17. Kramer A , Muijtjens A , Jansen K , et al.   Comparison of a rational and an empirical standard setting procedure for an OSCE . Med Educ . 2003;37:132–139
  18. Hobma SO , Ram PM , Muijtjens AM , et al.   Setting a standard for performance assessment of doctor-patient communication in general practice . Med Educ . 2004;38:1244–1252
  19. Onishi H . Theories of assessment methods in OSCE . In:  Otaki J editors. Theories and Practices of OSCE . Tokyo: Shinohara-shuppan Shinsha; 2007;p. 18–39 [In Japanese]
  20. Boursicot KA , Roberts TE , Pell G . Using borderline methods to compare passing standards for OSCEs at graduation across three medical schools . Med Educ . 2007;41:1024–1031
  21. Hambleton RK. Setting Standard on Performance Assessments: Promising New Methods and Technical Issues. Paper presented at the annual meeting of the American Psychological Association, New York, August 1995. Available from http://eric.ed.gov/ [Date accessed: November 20, 2008]
  22. Norcini JJ , Shea JA . The credibility and comparability of standards . Appl Meas Educ . 1997;10:39–59
  23. Humphrey-Murto S , MacFadyen JC . Standard setting: a comparison of case-author and modified borderline-group methods in a small-scale OSCE . Acad Med . 2002;77:729–732
  24. Searle J . Defining competency—the role of standard setting . Med Educ . 2000;34:363–366

PII: S1607-551X(09)70032-4

doi:10.1016/S1607-551X(09)70032-4

Kaohsiung Journal of Medical Sciences
Volume 24, Issue 12 , Pages 656-663, December 2008

Article Tools