AMEE 2015 Abstract Book

Page 851

#10CC15 (27849) Discordance between methods of decision in pass examination of objective structured clinical examination (OSCE) in fifth-year medical student in obstetrics and gynecology Nungrutai Saeaib*, Prince of Songkla University, Obstetrics and Gynecology, Hat Yai, Thailand Chitkasaem Suwanrath, Prince of Songkla University, Obstetrics and Gynecology, Hat Yai, Thailand Sirirat Thamrongwat, Prince of Songkla University, Obstetrics and Gynecology, Hat Yai, Thailand Saovakon Boonkumnerd, Prince of Songkla University, Obstetrics and Gynecology, Hat Yai, Thailand Kritima Jantanawan, Prince of Songkla University, Obstetrics and Gynecology, Hat Yai, Thailand Thada Kumkong, Prince of Songkla University, Obstetrics and Gynecology, Hat Yai, Thailand Background: Objective structured clinical examination (OCSE) is one method of evaluation, especially how to do. It can assess many aspects such as history taking, physical examination, counseling, laboratory interpretation and procedure. Summary of Work: 20 stations of OSCE were assessed in 600 fifth year medical students at the end of the session in 2010-2013. Pass score was decided from two methods, firstly, the score is more than minimum power level (MPL) in each station and number of stations is more than 60%. Secondly, total scores of 20 stations are more than 60%. Summary of Results: The medical students had a number of stations where the score was more than MPL 30-100% and the total scores 35-87%. The students had passed the examination in both methods 92.2%, and failed the examination 1.8%. There were medical students who had passed the examination in the number of stations but failed in total score 3.8%. On the other hand, there were medical students who had failed in number of stations but passed in total score 2%. Discussion and Conclusions: There is discordance between methods of deciding on the passing score for the OSCE examination. Take-home messages: OSCE is important in assessment but decisions on the passing score may vary.

#10CC16 (27505) Validation of Professor Assessors’ Global Rating in OSCE So Jung Yune*, Pusan National University School of Medicine, Medical Education, Yangsan, Republic of South Korea Sun Ju Im, Pusan National University School of Medicine, Medical Education, Yangsan, Republic of South Korea Sang Yeoup Lee, Pusan National University School of Medicine, Medical Education, Yangsan, Republic of South Korea Sun Yong Baek, Pusan National University School of Medicine, Department of Anatomy, Yangsan, Republic of South Korea Jae Seok Woo, Pusan National University School of Medicine, Department of Physiology, Yangsan, Republic of South Korea Background: The Objective Structured Clinical Examination(OSCE) uses CBA(Criterion Based Assessment) principles within a complex process. With increasing scrutiny of the techniques used to support high level decision making in academic disciplines, Criterion Based Assessment(CBA) delivers a reliable and structured methodological approach. Summary of Work: Fourth grade medical school students 427 in the Busan-Gyeongnam Consortium were included in the study. The examination was consisted of 6 clinical performance examination(CPX) and 6 objective structured clinical examination(OSCE) stations. Analysed data included global rating scores and checklist scores in 12 OSCE stations. Cronbach’α reliability analysis, Pearson correlation analysis, and variance analysis was carried out to examine the validation of global rating by professor assessors. Summary of Results: There were significant positive corelation(.040~ .851) in global rating scores and total scores of checklists. Results of variance analysis showed significant inter-grade discrimination and between–grouup variation by global ratings. Discussion and Conclusions: Global rating scales scored by professors showed higher inter-station reliability. These results suggest that global rating scales administered by professors are a more appropriate summative measure when assessing candidates on performance-based examinations. Take-home messages: Many factors influence the reliability of OSCE assessment method. Therefore we have to consider factors of main influences on the reliability of an OSCE.

www.amee.orgamee@dundee.ac.uk

Insp

ire...

and

be in

spired

!

AN INTERNATIONAL ASSOCIATION FOR MEDICAL EDUCATION

Glasgow, Scotland, United Kingdom

20154-9 September

SDMEG

Royal College of

Scotland – West

SCSNSkills Network

Medical and Dental Defence Union of Scotland

Cover photo is an original stained glass in the style of Charles Rennie Mackintosh done by Carol Arnold www.carolarnold.co.uk

ABSTRACT BOOKCorrect as of 31/7/15