| Home | E-Submission | Sitemap | Contact Us |  
J Korean Soc Emerg Med > Volume 31(3); 2020 > Article
Journal of The Korean Society of Emergency Medicine 2020;31(3): 315-322.
응급의학과 임상실습 과정 중 시행된 논술형 시험의 경험 및 채점 기준표 사용에 따른 채점자간 신뢰도 분석
이호진1 , 박송이1,2 , 정진우1,2 , 권인호1,2 , 최유리1 , 나현1
1동아대학교병원 응급의학과
2동아대학교 의과대학 응급의학교실
Experience of essay during the clinical clerkship in emergency medicine and inter-rater reliability on essay
Ho Jin Lee1 , Song Yi Park1,2 , Jin Woo Jeong1,2 , In Ho Kwon1,2 , Yuri Choi1 , Hyun Na1
1Department of Emergency Medicine, Dong-A University Hospital, Busan, Korea
2Department of Emergency Medicine, Dong-A University, College of Medicine, Busan, Korea
Correspondence  Song Yi Park ,Tel: 051-240-5590, Fax: 051-240-5309, Email: capesongnew@gmail.com,
Received: July 18, 2019; Revised: November 3, 2019   Accepted: November 9, 2019.  Published online: June 25, 2020.
An essay test is difficult to carry out because of the effort for hand scoring and the concerns about inter-rater reliability, even though the use of a rubric can increase inter-rater reliability. This study examined the feasibility of an essay test in medical school students and whether the use of a rubric increases inter-rater reliability.
An essay test was given to 51 undergraduate students in the third grade of emergency medicine clinical clerkship. Three raters assessed the essay test independently with a prepared rubric immediately after the test. They then did the same essay test without a rubric three months later. The researchers compared the Pearson’s correlation coefficients between raters. The researchers analyzed the validity comparing the correlation coefficient between the essay test and previous multiple-choice questions (MCQ) and feasibility by acceptance.
Fifty-one students took the essay test. The Pearson’s correlation coefficient using rubric between raters 1 and 2, 1 and 3, and 2 and 3 were 0.898 (P<0.001), 0.896 (P<0.001), and 0.856 (P<0.001), respectively. Without a rubric, the correlation coefficients were 0.838 (P<0.001), 0.888 (P<0.001), and 0.824 (P<0.001), respectively. The new essay test showed a positive correlation (0.367) with the previous MCQ, and the evidence for validity and feasibility was acceptable.
In this study, the rubric did not increase the inter-rater reliability of the essay test. On the other hand, the inter-rater reliability was higher than 0.8, even without a rubric. In addition, the essay test showed evidence of validity and feasibility.
Key words: Essays; Medical school; Emergency medicine; Reliability
PDF Links  PDF Links
Full text via DOI  Full text via DOI
Download Citation  Download Citation
Related article
Editorial Office
The Korean Society of Emergency Medicine
TEL: +82-62-226-1780   FAX: +82-62-224-3501   E-mail: 0012194@csuh.co.kr
About |  Browse Articles |  Current Issue |  For Authors and Reviewers
Copyright © The Korean Society of Emergency Medicine.                 Developed in M2PI