Psychometric Analysis of MCQs Used in Assessing the Students at Entrance to a Medical College

Abstract

Objective:  The study was performed to investigate the reliability and validity of MCQs paper administer-red to the applicants of the first MBBS batch at Rawal Institute of Health Sciences Islamabad.

Study Design:  Analytical study.

Material and Methods:  235 students were adminis-tered a questionnaire consisting of 100 MCQs of sin-gle best type with 5 options at the entrance to Rawal Institute of Health Sciences, Islamabad. The MCQs were generated by the subject specialists, vetted at departmental and central levels and were analyzed in terms of its reliability, validity and difficulty with dis-criminating indices. For reliability in terms of internal consistency Cronbach’s alpha was used and was 0.72. Difficulty and discriminating indices for the MCQs were collected from the computer generated marking sheets.

Result:  The MCQs showed satisfactory levels of reli-ability and validity and majority of the MCQs were within the acceptable level of difficulty index.  A well-structured and strict central vetting process ensures an acceptable standard MCQs.

Conclusion:  MCQ testing, the most efficient form of written assessment is both reliable and valid. Such tes-ting of cognitive knowledge predicts and correlates well with overall competence and performance. MCQ ‘fairness’ is an increasingly important strategic con-cept to improve their validity.

Keywords:  Psychometric characteristics, MCQs, Me-dical students.