Year : 2001 | Volume
: 8 | Issue : 3 | Page : 79--82
Views of undergraduate students on objective structured clinical examination in neurology: A preliminary report
Hassan M Ismail
King Fahd Hospital of the University, Al-Khobar, Saudi Arabia
Hassan M Ismail
P.O. Box 40152, Al-Khobar 31952
Objective: Obtain the undergraduate medical students«SQ» evaluation of an objective structured clinical examination (OSCE) formed by two stations in neurology.
Methods: The fifth-year medical students taking the neurology course at King Faisal University during the first rotation of academic year 1420-1421H (2000-2001G) made the evaluation. The time for each station was seven minutes. After finishing the examination, each student completed a six-item questionnaire on coverage, question clarity, time, patients, educational usefulness and organization of the examination with yes, no or don«SQ»t know responses.
Results: A total of 48 students (30 males and 18 females) took the examination. The average time to complete the examination for a group of 16 students was 2 hours. The responses were positive for clarity of questions and organization of the examination 41(85%), and allotted time 36(75%). Thirty-two students (67%) found the structured examination a useful educational experience. About half the students expressed their concern about the coverage of taught material and the number of patients seen in the examination as representative of those seen during the course, and 11 students (23%) requested more time.
Conclusions: The students«SQ» response to the use of the structured clinical examination as an objective tool for evaluation of clinical skills in neurology was favorable and comparable to reports from other parts of the world. Improvement is required in the number of patients, coverage and allotted time to optimize outcome by improving content validity and reducing stress on participating patients.
|How to cite this article:|
Ismail HM. Views of undergraduate students on objective structured clinical examination in neurology: A preliminary report.J Fam Community Med 2001;8:79-82
|How to cite this URL:|
Ismail HM. Views of undergraduate students on objective structured clinical examination in neurology: A preliminary report. J Fam Community Med [serial online] 2001 [cited 2019 Nov 18 ];8:79-82
Available from: http://www.jfcmonline.com/text.asp?2001/8/3/79/98067
The Department of Neurology in King Faisal University is the first academic department of neurology in the Kingdom of Saudi Arabia. The department offers a three-week clinical rotation in neurology (course MDNL506) to fifth-year medical students. Since the department was established the rotating students have been evaluated at the end of the course by a conventional long-case clinical examination. The Objective Structured Clinical Examination (OSCE) is presently the predominant method for formative and summative evaluation of clinical skills and competencies in undergraduate medical education. ,,, OSCE has been recently used for evaluation of undergraduate and postgraduate students in various sub-specialty departments including radiology,  dentistry, , rheumatology,  urology,  critical care medicine  and surgery.  Experience with the use of OSCE in neurology has been limited. , The neurology course objectives focus primarily on teaching clinical skills; thus, at the end of the course students are expected to be able to perform a neurological examination competently, and interpret the clinical signs in terms of neuro-anatomical localization of neurological disease. In order to improve objectivity in evaluating our students it was decided to give OSCE a trial for fifth year students rotating during the first semester of academic year 1420-1421H (2000-2001G). This paper presents a preliminary report of the students' views on the trial of OSCE.
The students were divided into two male groups and one female group who rotated in neurology for three-week blocks. The examination was composed of two stations, each with a patient having neurological signs similar to those covered during the course. The time given for each station was seven minutes. Each student answered a questionnaire of six items immediately after finishing the examination. The first question was on the coverage of the examination for the clinical material that was taught during the course. The second question was on the clarity of the examination questions. The third was on the adequacy of the allocated tine for each station. The fourth was on whether the patients seen in the examination were representative of those seen during the course. The fifth was on whether the examination could be viewed as a useful educational clinical experience, and the last question was on whether the organization of the examination was satisfactory. The students had to answer yes, no or don't know.
A total of 48 students took the OSCE, 30 males and 18 female students. The average time taken to complete the OSCE for a group of 16 students was two hours. [Figure 1] shows a bar chart of students' responses for the questionnaire items, including coverage of material taught, clarity of questions, adequacy of time per station, given patients as representative of those seen during the course, usefulness of the examination as an educational clinical experience, and organization of the examination. Forty-one students (85%) were satisfied with the clarity of the questions and organization of the examination. Thirty-six students (75%) were satisfied with the allotted time, but 11 (23%) suggested increasing the time to 10 minutes per station. Thirty-two students (67%) found the examination a useful educational clinical experience. Around half of the students found the coverage of the clinical material taught and the number of patients inadequate.
Evaluation of students in undergraduate medical education is a measurement of student learning and is directed towards assessment of knowledge, and of clinical and communication skills. Data analysis and data interpretation are the two most popular methods for assessing knowledge, whereas OSCE and case presentation are the most used methods for assessing clinical skills.  OSCE was introduced first as a new test for clinical competence. ,,,,, It has been widely accepted as a means of objectively assessing the acquisition of clinical skills and clinical competence with greater reliability and validity ,,,,,,,,,,,,,,,,, and is now considered worldwide as the standard form of examination for the clinical assessment of both under- and post-graduate students. ,,,,,,,,,,,, The students in previous reports felt that OSCE is a fairer system than the other forms of examination and preferred it as a method of clinical assessment. ,
Although the overall response to using OSCE as an objective tool for evaluating neurology students was favorable, the salient shortcomings included the coverage of the examination for the clinical material taught, the number of patients, and to a lesser extent the allotted time per station. Improvement in coverage and increase in the number of patients requires an increase in the number of stations to improve content validity, but will also increase the total time of the examination. Thus, the addition of a third patient and an increase of time to eight minutes per station will increase the examination time to three hours, which is still shorter than the time taken to examine the same number of students using the conventional interactive bedside assessment method. That method requires, on average, four hours for the same number of students. Furthermore, the stress to the participating patients has to be taken into consideration.
Although using a different set of patients may resolve this issue, it will certainly affect that important factor in favor of OSCE regarding objectivity, uniformity and fairness of the student evaluation process. Similar problems were previously noted on using OSCE in neurology. ,
The present preliminary results of using OSCE in neurology were favorable and are comparable to reports from other parts of the world. Improvement, however, in the number of patients, material coverage and allotted time per patient is required to optimize the outcome by improving content validity and reducing stress to participating patients.
|1||Fowell SL, Maudsley G, Maguire P, Leinster SJH, Bligh J. Student assessment in undergraduate medical education in the United Kingdom, 1998. Med Educ 2000;34(Suppl.1):1-49.|
|2||Bradley P, Humphris G. Assessing the ability of medical students to apply evidence in practice: the potential of OSCE. Med Educ 1999;33(11):815-7.|
|3||Duerson MC, Romrell LJ, Stevens CR. Impacting faculty teaching and student performance: nine years' experience with the Objective Structured Clinical Examination. Teach Learn Med 2000; 12(4): 176-82.|
|4||Carraccio C, Englander R. The objective structured clinical examination: a step in the direction of competency-based evaluation. Arch Pediatr Adolesc Med 2000;154(7):736-41.|
|5||Morag E, Lieberman G, Volkan K, Shaffer K, Novelline R, Lang EV. Clinical competence assessment in radiology: introduction of an objective structured clinical examination in the medical school curriculum. Acad Radiol 2001;8(1):74-8.|
|6||Brown G, Manogue M, Martin M. The validity and reliability of OSCE in dentistry. Eur J Dent Educ 1999;3(3):117-25.|
|7||Manogue M, Brown G. Developing and implementing an OSCE in dentistry. Eur J Dent Educ 1998;2(2):51-7.|
|8||Smith MD, Henry-Edwards S, Shanahan EM, Ahern MJ. Evaluation of patient partners in the teaching of the musculoskeletal examination. J Rheumatol 2000;27(6):1533-7.|
|9||Sibert L, Grand'Maison P, Doucet J, Weber J, Grise P. Initial experience of an objective structured clinical examination in evaluating urology residents. Eur Urol 2000;37(5):621-7.|
|10||Rogers PL, Jacob H, Thomas EA, Harwell M, Willenkin RL, Pinsky MR. Medical students can learn the basic application, analytic, evaluative and psychomotor skills of critical care medicine. Crit Care Med 2000;28(2):550-4.|
|11||Merrick HW, Nowacek G, Boyer J, Robertson J. Comparison of the objective structured clinical examination with the performance of the third-year medical students in surgery. Am J Surg 2000;79(4): 286-8.|
|12||Anderson DC, Harris IB, Allen S, Satran L, Bland CJ, Davis-Feickert JA, Poland GA, Miller WJ. Comparing students' feedback about clinical instruction with their performance. Acad Med 1991;66(1): 29-34.|
|13||Gledhill RF, Capatos D. Factors affecting the reliability of an objective structured clinical examination (OSCE) test in neurology. S Afr Med J 1985; 67(12):463-7.|
|14||Harden RM, Gleeson FA. Assessment of clinical competence using an objective structured clinical examination (OSCE). Med Educ 1979;13(1):41-54.|
|15||Cuschieri A, Gleeson FA, Harden RM, Wood RA. A new approach to final examination in surgery. Use of objective structured clinical examination. Ann R Coll Surg Eng 1979;61(5):400-5.|
|16||Watson AR, Houston IB, Close GC. Evaluation of an objective structured clinical examination. Arch Dis Child 1982;57(5):390-2.|
|17||Kirby RL, Curry L. Introduction of an objective structured clinical examination (OSCE) to an undergraduate clinical skills programme. Med Educ 1982; 16(6):362-4.|
|18||Newble DI. Eight years experience with structured clinical examination. Med Teacher 1988;22:200-4.|
|19||Newble DI, Swanson DB. Psychometric characteristics of the objective structured clinical examination. Med Educ 1988;22:325-34.|
|20||Rothman AI, Cohen R. Understanding the objective structured clinical examination (OSCE): issues and options. Ann R Col Phys Surg Can 1995;28:283-7.|
|21||Newble DI, Dauphinee D, Dawson-Saunders B, Macdonald M, Mulloholland H, Page G, et al. Guidelines for the development of effective procedures for the measurement of clinical competence. In: The certification and recertification of doctors: issues on the assessment of clinical competence. Ed. Newble DI, Jolly BJ, Wakeford RE. Cambridge University Press, Cambridge 1993; pp 69-91.|
|22||Smith LJ, Price DA, Houston IB. Objective structured clinical examination compared with other forms of student assessment. Arch Dis Child 1984; 59(12):1173-6.|
|23||Lazarus J, Kent AP. Student attitudes towards the objective structured clinical examination (OSCE) and conventional methods of assessment. S Afr Med J 1983;64(11):390-4.|