Roex, Ann
[]
Degryse, Jean-Marie
[UCL]
Advantageous to assessment in many fields, CAT (computerized adaptive testing) use in general practice has been scarce. In adapting CAT to general practice, the basic assumptions of item response theory and the case specificity must be taken into account. In this context, this study first evaluated the feasibility of converting written extended matching tests into CAT. Second, it questioned the content validity of CAT. A stratified sample of students was invited to participate in the pilot study. The items used in this test, together with their parameters, originated from the written test. The detailed test paths of the students were retained and analysed thoroughly. Using the predefined pass-fail standard, one student failed the test. There was a positive correlation between the number of items and the candidate's ability level. The majority of students were presented with questions in seven of the 10 existing domains. Although proved to be a feasible test format, CAT cannot substitute for the existing high-stakes large-scale written test. It may provide a reliable instrument for identifying candidates who are at risk of failing in the written test.
- Case Susan M., Swanson David B., Extended‐matching items: A practical alternative to free‐response questions, 10.1080/10401339309539601
- Kingsbury G. Gage, Zara Anthony R., Procedures for Selecting Items for Computerized Adaptive Tests, 10.1207/s15324818ame0204_6
- Kreiter C D, Ferguson K, Gruppen L D, Evaluating the usefulness of computerized adaptive testing for medical in-course assessment : , 10.1097/00001888-199910000-00016
- Lunz Mary E., Bergstrom Betty A., An Empirical Study of Computerized Adaptive Test Administration Conditions, 10.1111/j.1745-3984.1994.tb00446.x
- Lunz Mary E., Bergstrom Betty A., Wright Benjamin D., The Effect of Review on Student Ability and Test Efficiency for Computerized Adaptive Tests, 10.1177/014662169201600103
- NEWBLE D. I., ENTWISTLE N. J., Learning styles and approaches: implications for medical education, 10.1111/j.1365-2923.1986.tb01163.x
- Van Leeuwen Yvonne D, Pollemans Marjan C, Mol Saskia SL, Eekhof Just AH, The Dutch Knowledge Test for General Practice : Issues of Validity, 10.3109/13814789509160302
- Wainer Howard, Kiely Gerard L., Item Clusters and Computerized Adaptive Testing: A Case for Testlets, 10.1111/j.1745-3984.1987.tb00274.x
- Wainer Howard, Some Practical Considerations When Converting a Linearly Administered Test to an Adaptive Format, 10.1111/j.1745-3992.1993.tb00519.x
Bibliographic reference |
Roex, Ann ; Degryse, Jean-Marie. A computerized adaptive knowledge test as an assessment tool in general practice : a pilot study.. In: Medical teacher, Vol. 26, no. 2, p. 178-83 (2004) |
Permanent URL |
http://hdl.handle.net/2078.1/70090 |