Partial Knowledge in Multiple-Choice Testing

نوع مقاله: مقاله پژوهشی

نویسنده

Associate Professor at Shahid Bahonar University of Kerman

چکیده

The intent of this study was to discover the nature of (partial) knowledge as estimated by the multiple-choice (MC) test method. An MC test of vocabulary, including 20 items, was given to 10 participants. Each examinee was required to think aloud while focusing on each item before and while making a response. After each test taker was done with each item, s/he was required to provide answers to retrospective questions. The specific purpose of the questions was to elicit the examinees’ ‘systemic knowledge’ of each item (i.e., how much they knew about each component of the item as well as
their knowledge as to the relationship between the components). Based on the nature of the test takers’ protocols, task analysis, and objective of the study, a coding scheme was developed for analyzing the protocols. Then, the protocols were closely examined to find out the coding categories that contributed to the basic identity of the two polar classes of knowledge (i.e., Absence of Knowledge and Full Knowledge). The same approach was used in the rest of the protocols to find out the possible subcategories of partial knowledge. Similar codes were categorized into natural classes to develop a 
model of knowledge in MC testing which resulted in a model of knowledge comprising five categories.

کلیدواژه‌ها

مراجع

Bachman, L. F. & Palmer, A. S. (1996). Language Testing in Practice: Designing and Developing Useful Language Tests. Oxford: Oxford University Press.

Ben-Simon, A., Budescu, D. V. and Nevo, N. (1997). A comparative study of measures of partial knowledge in multiple-choice tests. Applied Psychological Measurement, 21, 65-88.

Green, A. (1998). Verbal Protocol Analysis in Language Testing Research: A Handbook. Cambridge: Cambridge University Press.

Traub, R. E., Hambleton, R. K., and Singh, B. (1969). Effects of promised reward and threatened penalty on performance of a multiple-choice vocabulary test. Educational and Psychological Measurement, 29, 847-

861.

نشریه پژوهش در نظام های آموزشی

دوره 5، شماره 14
پاییز 1390
صفحه 41-56

فایل ها

  • فایل‌های تکمیلی/اضافی
  • 3.pdf

اشتراک گذاری

ارجاع به این مقاله

آمار