Predicting item exposure parameters in computerized adaptive testing

Shu-Ying Chen,

Shu-Ying Chen

Department of Psychology, National Chung-Cheng University, Taiwan

Search for more papers by this author

Shing-Hwang Doong,

Corresponding Author

Shing-Hwang Doong

Department of Information Management, Shu-Te University, Taiwan

Correspondence should be addressed to Professor Shing-Hwang Doong, Department of Information Management, Shu-Te University, Taiwan (e-mail: [email protected]).Search for more papers by this author

Shu-Ying Chen,

Shu-Ying Chen

Department of Psychology, National Chung-Cheng University, Taiwan

Search for more papers by this author

Shing-Hwang Doong,

Corresponding Author

Shing-Hwang Doong

Department of Information Management, Shu-Te University, Taiwan

Correspondence should be addressed to Professor Shing-Hwang Doong, Department of Information Management, Shu-Te University, Taiwan (e-mail: [email protected]).Search for more papers by this author

First published: 24 December 2010

https://doi.org/10.1348/000711006X129553

Citations: 2

Share a link

Email
Facebook
x
LinkedIn
Reddit
Wechat

Abstract

The purpose of this study is to find a formula that describes the relationship between item exposure parameters and item parameters in computerized adaptive tests by using genetic programming (GP) – a biologically inspired artificial intelligence technique. Based on the formula, item exposure parameters for new parallel item pools can be predicted without conducting additional iterative simulations. Results show that an interesting formula between item exposure parameters and item parameters in a pool can be found by using GP. The item exposure parameters predicted based on the found formula were close to those observed from the Sympson and Hetter (1985) procedure and performed well in controlling item exposure rates. Similar results were observed for the Stocking and Lewis (1998) multinomial model for item selection and the Sympson and Hetter procedure with content balancing. The proposed GP approach has provided a knowledge-based solution for finding item exposure parameters.

References

Duffy, J., Engle-Warnick, J. Using symbolic regression to infer strategies from experimental data Chestnut Hill, MA: Society for computational Economics, Computing in Economics and Finance 1999.
Google Scholar
Goldberg, D. Genetic algorithms in search, optimization and machine learning Boston, MA: Addison-Wesley 1989.
Google Scholar
Hetter, R. D., Sympson, J. B. Item exposure control in CAT-ASVAB W. A. Sands, B. K. Waters, J. R. McBride Computerized adaptive testing: From inquiry to operation 141–144 Washington, DC: American Psychological Association 1997.
10.1037/10244-014
Google Scholar
Holland, J. Adaptation in natural and artificial systems Ann Arbor, MI: University of Michigan Press 1975.
Google Scholar
Kingsbury, G. G., Zara, A. R. Procedures for selecting items for computerized adaptive tests Applied Measurement in Education 2 359–375 1989.
10.1207/s15324818ame0204_6
Google Scholar
Koza, J. A genetic approach to econometric modeling Barcelona, Spain: Sixth World Congress of the Econometric Society 1990.
Google Scholar
Koza, J. Genetic programming: On the programming of computers by means of natural selection Cambridge, MA: MIT Press 1992.
Google Scholar
Koza, J., Bennett, F., Andre, D., Keane, M. (1999, April). Genetic programming: Biologically inspired computation that creatively solves non-trivial problems. Proceedings of the AISB 1999 Symposium on AI and Scientific Creativity, Edinburgh, UK.
Google Scholar
McBride, J. R., Martin, J. T. Reliability and validity of adaptive ability tests in a military setting D. J. Weiss New horizons in testing 223–236 New York, NY: Academic Press 1983.
10.1016/B978-0-12-742780-5.50022-6
Web of Science®Google Scholar
Rudolph, G. Convergence analysis of canonical genetic algorithms IEEE Transactions on Neural Networks 5 96–101 1994.
10.1109/72.265964
CASPubMedWeb of Science®Google Scholar
Segall, D. O., Moreno, K. E. Development of the CAT-ASVAB F. Drasgow, J. B. Olson-Buchanan Innovations in computerized assessment 35–65 Hillsdale, NJ: Lawrence Erlbaum Associates 1999.
Google Scholar
Stocking, M. L. Controlling item exposure rates in a realistic adaptive testing program (Research Report 93-2) Princeton, NJ: Educational Testing Service 1993.
Google Scholar
Stocking, M. L. Three practical issues for modern adaptive testing item pools (Research Report 94-5) Princeton, NJ: Educational Testing Service 1994.
Google Scholar
Stocking, M. L., Lewis, C. Controlling item exposure conditional on ability in computerized adaptive testing Journal of Educational and Behavior Statistics 23 57–75 1998.
10.3102/10769986023001057
Web of Science®Google Scholar
Stocking, M. L., Lewis, C. Methods of controlling the exposure of items in CAT W. J. Linden, A. W. Glas Computerized adaptive testing: Theory and practice 163–182 Dordrecht, The Netherlands: Kluwer Academic Publishers 2000.
10.1007/0-306-47531-6_9
Google Scholar
Sympson, J. B., Hetter, R. D. (1985, October). Controlling item-exposure rates in computerized adaptive testing. Proceedings of the 27th Annual Meeting of the Military Testing Association (pp. 973–977). San Diego, CA: Navy Personnel Research and Development Center.
Google Scholar
Wainer, H., Eignor, D. Caveats, pitfalls, and unexpected consequences of implementing large-scale computerized testing H. Wainer Computerized adaptive testing: A primer 2nd 271–298 Mahwah, NJ: Lawrence Erlbaum Associates 2000.
Google Scholar
Way, W. D. Protecting the integrity of computerized testing item pools Educational Measurement: Issues and Practice 17 17–27 1998.
10.1111/j.1745-3992.1998.tb00632.x
Google Scholar

Citing Literature

Volume61, Issue1

May 2008

Pages 75-91

Predicting item exposure parameters in computerized adaptive testing

Abstract

References

Citing Literature

References

Information

About Wiley Online Library

Help & Support

Opportunities

Connect with Wiley

Predicting item exposure parameters in computerized adaptive testing

Abstract

References

Citing Literature

References

Related

Information