Administering Defining Issues Test Online: Do Response Modes Matter?
Yuejin Xu
Tarleton State University – Central Texas
Asghar Iran-Nejad and Stephen J. Thoma
The University of Alabama
Abstract
The purpose of the study was to determine comparability of an online version to the original paper-pencil version of Defining Issues Test 2 (DIT2). This study employed methods from both Classical Test Theory (CTT) and Item Response Theory (IRT). Findings from CTT analyses supported the reliability and discriminant validity of both versions. Findings from IRT analyses confirmed that that both versions had comparable power of test-of-fit to the Rasch model. However, IRT analyses found that there were some variations in item difficulties and the patterns of item functions between the two versions. The study also tested the prediction that students’ satisfaction of DIT2-taking experience was equal across the two survey response modes, indicating that the online version of DIT2 was comparable to the paper-pencil version in terms of ease of use.
About the Author(s)...
Yuejin Xu is an assistant professor of psychology, Tarleton State University – Central Texas. His research interests include wholetheme education, ethical decision making, and online learning and testing. Dr. Xu may be contacted at This email address is being protected from spambots. You need JavaScript enabled to view it..
Asghar Iran-Nejad is professor of educational psychology, University of Alabama. He is interested in biofunctional cognition, learning, and whole theme education. Dr. Iran-Nejad is a founding member of the Multiple Abilities Program in elementary teacher education, the guest editor of special issues of Educational Psychologist, Journal of Mind and Behavior, and Review of Educational Research, and coeditor, with P. David Pearson, of AERA’s Review of Educational Research. He may be contacted at This email address is being protected from spambots. You need JavaScript enabled to view it..
Stephen J. Thoma is professor and program coordinator in Educational Studies in Psychology, Research Methodology, and Counseling, The University of Alabama. Dr. Thoma is also a member of the Center for the Study of Ethical Development, University of Minnesota. He may be contacted at This email address is being protected from spambots. You need JavaScript enabled to view it..
