
As an Amazon Associate and affiliate partner, Menrva Books earns from qualifying purchases. Learn more
Many educational tests use testlets as a way of providing context. When testlet effect and item idiosyncratic features of individual items are both considered to be the reasons of DIF in many educational tests using testlets, it is interesting to investigate the phenomena of DIF amplification and cancellation resulting from the interactive effects of these two factors. This research presented a study based on a multiple-group testlet item response theory model to examine in detail different situations of DIF amplification and cancellation at the item and testlet level using testlet characteristic curve procedures with signed/ unsigned area indices and logistic regression procedure. The testlet DIF model was estimated using a hierarchical Bayesian framework with the Markov Chain Monte Carlo method. The simulation study investigated all of the possible conditions of DIF amplification and cancellation. Real data analysis indicated the existence of testlet effect and its magnitudes of difference on the means and/or variance of testlet distribution between manifest groups such as gender or ethnicity.
This research investigates the complex interplay between testlet effects and individual item characteristics in educational testing, specifically examining how these factors can lead to Differential Item Functioning (DIF) amplification and cancellation. Authored by Han Bao, this study utilizes a multiple-group testlet item response theory model to dissect these phenomena at both the item and testlet levels. The research employs testlet characteristic curve procedures, including signed/unsigned area indices and logistic regression, to analyze DIF. Estimation of the testlet DIF model is conducted through a hierarchical Bayesian framework using the Markov Chain Monte Carlo method, with a simulation study exploring all potential conditions of DIF amplification and cancellation. Real data analysis confirms the presence and magnitude of testlet effects on group differences in testlet distributions.
This work presents a detailed statistical investigation into advanced psychometric modeling for educational testing, focusing on the nuanced effects of testlets. The methodology, employing hierarchical Bayesian frameworks and MCMC, suggests a rigorous and computationally intensive approach suitable for researchers in psychometrics and educational measurement. The real data analysis provides empirical support for the theoretical models, indicating the practical relevance of understanding testlet effects in group comparisons.
Page Count:
176
Publication Date:
2009-06-07
Publisher:
VDM Verlag
ISBN-10:
3639165497
ISBN-13:
9783639165494
No comments yet. Be the first to share your thoughts!