Comparing Chi-square and Log-linear Methods of Detecting Differential Item Performance on a Minimum Competency Test

Comparing Chi-square and Log-linear Methods of Detecting Differential Item Performance on a Minimum Competency Test PDF Author: Martha S. Jones
Publisher:
ISBN:
Category : Chi-square test
Languages : en
Pages : 166

Get Book Here

Book Description

Comparing Chi-square and Log-linear Methods of Detecting Differential Item Performance on a Minimum Competency Test

Comparing Chi-square and Log-linear Methods of Detecting Differential Item Performance on a Minimum Competency Test PDF Author: Martha S. Jones
Publisher:
ISBN:
Category : Chi-square test
Languages : en
Pages : 166

Get Book Here

Book Description


Differential Item Functioning and Adverse Impact

Differential Item Functioning and Adverse Impact PDF Author: Heather JoAn Whiteman
Publisher:
ISBN:
Category :
Languages : en
Pages : 274

Get Book Here

Book Description
This study serves as a comparative analysis of two measures for detecting differential item functioning (DIF) in item responses of 29,171 applicants on a 49 item selection test. The methods compared in this study were two of the more commonly used DIF detection procedures in the testing arena: the Mantel-Haenszel chi-square and the logistic regression procedure. The study focused on the overall effect each method had on adverse impact when used for the removal of items from a test. The study found that the presence of adverse impact findings were decreased by the removal of items displaying DIF, and that the effect on adverse impact differed by method of DIF detection. The study does not however, provide enough evidence to support the use of one DIF detection method over the other in applied settings where considerations such as cost and test reliability are of concern.

American Doctoral Dissertations

American Doctoral Dissertations PDF Author:
Publisher:
ISBN:
Category : Dissertation abstracts
Languages : en
Pages : 728

Get Book Here

Book Description


Differential Item Functioning

Differential Item Functioning PDF Author: Steven J. Osterlind
Publisher: SAGE
ISBN: 1412954940
Category : Mathematics
Languages : en
Pages : 105

Get Book Here

Book Description
Differential Item Functioning, Second Edition is a revision of the 1983 title Test Item Bias. In the past 23 years, differential item performance has assumed a level of attention unimagined in the early 1980s. Then, only a few tests and assessment programs attended to "item bias," while doing so is now a mandatory step in any responsible assessment program. Also, technical advances, such as the widespread use of item response theory, have pushed the field of differential performance to levels of technical sophistication far beyond what was practiced years ago. This new edition presents an up-to-date description of DIF; describes varying procedures for addressing DIF in practical testing contexts; presents useful examples and studies of DIF that readers may employ as a guide in their own DIF work; and briefly describes relevant features of major statistical packages that can be employed in DIF analysis (e.g., SPSS, SAS, M+, Minitab, and Systat). This text is ideal for the measurement professional or advanced student who deals with educational or psychological assessment. Readers need only have a preliminary background in tests and measurement, including some beginning statistics and elementary algebra, in order to find this volume useful.

A Comparison of the Reliability of Item Response Theory and Mantel-Haenszel Chi-square Procedures for Detecting Differential Item Functioning

A Comparison of the Reliability of Item Response Theory and Mantel-Haenszel Chi-square Procedures for Detecting Differential Item Functioning PDF Author: Matthew S. O'Connell
Publisher:
ISBN:
Category : Psychology
Languages : en
Pages : 246

Get Book Here

Book Description


A Comparison of Observed Score Approaches to Detecting Differential Item Functioning Among Multiple Groups

A Comparison of Observed Score Approaches to Detecting Differential Item Functioning Among Multiple Groups PDF Author: Jonathan Darrell Rollins (III)
Publisher:
ISBN:
Category : Educational tests and measurements
Languages : en
Pages : 126

Get Book Here

Book Description
"The overall purpose of this dissertation was to compare various observed score approaches in detecting differential item functioning among multiple examinee groups simultaneously. Specifically, this study contributes to the literature base by investigating a lasso-constraint observed score method (i.e., logistic regression lasso; LR lasso) in the context of multiple groups as well as features of test design related to test information targets. Given that a lasso-constraint method has not been extended for multiple groups using observed scores, comparisons are made with other observed score techniques (i.e., generalized Mantel-Haenszel x2 and generalized logistic regression) while using item response theory to generate data (thus avoiding model-data congruity complications in the study design). Multiple variables were manipulated in a simulation study at the test-level (e.g., the location of the test information target relative to the central tendency of the examinee population, and the shape of the test information function), item-level (e.g., the location of DIF items relative to the test information target, and the percentage of DIF items), and for simulees (e.g., the amount of impact and sample size balance). The relative lack of literature which explores DIF as it relates to target test information functions provided the exigency for exploring it within this study, along with its typical absence in literature using IRT generation models. Practitioners may find the results useful in judging the merit of adopting the newer lasso method for detecting DIF within multiple groups as opposed to pre-existing methods. Furthermore, the test design features of this study allow for the interpretation to be less theoretical in nature and better aligned with standard operational practices, such as building exams to be optimized at test information targets, for example. The results provide consilience that the LR lasso method has inflated type I error overall with no additional benefit in power. In fact, even when type I error rates are comparable across methods, LR lasso has a lower hit rate in many instances (i.e., higher type II error rate). The sensitivity of LR lasso to detecting DIF items seems to be substantially influenced by having an increased number of DIF items on a form. Recommendations for practitioners, as well as limitations and directions for future research, are provided as well. Taken collectively, the results of the simulation study can be interpreted to support the claim that LR lasso fails to perform comparably with more established methods for multiple groups DIF detection across numerous instances but could potentially have merit in practical application in situations that have yet to be explored. While some limitations of LR lasso were noted within this study, there are a variety of other conditions which need to be explored before practitioners discard the method altogether (a few such studies are suggested). It may well be the case that the added complexity afforded by the regularization in estimating the group-specific model parameters through lasso constraints may confound the detection of the DIF items."--Abstract from author supplied metadata. [This abstract has been edited to remove characters that will not display in this system. Please see the PDF for the full abstract.]

Methods of Detecting Differential Item Functioning

Methods of Detecting Differential Item Functioning PDF Author: Ratchaneewan Wanichtanom
Publisher:
ISBN:
Category : Difference (Psychology)
Languages : en
Pages : 362

Get Book Here

Book Description


A Comparison of Three Methods for Detecting Differential Item Functioning

A Comparison of Three Methods for Detecting Differential Item Functioning PDF Author: Pierre Jacques
Publisher:
ISBN:
Category :
Languages : en
Pages : 106

Get Book Here

Book Description


Detection of Differential Item Functioning (DIF) on the SATV

Detection of Differential Item Functioning (DIF) on the SATV PDF Author: T. Gary Greer
Publisher:
ISBN:
Category : Educational tests and measurements
Languages : en
Pages : 318

Get Book Here

Book Description


Comparison of Johnson-Neyman, Mantel-Haenszel and Partial Correlation Procedures for Detecting Differential Item Performance for Moderate Sample Size

Comparison of Johnson-Neyman, Mantel-Haenszel and Partial Correlation Procedures for Detecting Differential Item Performance for Moderate Sample Size PDF Author: Dipti Goswami Majumdar
Publisher:
ISBN:
Category : Examinations
Languages : en
Pages : 264

Get Book Here

Book Description