An Investigation of the Comparability and Accuracy of Three Differential Item Functioning (dif) Detection Methods Using Empirical and Simulated Data PDF Download
Are you looking for read ebook online? Search for your book and save it on your Kindle device, PC, phones or tablets. Download An Investigation of the Comparability and Accuracy of Three Differential Item Functioning (dif) Detection Methods Using Empirical and Simulated Data PDF full book. Access full book title An Investigation of the Comparability and Accuracy of Three Differential Item Functioning (dif) Detection Methods Using Empirical and Simulated Data by Ann Elizabeth Harman. Download full books in PDF and EPUB format.
Author: Ann Elizabeth Harman
Publisher:
ISBN:
Category : Psychological tests
Languages : en
Pages : 250
Get Book Here
Book Description
Author: Ann Elizabeth Harman
Publisher:
ISBN:
Category : Psychological tests
Languages : en
Pages : 250
Get Book Here
Book Description
Author:
Publisher:
ISBN:
Category : Dissertations, Academic
Languages : en
Pages : 602
Get Book Here
Book Description
Author: Xuan Tan
Publisher:
ISBN:
Category :
Languages : en
Pages : 34
Get Book Here
Book Description
The nature of the matching criterion (usually the total score) in the study of differential item functioning (DIF) has been shown to impact the accuracy of different DIF detection procedures. One of the topics related to the nature of the matching criterion is whether the studied item should be included. Although many studies exist that suggest the studied item should always be included in the criterion, the validity of this statement for models other than the Rasch model has not been studied. This study evaluates the effect of including/excluding the studied item in the matching criterion for situations that mimic real testing situations where the assumptions of the Rasch model are violated. A simulation study was conducted where the effect of including/excluding the studied item in the matching criterion was studied relative to different magnitudes of DIF and different group ability distributions, for data that follow the two-parameter logistic (2PL) item response theory (IRT) and multidimensional item response theory (MIRT) models. Results from the study show that including the studied item leads to less biased DIF estimates and more appropriate Type I error rate, especially when the group ability distributions are different. Systematic bias positioning DIF estimation in favor of the high ability group was consistently found across all simulated conditions when the studied item was excluded from the matching criterion. (Contains 22 tables and 1 note.).
Author: Steven J. Osterlind
Publisher: SAGE
ISBN: 1412954940
Category : Mathematics
Languages : en
Pages : 105
Get Book Here
Book Description
Differential Item Functioning, Second Edition is a revision of the 1983 title Test Item Bias. In the past 23 years, differential item performance has assumed a level of attention unimagined in the early 1980s. Then, only a few tests and assessment programs attended to "item bias," while doing so is now a mandatory step in any responsible assessment program. Also, technical advances, such as the widespread use of item response theory, have pushed the field of differential performance to levels of technical sophistication far beyond what was practiced years ago. This new edition presents an up-to-date description of DIF; describes varying procedures for addressing DIF in practical testing contexts; presents useful examples and studies of DIF that readers may employ as a guide in their own DIF work; and briefly describes relevant features of major statistical packages that can be employed in DIF analysis (e.g., SPSS, SAS, M+, Minitab, and Systat). This text is ideal for the measurement professional or advanced student who deals with educational or psychological assessment. Readers need only have a preliminary background in tests and measurement, including some beginning statistics and elementary algebra, in order to find this volume useful.
Author:
Publisher:
ISBN:
Category : Dissertation abstracts
Languages : en
Pages : 800
Get Book Here
Book Description
Author: Paulette C. Brown
Publisher:
ISBN:
Category : Educational tests and measurements
Languages : en
Pages : 0
Get Book Here
Book Description
The purpose of this study was to investigate how well the Mantel-Haenszel (MH) and logistic regression (LR) procedures perform in the identification of items that function differentially across gender groups and regional groups. Research questions to be answered by this study were concerned with three issues: (1) the detection rates for DIF items and items which did not exhibit DIF, (2) the agreement for the MH and LR methods in the detection of DIF items, and (3) the effectiveness of these indices across sample size and over replications. (Abstract shortened by UMI.).
Author: Judith A. Spray
Publisher:
ISBN:
Category : Educational tests and measurements
Languages : en
Pages : 58
Get Book Here
Book Description
Author: Gabriel E. Lopez
Publisher:
ISBN:
Category :
Languages : en
Pages :
Get Book Here
Book Description
The purpose of this investigation was to compare the efficacy of three methods for detecting differential item functioning (DIF). The performance of the crossing simultaneous item bias test (CSIBTEST), the item response theory likelihood ratio test (IRT-LR), and logistic regression (LOGREG) was examined across a range of experimental conditions including different test lengths, sample sizes, DIF and differential test functioning (DTF) magnitudes, and mean differences in the underlying trait distributions of comparison groups, herein referred to as the reference and focal groups. In addition, each procedure was implemented using both an all-other anchor approach, in which the IRT-LR baseline model, CSIBEST matching subtest, and LOGREG trait estimate were based on all test items except for the one under study, and a constant anchor approach, in which the baseline model, matching subtest, and trait estimate were based on a predefined subset of DIF-free items. Response data for the reference and focal groups were generated using known item parameters based on the three-parameter logistic item response theory model (3-PLM). Various types of DIF were simulated by shifting the generating item parameters of select items to achieve desired DIF and DTF magnitudes based on the area between the groups' item response functions. Power, Type I error, and Type III error rates were computed for each experimental condition based on 100 replications and effects analyzed via ANOVA. Results indicated that the procedures varied in efficacy, with LOGREG when implemented using an all-other approach providing the best balance of power and Type I error rate. However, none of the procedures were effective at identifying the type of DIF that was simulated.
Author: Susan Cromwell Duncan
Publisher:
ISBN:
Category :
Languages : en
Pages :
Get Book Here
Book Description
Psychometricians and test developers use DIF analysis to determine if there is possible bias in a given test item. This study examines the conditions under which two predominant methods for determining differential item function compare with each other in item bias detection using an effect size statistic as the basis for comparison. The main focus of the present research was to test whether or not incorporating an effect size for LR DIF will more accurately detect DIF and to compare the utility of an effect size index across MH DIF and LR DIF methods. A simulation study was used to compare the accuracy of MH DIF and LR DIF methods using a p value or supplemented with an effect size. Effect sizes were found to increase the accuracy of DIF and the possibility of the detection of DIF across varying ability distributions, population distributions, and sample size combinations. Varying ability distributions and sample size combinations affected the detection of DIF, while population distributions did not seem to affect the detection of DIF.
Author: Duanli Yan
Publisher: CRC Press
ISBN: 146650580X
Category : Mathematics
Languages : en
Pages : 532
Get Book Here
Book Description
Unlike other forms of adaptive testing, multistage testing (MST) is highly suitable for testing educational achievement because it can be adapted to educational surveys and student testing. This volume provides the first unified source of information on the design, psychometrics, implementation, and operational use of MST. It shows how to apply theoretical statistical tools to testing in novel and useful ways. It also explains how to explicitly tie the assumptions made by each model to observable (or at least inferable) data conditions.
