An Empirical Study of the Consistency of Differential Item Functioning Detection

An Empirical Study of the Consistency of Differential Item Functioning Detection PDF Author: Paulette C. Brown
Publisher:
ISBN:
Category : Educational tests and measurements
Languages : en
Pages : 138

Get Book Here

Book Description
The purpose of this study was to investigate how well the Mantel-Haenszel (MH) and logistic regression (LR) procedures perform in the identification of items that function differentially across gender groups and regional groups. Research questions to be answered by this study were concerned with three issues: (1) the detection rates for DIF items and items which did not exhibit DIF, (2) the agreement for the MH and LR methods in the detection of DIF items, and (3) the effectiveness of these indices across sample size and over replications. (Abstract shortened by UMI.).

An Empirical Study of the Consistency of Differential Item Functioning Detection

An Empirical Study of the Consistency of Differential Item Functioning Detection PDF Author: Paulette C. Brown
Publisher:
ISBN:
Category : Educational tests and measurements
Languages : en
Pages : 138

Get Book Here

Book Description
The purpose of this study was to investigate how well the Mantel-Haenszel (MH) and logistic regression (LR) procedures perform in the identification of items that function differentially across gender groups and regional groups. Research questions to be answered by this study were concerned with three issues: (1) the detection rates for DIF items and items which did not exhibit DIF, (2) the agreement for the MH and LR methods in the detection of DIF items, and (3) the effectiveness of these indices across sample size and over replications. (Abstract shortened by UMI.).

An Investigation of the Comparability and Accuracy of Three Differential Item Functioning (dif) Detection Methods Using Empirical and Simulated Data

An Investigation of the Comparability and Accuracy of Three Differential Item Functioning (dif) Detection Methods Using Empirical and Simulated Data PDF Author: Ann Elizabeth Harman
Publisher:
ISBN:
Category : Psychological tests
Languages : en
Pages : 250

Get Book Here

Book Description


Differential Item Functioning

Differential Item Functioning PDF Author: Paul W. Holland
Publisher: Routledge
ISBN: 1136601929
Category : Education
Languages : en
Pages : 449

Get Book Here

Book Description
Test fairness is a moral imperative for both the makers and the users of tests. This book focuses on methods for detecting test items that function differently for different groups of examinees and on using this information to improve tests. Of interest to all testing and measurement specialists, it examines modern techniques used routinely to insure test fairness. Three of these relevant to the book's contents are: * detailed reviews of test items by subject matter experts and members of the major subgroups in society (gender, ethnic, and linguistic) that will be represented in the examinee population * comparisons of the predictive validity of the test done separately for each one of the major subgroups of examinees * extensive statistical analyses of the relative performance of major subgroups of examinees on individual test items.

Differential Item Functioning

Differential Item Functioning PDF Author: Steven J. Osterlind
Publisher: SAGE
ISBN: 1412954940
Category : Mathematics
Languages : en
Pages : 105

Get Book Here

Book Description
Differential Item Functioning, Second Edition is a revision of the 1983 title Test Item Bias. In the past 23 years, differential item performance has assumed a level of attention unimagined in the early 1980s. Then, only a few tests and assessment programs attended to "item bias," while doing so is now a mandatory step in any responsible assessment program. Also, technical advances, such as the widespread use of item response theory, have pushed the field of differential performance to levels of technical sophistication far beyond what was practiced years ago. This new edition presents an up-to-date description of DIF; describes varying procedures for addressing DIF in practical testing contexts; presents useful examples and studies of DIF that readers may employ as a guide in their own DIF work; and briefly describes relevant features of major statistical packages that can be employed in DIF analysis (e.g., SPSS, SAS, M+, Minitab, and Systat). This text is ideal for the measurement professional or advanced student who deals with educational or psychological assessment. Readers need only have a preliminary background in tests and measurement, including some beginning statistics and elementary algebra, in order to find this volume useful.

Differential Item Functioning

Differential Item Functioning PDF Author: Paul W. Holland
Publisher: Psychology Press
ISBN: 0805809724
Category : Education
Languages : en
Pages : 450

Get Book Here

Book Description
First Published in 1993. Routledge is an imprint of Taylor & Francis, an informa company.

Statistical Approaches to Measurement Invariance

Statistical Approaches to Measurement Invariance PDF Author: Roger E. Millsap
Publisher: Routledge
ISBN: 1136761128
Category : Psychology
Languages : en
Pages : 359

Get Book Here

Book Description
This book reviews the statistical procedures used to detect measurement bias. Measurement bias is examined from a general latent variable perspective so as to accommodate different forms of testing in a variety of contexts including cognitive or clinical variables, attitudes, personality dimensions, or emotional states. Measurement models that underlie psychometric practice are described, including their strengths and limitations. Practical strategies and examples for dealing with bias detection are provided throughout. The book begins with an introduction to the general topic, followed by a review of the measurement models used in psychometric theory. Emphasis is placed on latent variable models, with introductions to classical test theory, factor analysis, and item response theory, and the controversies associated with each, being provided. Measurement invariance and bias in the context of multiple populations is defined in chapter 3 followed by chapter 4 that describes the common factor model for continuous measures in multiple populations and its use in the investigation of factorial invariance. Identification problems in confirmatory factor analysis are examined along with estimation and fit evaluation and an example using WAIS-R data. The factor analysis model for discrete measures in multiple populations with an emphasis on the specification, identification, estimation, and fit evaluation issues is addressed in the next chapter. An MMPI item data example is provided. Chapter 6 reviews both dichotomous and polytomous item response scales emphasizing estimation methods and model fit evaluation. The use of models in item response theory in evaluating invariance across multiple populations is then described, including an example that uses data from a large-scale achievement test. Chapter 8 examines item bias evaluation methods that use observed scores to match individuals and provides an example that applies item response theory to data introduced earlier in the book. The book concludes with the implications of measurement bias for the use of tests in prediction in educational or employment settings. A valuable supplement for advanced courses on psychometrics, testing, measurement, assessment, latent variable modeling, and/or quantitative methods taught in departments of psychology and education, researchers faced with considering bias in measurement will also value this book.

An Empirical Comparison of The Effect of Missing Data On Type I Error and Statistical Power of The Likelihood Ratio Test For Differential Item Functioning

An Empirical Comparison of The Effect of Missing Data On Type I Error and Statistical Power of The Likelihood Ratio Test For Differential Item Functioning PDF Author: Patricia Rodriguez De Gil
Publisher:
ISBN:
Category : Education
Languages : en
Pages :

Get Book Here

Book Description
Along with complete data and FIML, the PMS method had an adequate Type I error control under both nominal levels examined. MI and SRS had the smallest proportions of conditions meeting Bradley's criteria for robustness at both levels of significance examined; as a result, when alpha was .01 none of the simulation conditions of these methods met the criteria for robustness and were not included in power analyses at this significance level. Power analyses were entirely consistent across nominal levels, factors and missing data methods. Entirely consistent with theory, sample size and proportion of missing observations were the factors affecting the performance of the IRT-LR test for DIF detection across all missing data methods.

Advancing Human Assessment

Advancing Human Assessment PDF Author: Randy E. Bennett
Publisher: Springer
ISBN: 3319586890
Category : Education
Languages : en
Pages : 717

Get Book Here

Book Description
This book is open access under a CC BY-NC 2.5 license.​​ This book describes the extensive contributions made toward the advancement of human assessment by scientists from one of the world’s leading research institutions, Educational Testing Service. The book’s four major sections detail research and development in measurement and statistics, education policy analysis and evaluation, scientific psychology, and validity. Many of the developments presented have become de-facto standards in educational and psychological measurement, including in item response theory (IRT), linking and equating, differential item functioning (DIF), and educational surveys like the National Assessment of Educational Progress (NAEP), the Programme of international Student Assessment (PISA), the Progress of International Reading Literacy Study (PIRLS) and the Trends in Mathematics and Science Study (TIMSS). In addition to its comprehensive coverage of contributions to the theory and methodology of educational and psychological measurement and statistics, the book gives significant attention to ETS work in cognitive, personality, developmental, and social psychology, and to education policy analysis and program evaluation. The chapter authors are long-standing experts who provide broad coverage and thoughtful insights that build upon decades of experience in research and best practices for measurement, evaluation, scientific psychology, and education policy analysis. Opening with a chapter on the genesis of ETS and closing with a synthesis of the enormously diverse set of contributions made over its 70-year history, the book is a useful resource for all interested in the improvement of human assessment.

Investigations of Differential Item Functioning

Investigations of Differential Item Functioning PDF Author: Insu Paek
Publisher:
ISBN:
Category :
Languages : en
Pages : 434

Get Book Here

Book Description


Differential Item Functioning

Differential Item Functioning PDF Author: Paul W Holland
Publisher: Routledge
ISBN: 9781138967694
Category :
Languages : en
Pages : 470

Get Book Here

Book Description
Test fairness is a moral imperative for both the makers and the users of tests. This book focuses on methods for detecting test items that function differently for different groups of examinees and on using this information to improve tests. Of interest to all testing and measurement specialists, it examines modern techniques used routinely to insure test fairness. Three of these relevant to the book's contents are: * detailed reviews of test items by subject matter experts and members of the major subgroups in society (gender, ethnic, and linguistic) that will be represented in the examinee population * comparisons of the predictive validity of the test done separately for each one of the major subgroups of examinees * extensive statistical analyses of the relative performance of major subgroups of examinees on individual test items.