Differential Item Functioning and Adverse Impact

Differential Item Functioning and Adverse Impact PDF Author: Heather JoAn Whiteman
Publisher:
ISBN:
Category :
Languages : en
Pages : 274

Get Book Here

Book Description
This study serves as a comparative analysis of two measures for detecting differential item functioning (DIF) in item responses of 29,171 applicants on a 49 item selection test. The methods compared in this study were two of the more commonly used DIF detection procedures in the testing arena: the Mantel-Haenszel chi-square and the logistic regression procedure. The study focused on the overall effect each method had on adverse impact when used for the removal of items from a test. The study found that the presence of adverse impact findings were decreased by the removal of items displaying DIF, and that the effect on adverse impact differed by method of DIF detection. The study does not however, provide enough evidence to support the use of one DIF detection method over the other in applied settings where considerations such as cost and test reliability are of concern.

Differential Item Functioning and Adverse Impact

Differential Item Functioning and Adverse Impact PDF Author: Heather JoAn Whiteman
Publisher:
ISBN:
Category :
Languages : en
Pages : 274

Get Book Here

Book Description
This study serves as a comparative analysis of two measures for detecting differential item functioning (DIF) in item responses of 29,171 applicants on a 49 item selection test. The methods compared in this study were two of the more commonly used DIF detection procedures in the testing arena: the Mantel-Haenszel chi-square and the logistic regression procedure. The study focused on the overall effect each method had on adverse impact when used for the removal of items from a test. The study found that the presence of adverse impact findings were decreased by the removal of items displaying DIF, and that the effect on adverse impact differed by method of DIF detection. The study does not however, provide enough evidence to support the use of one DIF detection method over the other in applied settings where considerations such as cost and test reliability are of concern.

Differential Item Functioning

Differential Item Functioning PDF Author: Paul W. Holland
Publisher: Routledge
ISBN: 1136601910
Category : Education
Languages : en
Pages : 450

Get Book Here

Book Description
Test fairness is a moral imperative for both the makers and the users of tests. This book focuses on methods for detecting test items that function differently for different groups of examinees and on using this information to improve tests. Of interest to all testing and measurement specialists, it examines modern techniques used routinely to insure test fairness. Three of these relevant to the book's contents are: * detailed reviews of test items by subject matter experts and members of the major subgroups in society (gender, ethnic, and linguistic) that will be represented in the examinee population * comparisons of the predictive validity of the test done separately for each one of the major subgroups of examinees * extensive statistical analyses of the relative performance of major subgroups of examinees on individual test items.

Adverse Impact

Adverse Impact PDF Author: James L. Outtz
Publisher: Taylor & Francis
ISBN: 1136948198
Category : Psychology
Languages : en
Pages : 564

Get Book Here

Book Description
This text is the best single repository for a comprehensive examination of the scientific research and practical issues associated with adverse impact. Adverse impact occurs when there is a significant difference in organizational outcomes to the disadvantage of one or more groups defined on the basis of demographic characteristics such as race, ethnicity, gender, age, religion, etc. This book shows, based on scientific research, how to design selection systems that minimize subgroup differences. The primary object of this volume in the SIOP series is to bring together renowned experts in this field to present their viewpoints and perspectives on what underlies adverse impact, where we are in terms of assessing it and what we may have learned (or not learned) about minimizing it.

Differential Item Functioning

Differential Item Functioning PDF Author: Steven J. Osterlind
Publisher: SAGE
ISBN: 1412954940
Category : Mathematics
Languages : en
Pages : 105

Get Book Here

Book Description
Differential Item Functioning, Second Edition is a revision of the 1983 title Test Item Bias. In the past 23 years, differential item performance has assumed a level of attention unimagined in the early 1980s. Then, only a few tests and assessment programs attended to "item bias," while doing so is now a mandatory step in any responsible assessment program. Also, technical advances, such as the widespread use of item response theory, have pushed the field of differential performance to levels of technical sophistication far beyond what was practiced years ago. This new edition presents an up-to-date description of DIF; describes varying procedures for addressing DIF in practical testing contexts; presents useful examples and studies of DIF that readers may employ as a guide in their own DIF work; and briefly describes relevant features of major statistical packages that can be employed in DIF analysis (e.g., SPSS, SAS, M+, Minitab, and Systat). This text is ideal for the measurement professional or advanced student who deals with educational or psychological assessment. Readers need only have a preliminary background in tests and measurement, including some beginning statistics and elementary algebra, in order to find this volume useful.

The Theory and Practice of Item Response Theory, Second Edition

The Theory and Practice of Item Response Theory, Second Edition PDF Author: R. J. de Ayala
Publisher: Guilford Publications
ISBN: 1462547753
Category : Business & Economics
Languages : en
Pages : 674

Get Book Here

Book Description
Introduction to measurement -- The one-parameter model -- Joint maximum likelihood parameter estimation -- Marginal maximum likelihood parameter estimation -- The two-parameter model -- The three-parameter model -- Rasch models for ordered polytomous data -- Non-Rasch models for ordered polytomous data -- Models for nominal polytomous data -- Models for multidimensional data -- Linking and equating -- Differential item functioning -- Multilevel IRT models.

Adverse Impact and Test Validation

Adverse Impact and Test Validation PDF Author: Dan Biddle
Publisher: Routledge
ISBN: 135196061X
Category : Business & Economics
Languages : en
Pages : 153

Get Book Here

Book Description
Adverse impact analyses and test validation promote social justice and equity. Employers who unknowingly use invalid tests or recruitment procedures that have an adverse impact are reducing minority and/or female representation in their workforce, unfairly screening out qualified workers and (worst of all) just plain discriminating. Dan Biddle's Adverse Impact and Test Validation provides you with analyses that allow you to identify which of your selection procedures have adverse impact. The validation steps will help you decide whether to keep the selection procedure (because it's valid), change it, or stop using it altogether. This second edition contains new material on using multiple regression to evaluate pay practices and provides step-by-step instructions for using SPSS or Excel for evaluating your company's pay practices for possible inequities. New content on how to define "Internet applicants" and set up defensible Basic Qualifications (BQs) for online recruiting will help employers ensure compliance with EEO regulations and screen in qualified applicants. Specific guidelines for developing and validating written job knowledge tests, such as those used for police and fire promotional testing, have also been included in this new edition. The downloadable resources include tools (which may be used on a trial evaluation basis) describing several of the functions described in the book, including Adverse Impact Toolkit®, Test Validation and Analysis Program® (TVAP®), Guidelines Oriented Job Analysis® (GOJA®) Manual, and Content Validity Checklists. This highly pragmatic guide goes beyond the concepts, theories and ideas behind adverse impact and test validation. It not only explains what to do but crucially, also shows you how to do it. The second edition has been expanded to include two brand new chapters with a new Appendix and comes with new editions of the accompanying software. As a means of protecting your organization from litigation, damage to employee relations and to your corporate reputation, Adverse Impact and Test Validation is a 'must-have' purchase for human resource professionals, testing and recruitment specialists.

A Course in Item Response Theory and Modeling with Stata

A Course in Item Response Theory and Modeling with Stata PDF Author: Tenko Raykov
Publisher:
ISBN: 9781597182669
Category : Item reponse modeling
Languages : en
Pages : 270

Get Book Here

Book Description
Over the past several decades, item response theory (IRT) and item response modeling (IRM) have become increasingly popular in the behavioral, educational, social, business, marketing, clinical, and health sciences. In this book, Raykov and Marcoulides begin with a nontraditional approach to IRT and IRM that is based on their connections to classical test theory, (nonlinear) factor analysis, generalized linear modeling, and logistic regression. Application-oriented discussions follow next. These cover the one-, two-, and three-parameter logistic models, polytomous item response models (with nominal or ordinal items), item and test information functions, instrument construction and development, hybrid models, differential item functioning, and an introduction to multidimensional IRT and IRM. The pertinent analytic and modeling capabilities of Stata are thoroughly discussed, highlighted, and illustrated on empirical examples from behavioral and social research.

Handbook of Industrial, Work & Organizational Psychology

Handbook of Industrial, Work & Organizational Psychology PDF Author: Neil Anderson
Publisher: SAGE
ISBN: 9780761964889
Category : Business & Economics
Languages : en
Pages : 524

Get Book Here

Book Description
This volume mainly focuses on theories, techniques and methods used by industrial and work psychologists. Internationally renowned authors summarize advances in core topics.

Advancing Human Assessment

Advancing Human Assessment PDF Author: Randy E. Bennett
Publisher: Springer
ISBN: 3319586890
Category : Education
Languages : en
Pages : 717

Get Book Here

Book Description
This book is open access under a CC BY-NC 2.5 license.​​ This book describes the extensive contributions made toward the advancement of human assessment by scientists from one of the world’s leading research institutions, Educational Testing Service. The book’s four major sections detail research and development in measurement and statistics, education policy analysis and evaluation, scientific psychology, and validity. Many of the developments presented have become de-facto standards in educational and psychological measurement, including in item response theory (IRT), linking and equating, differential item functioning (DIF), and educational surveys like the National Assessment of Educational Progress (NAEP), the Programme of international Student Assessment (PISA), the Progress of International Reading Literacy Study (PIRLS) and the Trends in Mathematics and Science Study (TIMSS). In addition to its comprehensive coverage of contributions to the theory and methodology of educational and psychological measurement and statistics, the book gives significant attention to ETS work in cognitive, personality, developmental, and social psychology, and to education policy analysis and program evaluation. The chapter authors are long-standing experts who provide broad coverage and thoughtful insights that build upon decades of experience in research and best practices for measurement, evaluation, scientific psychology, and education policy analysis. Opening with a chapter on the genesis of ETS and closing with a synthesis of the enormously diverse set of contributions made over its 70-year history, the book is a useful resource for all interested in the improvement of human assessment.

Methods for Identifying Biased Test Items

Methods for Identifying Biased Test Items PDF Author: Gregory Camilli
Publisher: SAGE
ISBN: 9780803944169
Category : Business & Economics
Languages : en
Pages : 196

Get Book Here

Book Description
In this book, the authors provide a cogent review of statistical and interpretive procedures that, in combination, can be used to reduce the likelihood that tests contain items that favor members of one gender, age, racial, or ethnic group over equally able members of another group, for reasons that are unrelated to the objectives and purposes of measurement. Such test items are said to be biased against the equally able members of the group that is not favored. The methods described and illustrated in this book have the potential to reducing the incidence of tests that are, in their construction, biased against members of one or more groups. These methods have the potential of controlling an important source of invalidity when test results are interpreted.