Using Three Different Categorical Data Analysis Techniques to Detect Differential Item Functioning

Using Three Different Categorical Data Analysis Techniques to Detect Differential Item Functioning PDF Author: Torie Amelia Stephens-Bonty
Publisher:
ISBN:
Category : Sampling (Statistics)
Languages : en
Pages :

Get Book Here

Book Description
Diversity in the population along with the diversity of testing usage has resulted in smaller identified groups of test takers. In addition, computer adaptive testing sometimes results in a relatively small number of items being used for a particular assessment. The need and use for statistical techniques that are able to effectively detect differential item functioning (DIF) when the population is small and or the assessment is short is necessary. Identification of empirically biased items is a crucial step in creating equitable and construct-valid assessments. Parshall and Miller (1995) compared the conventional asymptotic Mantel-Haenszel (MH) with the exact test (ET) for the detection of DIF with small sample sizes. Several studies have since compared the performance of MH to logistic regression (LR) under a variety of conditions. Both Swaminathan and Rogers (1990), and Hildalgo and Lopez-Pina (2004) demonstrated that MH and LR were comparable in their detection of items with DIF. This study followed by comparing the performance of the MH, the ET, and LR performance when both the sample size is small and test length is short. The purpose of this Monte Carlo simulation study was to expand on the research done by Parshall and Miller (1995) by examining power and power with effect size measures for each of the three DIF detection procedures. The following variables were manipulated in this study: focal group sample size, percent of items with DIF, and magnitude of DIF. For each condition, a small reference group size of 200 was utilized as well as a short, 10-item test. The results demonstrated that in general, LR was slightly more powerful in detecting items with DIF. In most conditions, however, power was well below the acceptable rate of 80%. As the size of the focal group and the magnitude of DIF increased, the three procedures were more likely to reach acceptable power. Also, all three procedures demonstrated the highest power for the most discriminating item. Collectively, the results from this research provide information in the area of small sample size and DIF detection.

Using Three Different Categorical Data Analysis Techniques to Detect Differential Item Functioning

Using Three Different Categorical Data Analysis Techniques to Detect Differential Item Functioning PDF Author: Torie Amelia Stephens-Bonty
Publisher:
ISBN:
Category : Sampling (Statistics)
Languages : en
Pages :

Get Book Here

Book Description
Diversity in the population along with the diversity of testing usage has resulted in smaller identified groups of test takers. In addition, computer adaptive testing sometimes results in a relatively small number of items being used for a particular assessment. The need and use for statistical techniques that are able to effectively detect differential item functioning (DIF) when the population is small and or the assessment is short is necessary. Identification of empirically biased items is a crucial step in creating equitable and construct-valid assessments. Parshall and Miller (1995) compared the conventional asymptotic Mantel-Haenszel (MH) with the exact test (ET) for the detection of DIF with small sample sizes. Several studies have since compared the performance of MH to logistic regression (LR) under a variety of conditions. Both Swaminathan and Rogers (1990), and Hildalgo and Lopez-Pina (2004) demonstrated that MH and LR were comparable in their detection of items with DIF. This study followed by comparing the performance of the MH, the ET, and LR performance when both the sample size is small and test length is short. The purpose of this Monte Carlo simulation study was to expand on the research done by Parshall and Miller (1995) by examining power and power with effect size measures for each of the three DIF detection procedures. The following variables were manipulated in this study: focal group sample size, percent of items with DIF, and magnitude of DIF. For each condition, a small reference group size of 200 was utilized as well as a short, 10-item test. The results demonstrated that in general, LR was slightly more powerful in detecting items with DIF. In most conditions, however, power was well below the acceptable rate of 80%. As the size of the focal group and the magnitude of DIF increased, the three procedures were more likely to reach acceptable power. Also, all three procedures demonstrated the highest power for the most discriminating item. Collectively, the results from this research provide information in the area of small sample size and DIF detection.

Learning Statistics with R

Learning Statistics with R PDF Author: Daniel Navarro
Publisher: Lulu.com
ISBN: 1326189727
Category : Computers
Languages : en
Pages : 617

Get Book Here

Book Description
"Learning Statistics with R" covers the contents of an introductory statistics class, as typically taught to undergraduate psychology students, focusing on the use of the R statistical software and adopting a light, conversational style throughout. The book discusses how to get started in R, and gives an introduction to data manipulation and writing scripts. From a statistical perspective, the book discusses descriptive statistics and graphing first, followed by chapters on probability theory, sampling and estimation, and null hypothesis testing. After introducing the theory, the book covers the analysis of contingency tables, t-tests, ANOVAs and regression. Bayesian statistics are covered at the end of the book. For more information (and the opportunity to check the book out before you buy!) visit http://ua.edu.au/ccs/teaching/lsr or http://learningstatisticswithr.com

A Course in Item Response Theory and Modeling with Stata

A Course in Item Response Theory and Modeling with Stata PDF Author: Tenko Raykov
Publisher:
ISBN: 9781597182669
Category : Item reponse modeling
Languages : en
Pages : 270

Get Book Here

Book Description
Over the past several decades, item response theory (IRT) and item response modeling (IRM) have become increasingly popular in the behavioral, educational, social, business, marketing, clinical, and health sciences. In this book, Raykov and Marcoulides begin with a nontraditional approach to IRT and IRM that is based on their connections to classical test theory, (nonlinear) factor analysis, generalized linear modeling, and logistic regression. Application-oriented discussions follow next. These cover the one-, two-, and three-parameter logistic models, polytomous item response models (with nominal or ordinal items), item and test information functions, instrument construction and development, hybrid models, differential item functioning, and an introduction to multidimensional IRT and IRM. The pertinent analytic and modeling capabilities of Stata are thoroughly discussed, highlighted, and illustrated on empirical examples from behavioral and social research.

Statistical Methods for Categorical Data Analysis

Statistical Methods for Categorical Data Analysis PDF Author: Daniel Powers
Publisher: Emerald Group Publishing
ISBN: 1781906599
Category : Psychology
Languages : en
Pages : 330

Get Book Here

Book Description
This book provides a comprehensive introduction to methods and models for categorical data analysis and their applications in social science research. Companion website also available, at https://webspace.utexas.edu/dpowers/www/

Assessing Quality of Life in Clinical Trials

Assessing Quality of Life in Clinical Trials PDF Author: Peter M. Fayers
Publisher:
ISBN: 9780198527695
Category : Medical
Languages : en
Pages : 490

Get Book Here

Book Description
Researchers in all clinical fields are fully aware of the importance of Quality of Life measurements in judging the efficacy of a given treatment. Psychological criteria play an important role in this evaluation. Assessment of Quality of Life in Clinical Trials: methods and practice explores the current state of the art and illustrates the benefits and potential of health related quality of life assessment in clinical trials. It covers a wide range of analytical issues, emphasizing new and innovative approaches that are of practical and clinical importance.

An Investigation of the Comparability and Accuracy of Three Differential Item Functioning (dif) Detection Methods Using Empirical and Simulated Data

An Investigation of the Comparability and Accuracy of Three Differential Item Functioning (dif) Detection Methods Using Empirical and Simulated Data PDF Author: Ann Elizabeth Harman
Publisher:
ISBN:
Category : Psychological tests
Languages : en
Pages : 250

Get Book Here

Book Description


Handbook of Diagnostic Classification Models

Handbook of Diagnostic Classification Models PDF Author: Matthias von Davier
Publisher: Springer Nature
ISBN: 3030055841
Category : Education
Languages : en
Pages : 656

Get Book Here

Book Description
This handbook provides an overview of major developments around diagnostic classification models (DCMs) with regard to modeling, estimation, model checking, scoring, and applications. It brings together not only the current state of the art, but also the theoretical background and models developed for diagnostic classification. The handbook also offers applications and special topics and practical guidelines how to plan and conduct research studies with the help of DCMs. Commonly used models in educational measurement and psychometrics typically assume a single latent trait or at best a small number of latent variables that are aimed at describing individual differences in observed behavior. While this allows simple rankings of test takers along one or a few dimensions, it does not provide a detailed picture of strengths and weaknesses when assessing complex cognitive skills. DCMs, on the other hand, allow the evaluation of test taker performance relative to a potentially large number of skill domains. Most diagnostic models provide a binary mastery/non-mastery classification for each of the assumed test taker attributes representing these skill domains. Attribute profiles can be used for formative decisions as well as for summative purposes, for example in a multiple cut-off procedure that requires mastery on at least a certain subset of skills. The number of DCMs discussed in the literature and applied to a variety of assessment data has been increasing over the past decades, and their appeal to researchers and practitioners alike continues to grow. These models have been used in English language assessment, international large scale assessments, and for feedback for practice exams in preparation of college admission testing, just to name a few. Nowadays, technology-based assessments provide increasingly rich data on a multitude of skills and allow collection of data with respect to multiple types of behaviors. Diagnostic models can be understood as an ideal match for these types of data collections to provide more in-depth information about test taker skills and behavioral tendencies.

Differential Item Functioning

Differential Item Functioning PDF Author: Paul W. Holland
Publisher: Routledge
ISBN: 1136601910
Category : Education
Languages : en
Pages : 450

Get Book Here

Book Description
Test fairness is a moral imperative for both the makers and the users of tests. This book focuses on methods for detecting test items that function differently for different groups of examinees and on using this information to improve tests. Of interest to all testing and measurement specialists, it examines modern techniques used routinely to insure test fairness. Three of these relevant to the book's contents are: * detailed reviews of test items by subject matter experts and members of the major subgroups in society (gender, ethnic, and linguistic) that will be represented in the examinee population * comparisons of the predictive validity of the test done separately for each one of the major subgroups of examinees * extensive statistical analyses of the relative performance of major subgroups of examinees on individual test items.

Modern Psychometrics with R

Modern Psychometrics with R PDF Author: Patrick Mair
Publisher: Springer
ISBN: 3319931776
Category : Social Science
Languages : en
Pages : 464

Get Book Here

Book Description
This textbook describes the broadening methodology spectrum of psychological measurement in order to meet the statistical needs of a modern psychologist. The way statistics is used, and maybe even perceived, in psychology has drastically changed over the last few years; computationally as well as methodologically. R has taken the field of psychology by storm, to the point that it can now safely be considered the lingua franca for statistical data analysis in psychology. The goal of this book is to give the reader a starting point when analyzing data using a particular method, including advanced versions, and to hopefully motivate him or her to delve deeper into additional literature on the method. Beginning with one of the oldest psychometric model formulations, the true score model, Mair devotes the early chapters to exploring confirmatory factor analysis, modern test theory, and a sequence of multivariate exploratory method. Subsequent chapters present special techniques useful for modern psychological applications including correlation networks, sophisticated parametric clustering techniques, longitudinal measurements on a single participant, and functional magnetic resonance imaging (fMRI) data. In addition to using real-life data sets to demonstrate each method, the book also reports each method in three parts-- first describing when and why to apply it, then how to compute the method in R, and finally how to present, visualize, and interpret the results. Requiring a basic knowledge of statistical methods and R software, but written in a casual tone, this text is ideal for graduate students in psychology. Relevant courses include methods of scaling, latent variable modeling, psychometrics for graduate students in Psychology, and multivariate methods in the social sciences.

Discrete Data Analysis with R

Discrete Data Analysis with R PDF Author: Michael Friendly
Publisher: CRC Press
ISBN: 1498725864
Category : Mathematics
Languages : en
Pages : 700

Get Book Here

Book Description
An Applied Treatment of Modern Graphical Methods for Analyzing Categorical DataDiscrete Data Analysis with R: Visualization and Modeling Techniques for Categorical and Count Data presents an applied treatment of modern methods for the analysis of categorical data, both discrete response data and frequency data. It explains how to use graphical meth