Computerized Adaptive and Multistage Testing with R

Computerized Adaptive and Multistage Testing with R PDF Author: David Magis
Publisher: Springer
ISBN: 3319692186
Category : Mathematics
Languages : en
Pages : 183

Get Book Here

Book Description
The goal of this guide and manual is to provide a practical and brief overview of the theory on computerized adaptive testing (CAT) and multistage testing (MST) and to illustrate the methodologies and applications using R open source language and several data examples. Implementation relies on the R packages catR and mstR that have been already or are being developed by the first author (with the team) and that include some of the newest research algorithms on the topic. The book covers many topics along with the R-code: the basics of R, theoretical overview of CAT and MST, CAT designs, CAT assembly methodologies, CAT simulations, catR package, CAT applications, MST designs, IRT-based MST methodologies, tree-based MST methodologies, mstR package, and MST applications. CAT has been used in many large-scale assessments over recent decades, and MST has become very popular in recent years. R open source language also has become one of the most useful tools for applications in almost all fields, including business and education. Though very useful and popular, R is a difficult language to learn, with a steep learning curve. Given the obvious need for but with the complex implementation of CAT and MST, it is very difficult for users to simulate or implement CAT and MST. Until this manual, there has been no book for users to design and use CAT and MST easily and without expense; i.e., by using the free R software. All examples and illustrations are generated using predefined scripts in R language, available for free download from the book's website.

Computerized Adaptive and Multistage Testing with R

Computerized Adaptive and Multistage Testing with R PDF Author: David Magis
Publisher: Springer
ISBN: 3319692186
Category : Mathematics
Languages : en
Pages : 183

Get Book Here

Book Description
The goal of this guide and manual is to provide a practical and brief overview of the theory on computerized adaptive testing (CAT) and multistage testing (MST) and to illustrate the methodologies and applications using R open source language and several data examples. Implementation relies on the R packages catR and mstR that have been already or are being developed by the first author (with the team) and that include some of the newest research algorithms on the topic. The book covers many topics along with the R-code: the basics of R, theoretical overview of CAT and MST, CAT designs, CAT assembly methodologies, CAT simulations, catR package, CAT applications, MST designs, IRT-based MST methodologies, tree-based MST methodologies, mstR package, and MST applications. CAT has been used in many large-scale assessments over recent decades, and MST has become very popular in recent years. R open source language also has become one of the most useful tools for applications in almost all fields, including business and education. Though very useful and popular, R is a difficult language to learn, with a steep learning curve. Given the obvious need for but with the complex implementation of CAT and MST, it is very difficult for users to simulate or implement CAT and MST. Until this manual, there has been no book for users to design and use CAT and MST easily and without expense; i.e., by using the free R software. All examples and illustrations are generated using predefined scripts in R language, available for free download from the book's website.

Computerized Multistage Testing

Computerized Multistage Testing PDF Author: Duanli Yan
Publisher: CRC Press
ISBN: 146650580X
Category : Mathematics
Languages : en
Pages : 532

Get Book Here

Book Description
Unlike other forms of adaptive testing, multistage testing (MST) is highly suitable for testing educational achievement because it can be adapted to educational surveys and student testing. This volume provides the first unified source of information on the design, psychometrics, implementation, and operational use of MST. It shows how to apply theoretical statistical tools to testing in novel and useful ways. It also explains how to explicitly tie the assumptions made by each model to observable (or at least inferable) data conditions.

Elements of Adaptive Testing

Elements of Adaptive Testing PDF Author: Wim J. van der Linden
Publisher: Springer Science & Business Media
ISBN: 0387854614
Category : Social Science
Languages : en
Pages : 433

Get Book Here

Book Description
The arrival of the computer in educational and psychological testing has led to the current popularity of adaptive testing---a testing format in which the computer uses statistical information about the test items to automatically adapt their selection to a real-time update of the test taker’s ability estimate. This book covers such key features of adaptive testing as item selection and ability estimation, adaptive testing with multidimensional abilities, sequencing adaptive test batteries, multistage adaptive testing, item-pool design and maintenance, estimation of item and item-family parameters, item and person fit, as well as adaptive mastery and classification testing. It also shows how these features are used in the daily operations of several large-scale adaptive testing programs.

Computerized Adaptive Testing: Theory and Practice

Computerized Adaptive Testing: Theory and Practice PDF Author: Wim J. van der Linden
Publisher: Springer
ISBN: 9789048155118
Category : Education
Languages : en
Pages : 0

Get Book Here

Book Description
This book offers a comprehensive introduction to the latest developments in the theory and practice of CAT. It can be used both as a basic reference and a valuable resource on test theory. It covers such topics as item selection and ability estimation, item pool development and maintenance, item calibration and model fit, and testlet-based adaptive testing, as well as the operational aspects of existing large-scale CAT programs.

Application of Artificial Intelligence to Assessment

Application of Artificial Intelligence to Assessment PDF Author: Hong Jiao
Publisher: IAP
ISBN: 1641139536
Category : Computers
Languages : en
Pages : 218

Get Book Here

Book Description
The general theme of this book is to present the applications of artificial intelligence (AI) in test development. In particular, this book includes research and successful examples of using AI technology in automated item generation, automated test assembly, automated scoring, and computerized adaptive testing. By utilizing artificial intelligence, the efficiency of item development, test form construction, test delivery, and scoring could be dramatically increased. Chapters on automated item generation offer different perspectives related to generating a large number of items with controlled psychometric properties including the latest development of using machine learning methods. Automated scoring is illustrated for different types of assessments such as speaking and writing from both methodological aspects and practical considerations. Further, automated test assembly is elaborated for the conventional linear tests from both classical test theory and item response theory perspectives. Item pool design and assembly for the linear-on-the-fly tests elaborates more complications in practice when test security is a big concern. Finally, several chapters focus on computerized adaptive testing (CAT) at either item or module levels. CAT is further illustrated as an effective approach to increasing test-takers’ engagement in testing. In summary, the book includes both theoretical, methodological, and applied research and practices that serve as the foundation for future development. These chapters provide illustrations of efforts to automate the process of test development. While some of these automation processes have become common practices such as automated test assembly, automated scoring, and computerized adaptive testing, some others such as automated item generation calls for more research and exploration. When new AI methods are emerging and evolving, it is expected that researchers can expand and improve the methods for automating different steps in test development to enhance the automation features and practitioners can adopt quality automation procedures to improve assessment practices.

Multidimensional Item Response Theory

Multidimensional Item Response Theory PDF Author: M.D. Reckase
Publisher: Springer Science & Business Media
ISBN: 0387899766
Category : Social Science
Languages : en
Pages : 355

Get Book Here

Book Description
First thorough treatment of multidimensional item response theory Description of methods is supported by numerous practical examples Describes procedures for multidimensional computerized adaptive testing

Practical Considerations in Computer-Based Testing

Practical Considerations in Computer-Based Testing PDF Author: Cynthia G. Parshall
Publisher: Springer Science & Business Media
ISBN: 1461300835
Category : Social Science
Languages : en
Pages : 233

Get Book Here

Book Description
This book introduces computer-based testing, addressing both nontechnical and technical considerations. The material is oriented toward practitioners and graduate students. The practical emphasis will be useful to measurement professionals who are or will be responsible for implementing a computerized testing program. The instructional information is also designed to be suitable for a one-semester graduate course in computerized testing in an educational measurement or quantitative methods program. While certain theoretical concepts are addressed, the focus of the book is on the applied nature of computerized testing. For this reason, the materials include such features as example applications, figures, and plots to illustrate critical points in the discussions. A wide range ofnontechnical issues need to be considered in implementing a computer-based testing program. Separate chapters are provided on test administration and development issues, examinee issues, software issues, and innovative item types. Test administration and delivery issues include the location of exam administration, selection of hardware and software, security considerations, scheduling of administration frequency and time limits, cost implications, and program support as well as approaches for addressing reliability, validity, comparability, and data analysis. Examinee issues include the influence ofexaminees' reactions to adaptive testing, the effect ofcomputer based task constraints, and the impact of examinees' prior computer experience. Software issues include usability studies and software evaluation as tools in selecting and developing appropriate software, based on the test program needs.

Research for Practical Issues and Solutions in Computerized Multistage Testing

Research for Practical Issues and Solutions in Computerized Multistage Testing PDF Author: Duanli Yan
Publisher: Taylor & Francis
ISBN: 0429554060
Category : Education
Languages : en
Pages : 517

Get Book Here

Book Description
This volume presents a comprehensive collection of the latest research findings supporting the current and future implementations and applications of computerized multistage testing (MST). As a sequel to the widely acclaimed Computerized Multistage Testing: Theory and Applications (2014) by Yan, von Davier, and Lewis, this volume delves into the experiences, considerations, challenges, and lessons learned over the past years. It also offers practical approaches and solutions to the issues encountered. The topics covered include purposeful MST designs, practical approaches for optimal design, assembly strategies for accuracy and efficiency, hybrid designs, MST with natural language processing, practical routing considerations and methodologies, item calibration and proficiency estimation methods, routing and classification accuracy, added value of process data, prediction and evaluation of MST performance, cognitive diagnostic MST, differential item functioning, robustness of statistical methods, simulations, test security, the new digital large-scale Scholastic Aptitude Test, software for practical assessment and simulations, artificial intelligence impact, and the future of adaptive MST. This volume is intended for students, faculty, researchers, practitioners, and education officers in the fields of educational measurement and evaluation in the United States and internationally.

Computerized Adaptive Testing

Computerized Adaptive Testing PDF Author: David J. Weiss
Publisher: Guilford Publications
ISBN: 1462554512
Category : Business & Economics
Languages : en
Pages : 387

Get Book Here

Book Description
"CAT is the use of artificial intelligence and machine learning to create a test unique to each person in real time. CAT: From Concept to Implementation is designed to take you from your initial decision to implement a CAT through each step in the process of fielding a CAT that will provide its benefits both to your examinees and to your organization. It describes how CATs are developed, and how they are implemented using current advanced psychometric methods"--

Advancing Natural Language Processing in Educational Assessment

Advancing Natural Language Processing in Educational Assessment PDF Author: Victoria Yaneva
Publisher: Taylor & Francis
ISBN: 1000904199
Category : Education
Languages : en
Pages : 339

Get Book Here

Book Description
Advancing Natural Language Processing in Educational Assessment examines the use of natural language technology in educational testing, measurement, and assessment. Recent developments in natural language processing (NLP) have enabled large-scale educational applications, though scholars and professionals may lack a shared understanding of the strengths and limitations of NLP in assessment as well as the challenges that testing organizations face in implementation. This first-of-its-kind book provides evidence-based practices for the use of NLP-based approaches to automated text and speech scoring, language proficiency assessment, technology-assisted item generation, gamification, learner feedback, and beyond. Spanning historical context, validity and fairness issues, emerging technologies, and implications for feedback and personalization, these chapters represent the most robust treatment yet about NLP for education measurement researchers, psychometricians, testing professionals, and policymakers. The Open Access version of this book, available at www.taylorfrancis.com, has been made available under a Creative Commons Attribution-NonCommercial-No Derivatives 4.0 license.