Technical Issues in Large-scale Performance Assessment

Technical Issues in Large-scale Performance Assessment PDF Author: Gary W. Phillips
Publisher:
ISBN:
Category : Educational evaluation
Languages : en
Pages : 156

Get Book Here

Book Description

Technical Issues in Large-scale Performance Assessment

Technical Issues in Large-scale Performance Assessment PDF Author: Gary W. Phillips
Publisher:
ISBN:
Category : Educational evaluation
Languages : en
Pages : 156

Get Book Here

Book Description


Handbook of International Large-Scale Assessment

Handbook of International Large-Scale Assessment PDF Author: Leslie Rutkowski
Publisher: CRC Press
ISBN: 1439895120
Category : Mathematics
Languages : en
Pages : 650

Get Book Here

Book Description
Technological and statistical advances, along with a strong interest in gathering more information about the state of our educational systems, have made it possible to assess more students, in more countries, more often, and in more subject domains. The Handbook of International Large-Scale Assessment: Background, Technical Issues, and Methods of Data Analysis brings together recognized scholars in the field of ILSA, behavioral statistics, and policy to develop a detailed guide that goes beyond database user manuals. After highlighting the importance of ILSA data to policy and research, the book reviews methodological aspects and features of the studies based on operational considerations, analytics, and reporting. The book then describes methods of interest to advanced graduate students, researchers, and policy analysts who have a good grounding in quantitative methods, but who are not necessarily quantitative methodologists. In addition, it provides a detailed exposition of the technical details behind these assessments, including the test design, the sampling framework, and estimation methods, with a focus on how these issues impact analysis choices.

Performance Assessments for Adult Education

Performance Assessments for Adult Education PDF Author: National Research Council
Publisher: National Academies Press
ISBN: 0309084539
Category : Education
Languages : en
Pages : 132

Get Book Here

Book Description
In the United States, the nomenclature of adult education includes adult literacy, adult secondary education, and English for speakers of other languages (ESOL) services provided to undereducated and limited English proficient adults. Those receiving adult education services have diverse reasons for seeking additional education. With the passage of the WIA, the assessment of adult education students became mandatory-regardless of their reasons for seeking services. The law does allow the states and local programs flexibility in selecting the most appropriate assessment for the student. The purpose of the NRC's workshop was to explore issues related to efforts to measure learning gains in adult basic education programs, with a focus on performance-based assessments.

Test Fairness in the New Generation of Large?Scale Assessment

Test Fairness in the New Generation of Large?Scale Assessment PDF Author: Hong Jiao
Publisher: IAP
ISBN: 1681238950
Category : Education
Languages : en
Pages : 248

Get Book Here

Book Description
The new generation of tests is faced with new challenges. In the K?12 setting, the new learning targets are intended to assess higher?order thinking skills and prepare students to be ready for college and career and to keep American students competitive with their international peers. In addition, the new generation of state tests requires the use of technology in item delivery and embedding assessment in real?world, authentic, situations. It further requires accurate assessment of students at all ability levels. One of the most important questions is how to maintain test fairness in the new assessments with technology innovative items and technology delivered tests. In the traditional testing programs such as licensure and certification tests and college admission tests, test fairness has constantly been a key psychometric issue in test development and this continues to be the case with the national testing programs. As test fairness needs to be addressed throughout the whole process of test development, experts from state, admission, and licensure tests will address test fairness challenges in the new generation assessment. The book chapters clarify misconceptions of test fairness including the use of admission test results in cohort comparison, the use of international assessment results in trend evaluation, whether standardization and fairness necessarily mean uniformity when test?takers have different cultural backgrounds, and whether standardization can insure fairness. More technically, chapters also address issues related to how compromised items and test fairness are related to classification decisions, how accessibility in item development and accommodation could be mingled with technology, how to assess special populations with dyslexia, using Blinder?Oaxaca Decomposition for differential item functioning detection, and differential feature functioning in automated scoring. Overall, this book addresses test fairness issues in state assessment, college admission testing, international assessment, and licensure tests. Fairness is discussed in the context of culture and special populations. Further, fairness related to performance assessment and automated scoring is a focus as well. This book provides a very good source of information related to test fairness issues in test development in the new generation of assessment where technology is highly involved.

Quality Performance Assessment

Quality Performance Assessment PDF Author: Christina Brown
Publisher:
ISBN: 9780988311602
Category : Education
Languages : en
Pages :

Get Book Here

Book Description
Created at the Center for Collaborative Education, this is a practical guide for implementing performance assessments in schools and school districts. It includes extensive tools and assessments aligned with the Common Core. The guide is spiral bound for use by teachers and teams of educators. It offers full discussion of issues pertaining to performance assessment.

Reliability and Validity of International Large-Scale Assessment

Reliability and Validity of International Large-Scale Assessment PDF Author: Hans Wagemaker
Publisher: Springer Nature
ISBN: 3030530817
Category : Education
Languages : en
Pages : 279

Get Book Here

Book Description
This open access book describes and reviews the development of the quality control mechanisms and methodologies associated with IEA’s extensive program of educational research. A group of renowned international researchers, directly involved in the design and execution of IEA’s international large-scale assessments (ILSAs), describe the operational and quality control procedures that are employed to address the challenges associated with providing high-quality, comparable data. Throughout the now considerable history of IEA’s international large-scale assessments, establishing the quality of the data has been paramount. Research in the complex multinational context in which IEA studies operate imposes significant burdens and challenges in terms of the methodologies and technologies that have been developed to achieve the stated study goals. The demands of the twin imperatives of validity and reliability must be satisfied in the context of multiple and diverse cultures, languages, orthographies, educational structures, educational histories, and traditions. Readers will learn about IEA’s approach to such challenges, and the methods used to ensure that the quality of the data provided to policymakers and researchers can be trusted. An often neglected area of investigation, namely the consequential validity of ILSAs, is also explored, examining issues related to reporting, dissemination, and impact, including discussion of the limits of interpretation. The final chapters address the question of the influence of ILSAs on policy and reform in education, including a case study from Singapore, a country known for its outstanding levels of achievement, but which nevertheless seeks the means of continual improvement, illustrating best practice use of ILSA data.

Beyond the Bubble Test

Beyond the Bubble Test PDF Author: Linda Darling-Hammond
Publisher: John Wiley & Sons
ISBN: 1118456181
Category : Education
Languages : en
Pages : 464

Get Book Here

Book Description
Performance assessment is a hot topic in school systems, and educators continue to analyze its costs, benefits, and feasibility as a replacement for high-stakes testing. Until now, researchers and policymakers have had to dig to find out what we know and what we still have to learn about performance assessment. Beyond the Bubble Test: How Performance Assessments Support 21st Century Learning synthesizes the latest findings in the field, and not a moment too soon. Statistics indicate that the United States is in danger of falling behind if it fails to adapt to our changing world. The memory and recall strategies of traditional testing are no longer adequate to equip our students with the skills they need to excel in the global economy. Instead teachers need to engage students in deeper learning, assessing their ability to use higher-order skills. Skills like synthesizing information, understanding evidence, and critical problem-solving are not achieved when we teach to multiple-choice exams. Examples in Beyond the Bubble Test paint a useful picture of how schools can begin to supplement traditional tests with something that works better. This book provides new perspectives on current performance assessment research, plus an incisive look at what’s possible at the local and state levels. Linda Darling-Hammond, with a team of leading scholars, bring together lessons learned, new directions, and solid recommendations into a single, readily accessible compendium. Beyond the Bubble Test situates the current debate on performance assessment within the context of testing in the United States. This comprehensive resource also looks beyond our U.S. borders to Singapore, Hong Kong, and other places whose reform-mindedness can serve as an example to us.

Measurement in Sport and Exercise Psychology

Measurement in Sport and Exercise Psychology PDF Author: Gershon Tenenbaum
Publisher: Human Kinetics
ISBN: 1492582697
Category : Sports & Recreation
Languages : en
Pages : 724

Get Book Here

Book Description
Measurement in Sport and Exercise Psychology provides a complete analysis of the tools and methods used in sport and exercise psychology research. Each chapter of this accessible text presents key measurement variables and concepts, including their definitions; an evaluation of the measurement constructs and tools available; and an explanation of any controversies in each topic. The text includes access to an online resource that presents 14 measurement instruments in their entirety. This resource also contains additional web links to many other measurement instruments. Drawing on their experience as leading researchers in the field, editors Tenenbaum, Eklund, and Kamata have selected a team of recognized scholars to bring both breadth and depth to this essential resource. By thoroughly examining each measurement tool, Measurement in Sport and Exercise Psychology assists readers in determining strengths and limitations of each tool and discovering which tools are best suited to their research projects. Readers will also gain critical knowledge to expand the field by recognizing opportunities for new methods of measurement and evaluation. The text begins with a historical review of measurement in sport and exercise psychology followed by a comprehensive description of theories and measurement issues. It provides detailed information regarding ethical and cultural issues inherent in the selection of specific testing protocols as well as issues in interpreting meta-analysis. This is followed by discussion of the commonly used constructs and inventories in three areas: cognition, perception, and motivation measurement; emotion (affect) and coping measurement; and social and behavioral measurement. Recommendations for researchers and practitioners included at the end of each chapter provide starting points for considering ways to incorporate chapter content into research projects and professional practice. Tables located at the end of each chapter summarize key information for quick reference and provide online sources, when available, so that readers can access each measurement tool. Original source information is provided for those tools not available online. Measurement in Sport and Exercise Psychology assists readers in evaluating the effectiveness of specific measurement tools. As the most complete and up-to-date directory of tools and inventories in the field of sport and exercise, this text offers a thorough explanation of considerations, controversies, recommendations, and locations for accessing these measurement tools.

Automated Scoring of Complex Tasks in Computer-based Testing

Automated Scoring of Complex Tasks in Computer-based Testing PDF Author: David M. Williamson
Publisher: Psychology Press
ISBN: 0805846344
Category : Education
Languages : en
Pages : 437

Get Book Here

Book Description
This is the first volume to provide the latest methods and examples of "best practices" in the design, implementation, and evaluation of automated scoring for complex assessments. The contributing authors, all noted leaders in the field, introduce each m

Meeting the Challenges to Measurement in an Era of Accountability

Meeting the Challenges to Measurement in an Era of Accountability PDF Author: Henry Braun
Publisher: Routledge
ISBN: 113504015X
Category : Education
Languages : en
Pages : 463

Get Book Here

Book Description
Under pressure and support from the federal government, states have increasingly turned to indicators based on student test scores to evaluate teachers and schools, as well as students themselves. The focus thus far has been on test scores in those subject areas where there is a sequence of consecutive tests, such as in mathematics or English/language arts with a focus on grades 4-8. Teachers in these subject areas, however, constitute less than thirty percent of the teacher workforce in a district. Comparatively little has been written about the measurement of achievement in the other grades and subjects. This volume seeks to remedy this imbalance by focusing on the assessment of student achievement in a broad range of grade levels and subject areas, with particular attention to their use in the evaluation of teachers and schools in all. It addresses traditional end-of-course tests, as well as alternative measures such as portfolios, exhibitions, and student learning objectives. In each case, issues related to design and development, psychometric considerations, and validity challenges are covered from both a generic and a content-specific perspective. The NCME Applications of Educational Measurement and Assessment series includes edited volumes designed to inform research-based applications of educational measurement and assessment. Edited by leading experts, these books are comprehensive and practical resources on the latest developments in the field. The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license