Author: John Michael Norris
Publisher: Language Testing and Evaluation
ISBN: 9783631549469
Category : Language and languages
Languages : en
Pages : 0
Book Description
This book explores the notion of «validity evaluation» as a means for helping educators to ensure the utility and worth of their assessment practices. With a particular focus on foreign language testing, the author challenges assessment traditions and argues for a fundamental reconceptualization of assessments and their validation in language teaching and other educational settings. Following a critical review of test validity standards and methods within educational measurement, the author then proposes a comprehensive alternative approach to validation based upon program evaluation methodology. A report of a multi-year case study completes the volume, providing in-depth analyses of how validity evaluation methods were applied by foreign language educators in meeting the assessment needs of a German program at a US university.
Validity Evaluation in Language Assessment
Author: John Michael Norris
Publisher: Language Testing and Evaluation
ISBN: 9783631549469
Category : Language and languages
Languages : en
Pages : 0
Book Description
This book explores the notion of «validity evaluation» as a means for helping educators to ensure the utility and worth of their assessment practices. With a particular focus on foreign language testing, the author challenges assessment traditions and argues for a fundamental reconceptualization of assessments and their validation in language teaching and other educational settings. Following a critical review of test validity standards and methods within educational measurement, the author then proposes a comprehensive alternative approach to validation based upon program evaluation methodology. A report of a multi-year case study completes the volume, providing in-depth analyses of how validity evaluation methods were applied by foreign language educators in meeting the assessment needs of a German program at a US university.
Publisher: Language Testing and Evaluation
ISBN: 9783631549469
Category : Language and languages
Languages : en
Pages : 0
Book Description
This book explores the notion of «validity evaluation» as a means for helping educators to ensure the utility and worth of their assessment practices. With a particular focus on foreign language testing, the author challenges assessment traditions and argues for a fundamental reconceptualization of assessments and their validation in language teaching and other educational settings. Following a critical review of test validity standards and methods within educational measurement, the author then proposes a comprehensive alternative approach to validation based upon program evaluation methodology. A report of a multi-year case study completes the volume, providing in-depth analyses of how validity evaluation methods were applied by foreign language educators in meeting the assessment needs of a German program at a US university.
Validity Argument in Language Testing
Author: Carol A. Chapelle
Publisher: Cambridge University Press
ISBN: 110860238X
Category : Language Arts & Disciplines
Languages : en
Pages : 371
Book Description
Language tests play pivotal roles in education, research on learning, and gate-keeping decisions. The central concern for language testing professionals is how to investigate whether or not tests are appropriate for their intended purposes. This book introduces an argument-based validity framework to help with the design of research that investigates the validity of language test interpretation and use. The book presents the principal concepts and technical terms, then shows how they can be implemented successfully in practice through a variety of validation studies. It also demonstrates how argument-based validity intersects with technology in language testing research and highlights the use of validity argument for identifying research questions and interpreting the results of validation research. Use of the framework helps researchers in language testing to communicate clearly and consistently about technical issues with each other and with researchers of other types of tests.
Publisher: Cambridge University Press
ISBN: 110860238X
Category : Language Arts & Disciplines
Languages : en
Pages : 371
Book Description
Language tests play pivotal roles in education, research on learning, and gate-keeping decisions. The central concern for language testing professionals is how to investigate whether or not tests are appropriate for their intended purposes. This book introduces an argument-based validity framework to help with the design of research that investigates the validity of language test interpretation and use. The book presents the principal concepts and technical terms, then shows how they can be implemented successfully in practice through a variety of validation studies. It also demonstrates how argument-based validity intersects with technology in language testing research and highlights the use of validity argument for identifying research questions and interpreting the results of validation research. Use of the framework helps researchers in language testing to communicate clearly and consistently about technical issues with each other and with researchers of other types of tests.
Useful Assessment and Evaluation in Language Education
Author: John McE. Davis
Publisher: Georgetown University Press
ISBN: 1626165416
Category : Foreign Language Study
Languages : en
Pages : 275
Book Description
The specific—and varied—ways in which assessment and evaluation can impact learning and teaching have become an important language education research concern, particularly as educators are increasingly called on to implement these processes for improvement, accountability, or curricular development purposes. Useful Assessment and Evaluation in Language Education showcases contemporary research that explores innovative uses of assessment and evaluation in a variety of educational contexts. Divided into three parts, this volume first examines theoretical considerations and practical implementations of assessment conducted for the purpose of enhancing and developing language learning. Part 2 addresses novel assessment development and implementation projects, such as the formative use of task-based assessments, technology-mediated language performance assessment, validation of educational placement tests for immigrant learners, and the use of assessment to help identify neurolinguistic correlates of proficiency. The final section of the book highlights examples of argument-based approaches to assessment and evaluation validation, extending this critical framework to quality assurance efforts in new domains. Adding to research on traditional and conventional uses of testing and evaluation in language education, this volume captures innovative trends in assessment and evaluation practice that explicitly aim to better inform and enhance language teaching and learning.
Publisher: Georgetown University Press
ISBN: 1626165416
Category : Foreign Language Study
Languages : en
Pages : 275
Book Description
The specific—and varied—ways in which assessment and evaluation can impact learning and teaching have become an important language education research concern, particularly as educators are increasingly called on to implement these processes for improvement, accountability, or curricular development purposes. Useful Assessment and Evaluation in Language Education showcases contemporary research that explores innovative uses of assessment and evaluation in a variety of educational contexts. Divided into three parts, this volume first examines theoretical considerations and practical implementations of assessment conducted for the purpose of enhancing and developing language learning. Part 2 addresses novel assessment development and implementation projects, such as the formative use of task-based assessments, technology-mediated language performance assessment, validation of educational placement tests for immigrant learners, and the use of assessment to help identify neurolinguistic correlates of proficiency. The final section of the book highlights examples of argument-based approaches to assessment and evaluation validation, extending this critical framework to quality assurance efforts in new domains. Adding to research on traditional and conventional uses of testing and evaluation in language education, this volume captures innovative trends in assessment and evaluation practice that explicitly aim to better inform and enhance language teaching and learning.
Classroom Assessment and Educational Measurement
Author: Susan M. Brookhart
Publisher: Routledge
ISBN: 042901760X
Category : Education
Languages : en
Pages : 567
Book Description
Classroom Assessment and Educational Measurement explores the ways in which the theory and practice of both educational measurement and the assessment of student learning in classroom settings mutually inform one another. Chapters by assessment and measurement experts consider the nature of classroom assessment information, from student achievement to affective and socio-emotional attributes; how teachers interpret and work with assessment results; and emerging issues in assessment such as digital technologies and diversity/inclusion. This book uniquely considers the limitations of applying large-scale educational measurement theory to classroom assessment and the adaptations necessary to make this transfer useful. Researchers, graduate students, industry professionals, and policymakers will come away with an essential understanding of how the classroom assessment context is essential to broadening contemporary educational measurement perspectives. The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license.
Publisher: Routledge
ISBN: 042901760X
Category : Education
Languages : en
Pages : 567
Book Description
Classroom Assessment and Educational Measurement explores the ways in which the theory and practice of both educational measurement and the assessment of student learning in classroom settings mutually inform one another. Chapters by assessment and measurement experts consider the nature of classroom assessment information, from student achievement to affective and socio-emotional attributes; how teachers interpret and work with assessment results; and emerging issues in assessment such as digital technologies and diversity/inclusion. This book uniquely considers the limitations of applying large-scale educational measurement theory to classroom assessment and the adaptations necessary to make this transfer useful. Researchers, graduate students, industry professionals, and policymakers will come away with an essential understanding of how the classroom assessment context is essential to broadening contemporary educational measurement perspectives. The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license.
Language Testing and Validation
Author: C. Weir
Publisher: Springer
ISBN: 023051457X
Category : Education
Languages : en
Pages : 309
Book Description
Tests for the measurement of language abilities must be constructed according to a coherent validity framework based on the latest developments in theory and practice. This innovative book, by a world authority on language testing, deals with all key aspects of language test design and implementation. It provides a road map to effective testing based on the latest approaches to test validation. A book for all MA students in Applied Linguistics or TESOL, and for professional language teachers
Publisher: Springer
ISBN: 023051457X
Category : Education
Languages : en
Pages : 309
Book Description
Tests for the measurement of language abilities must be constructed according to a coherent validity framework based on the latest developments in theory and practice. This innovative book, by a world authority on language testing, deals with all key aspects of language test design and implementation. It provides a road map to effective testing based on the latest approaches to test validation. A book for all MA students in Applied Linguistics or TESOL, and for professional language teachers
Validity in Educational and Psychological Assessment
Author: Paul Newton
Publisher: SAGE
ISBN: 1473904056
Category : Education
Languages : en
Pages : 465
Book Description
Validity is the hallmark of quality for educational and psychological measurement. But what does quality mean in this context? And to what, exactly, does the concept of validity apply? These apparently innocuous questions parachute the unwary inquirer into a minefield of tricky ideas. This book guides you through this minefield, investigating how the concept of validity has evolved from the nineteenth century to the present day. Communicating complicated concepts straightforwardly, the authors answer questions like: What does ′validity′ mean? What does it mean to ′validate′? How many different kinds of validity are there? When does validation begin and end? Is reliability a part of validity, or distinct from it? This book will be of interest to anyone with a professional or academic interest in evaluating the quality of educational or psychological assessments, measurements and diagnoses.
Publisher: SAGE
ISBN: 1473904056
Category : Education
Languages : en
Pages : 465
Book Description
Validity is the hallmark of quality for educational and psychological measurement. But what does quality mean in this context? And to what, exactly, does the concept of validity apply? These apparently innocuous questions parachute the unwary inquirer into a minefield of tricky ideas. This book guides you through this minefield, investigating how the concept of validity has evolved from the nineteenth century to the present day. Communicating complicated concepts straightforwardly, the authors answer questions like: What does ′validity′ mean? What does it mean to ′validate′? How many different kinds of validity are there? When does validation begin and end? Is reliability a part of validity, or distinct from it? This book will be of interest to anyone with a professional or academic interest in evaluating the quality of educational or psychological assessments, measurements and diagnoses.
Cultural Validity in Assessment
Author: María del Rosario Basterra
Publisher: Routledge
ISBN: 1136965971
Category : Education
Languages : en
Pages : 317
Book Description
This guide for educators looks at major issues in language testing and provides knowledge, techniques, and strategies to design and implement assessments for use in classrooms that maximize fairness and validity for all students.
Publisher: Routledge
ISBN: 1136965971
Category : Education
Languages : en
Pages : 317
Book Description
This guide for educators looks at major issues in language testing and provides knowledge, techniques, and strategies to design and implement assessments for use in classrooms that maximize fairness and validity for all students.
Reliability and Validity of International Large-Scale Assessment
Author: Hans Wagemaker
Publisher: Springer Nature
ISBN: 3030530817
Category : Education
Languages : en
Pages : 279
Book Description
This open access book describes and reviews the development of the quality control mechanisms and methodologies associated with IEA’s extensive program of educational research. A group of renowned international researchers, directly involved in the design and execution of IEA’s international large-scale assessments (ILSAs), describe the operational and quality control procedures that are employed to address the challenges associated with providing high-quality, comparable data. Throughout the now considerable history of IEA’s international large-scale assessments, establishing the quality of the data has been paramount. Research in the complex multinational context in which IEA studies operate imposes significant burdens and challenges in terms of the methodologies and technologies that have been developed to achieve the stated study goals. The demands of the twin imperatives of validity and reliability must be satisfied in the context of multiple and diverse cultures, languages, orthographies, educational structures, educational histories, and traditions. Readers will learn about IEA’s approach to such challenges, and the methods used to ensure that the quality of the data provided to policymakers and researchers can be trusted. An often neglected area of investigation, namely the consequential validity of ILSAs, is also explored, examining issues related to reporting, dissemination, and impact, including discussion of the limits of interpretation. The final chapters address the question of the influence of ILSAs on policy and reform in education, including a case study from Singapore, a country known for its outstanding levels of achievement, but which nevertheless seeks the means of continual improvement, illustrating best practice use of ILSA data.
Publisher: Springer Nature
ISBN: 3030530817
Category : Education
Languages : en
Pages : 279
Book Description
This open access book describes and reviews the development of the quality control mechanisms and methodologies associated with IEA’s extensive program of educational research. A group of renowned international researchers, directly involved in the design and execution of IEA’s international large-scale assessments (ILSAs), describe the operational and quality control procedures that are employed to address the challenges associated with providing high-quality, comparable data. Throughout the now considerable history of IEA’s international large-scale assessments, establishing the quality of the data has been paramount. Research in the complex multinational context in which IEA studies operate imposes significant burdens and challenges in terms of the methodologies and technologies that have been developed to achieve the stated study goals. The demands of the twin imperatives of validity and reliability must be satisfied in the context of multiple and diverse cultures, languages, orthographies, educational structures, educational histories, and traditions. Readers will learn about IEA’s approach to such challenges, and the methods used to ensure that the quality of the data provided to policymakers and researchers can be trusted. An often neglected area of investigation, namely the consequential validity of ILSAs, is also explored, examining issues related to reporting, dissemination, and impact, including discussion of the limits of interpretation. The final chapters address the question of the influence of ILSAs on policy and reform in education, including a case study from Singapore, a country known for its outstanding levels of achievement, but which nevertheless seeks the means of continual improvement, illustrating best practice use of ILSA data.
Criterion-Referenced Language Testing
Author: James Dean Brown
Publisher: Cambridge University Press
ISBN: 0521000831
Category : Foreign Language Study
Languages : en
Pages : 640
Book Description
Criterion-referenced Language Testing looks at the practical applications of this new area of language testing.
Publisher: Cambridge University Press
ISBN: 0521000831
Category : Foreign Language Study
Languages : en
Pages : 640
Book Description
Criterion-referenced Language Testing looks at the practical applications of this new area of language testing.
Allocating Federal Funds for State Programs for English Language Learners
Author: National Research Council
Publisher: National Academies Press
ISBN: 0309216737
Category : Education
Languages : en
Pages : 240
Book Description
As the United States continues to be a nation of immigrants and their children, the nation's school systems face increased enrollments of students whose primary language is not English. With the 2001 reauthorization of the Elementary and Secondary Education Act (ESEA) in the No Child Left Behind Act (NCLB), the allocation of federal funds for programs to assist these students to be proficient in English became formula-based: 80 percent on the basis of the population of children with limited English proficiency1 and 20 percent on the basis of the population of recently immigrated children and youth. Title III of NCLB directs the U.S. Department of Education to allocate funds on the basis of the more accurate of two allowable data sources: the number of students reported to the federal government by each state education agency or data from the American Community Survey (ACS). The department determined that the ACS estimates are more accurate, and since 2005, those data have been basis for the federal distribution of Title III funds. Subsequently, analyses of the two data sources have raised concerns about that decision, especially because the two allowable data sources would allocate quite different amounts to the states. In addition, while shortcomings were noted in the data provided by the states, the ACS estimates were shown to fluctuate between years, causing concern among the states about the unpredictability and unevenness of program funding. In this context, the U.S. Department of Education commissioned the National Research Council to address the accuracy of the estimates from the two data sources and the factors that influence the estimates. The resulting book also considers means of increasing the accuracy of the data sources or alternative data sources that could be used for allocation purposes.
Publisher: National Academies Press
ISBN: 0309216737
Category : Education
Languages : en
Pages : 240
Book Description
As the United States continues to be a nation of immigrants and their children, the nation's school systems face increased enrollments of students whose primary language is not English. With the 2001 reauthorization of the Elementary and Secondary Education Act (ESEA) in the No Child Left Behind Act (NCLB), the allocation of federal funds for programs to assist these students to be proficient in English became formula-based: 80 percent on the basis of the population of children with limited English proficiency1 and 20 percent on the basis of the population of recently immigrated children and youth. Title III of NCLB directs the U.S. Department of Education to allocate funds on the basis of the more accurate of two allowable data sources: the number of students reported to the federal government by each state education agency or data from the American Community Survey (ACS). The department determined that the ACS estimates are more accurate, and since 2005, those data have been basis for the federal distribution of Title III funds. Subsequently, analyses of the two data sources have raised concerns about that decision, especially because the two allowable data sources would allocate quite different amounts to the states. In addition, while shortcomings were noted in the data provided by the states, the ACS estimates were shown to fluctuate between years, causing concern among the states about the unpredictability and unevenness of program funding. In this context, the U.S. Department of Education commissioned the National Research Council to address the accuracy of the estimates from the two data sources and the factors that influence the estimates. The resulting book also considers means of increasing the accuracy of the data sources or alternative data sources that could be used for allocation purposes.