Reliability and Validity Claims of a Foreign Language Proficiency Test PDF Download
Are you looking for read ebook online? Search for your book and save it on your Kindle device, PC, phones or tablets. Download Reliability and Validity Claims of a Foreign Language Proficiency Test PDF full book. Access full book title Reliability and Validity Claims of a Foreign Language Proficiency Test by Walter J. Mircea-Pines. Download full books in PDF and EPUB format.
Author: Walter J. Mircea-Pines
Publisher: LAP Lambert Academic Publishing
ISBN: 9783848417889
Category :
Languages : en
Pages : 116
Get Book Here
Book Description
This analysis examined the reliability and validity claims of a modified version of the Spanish Modern Language Association Foreign Language Proficiency Test. The study used a computerized version that was administered to 277 test-takers. The study's design was framed by the investigative steps proposed by Messick (1989) and Nitko and Brookhart (2007). An ex post facto approach was used, which mixed the confirmatory factor analysis and multiple regression analyses with descriptive interpretations. The quantitative analyses examined the impact of nationality, gender and average time spent on completing the tasks on the five subscales of this particular examination. The analyses provided mixed results related to the predictors' ability to explain the subscale scores. The descriptive analyses revealed numerous validity flaws and gaps in the test construction. Such inadequacies overshadowed the positive aspects and eventually led to my questioning of the hypothesis that the judgments based on data from these particular examinations are reliable and valid. Recommendations for possible revisions were made, along with suggestions for future research avenues.
Author: Walter J. Mircea-Pines
Publisher: LAP Lambert Academic Publishing
ISBN: 9783848417889
Category :
Languages : en
Pages : 116
Get Book Here
Book Description
This analysis examined the reliability and validity claims of a modified version of the Spanish Modern Language Association Foreign Language Proficiency Test. The study used a computerized version that was administered to 277 test-takers. The study's design was framed by the investigative steps proposed by Messick (1989) and Nitko and Brookhart (2007). An ex post facto approach was used, which mixed the confirmatory factor analysis and multiple regression analyses with descriptive interpretations. The quantitative analyses examined the impact of nationality, gender and average time spent on completing the tasks on the five subscales of this particular examination. The analyses provided mixed results related to the predictors' ability to explain the subscale scores. The descriptive analyses revealed numerous validity flaws and gaps in the test construction. Such inadequacies overshadowed the positive aspects and eventually led to my questioning of the hypothesis that the judgments based on data from these particular examinations are reliable and valid. Recommendations for possible revisions were made, along with suggestions for future research avenues.
Author: Walter J. Mircea-Pines
Publisher:
ISBN:
Category :
Languages : en
Pages : 212
Get Book Here
Book Description
This dissertation study examined the reliability and validity claims of a modified version of the Spanish Modern Language Association Foreign Language Proficiency Test for Teachers and Advanced Students administered at George Mason University (GMU). The study used the 1999 computerized GMU version that was administered to 277 test-takers via WebCT, (a web course management tool), and not the original 1961 pencil-and-paper edition. The GMU examination retained five sections from the test's original seven, namely Speaking, Listening, Reading, Writing, and Culture and Civilization. The original response formats, i.e. multiple-choice and true-false, were preserved for the most part. The Writing section was changed from the original error correction and text editing format to a fill-in-the-blanks format. The Culture and Civilization section was re-written due to obsolescence; however it retained the original answer format, to which a matching component was added. The study's design was framed by the investigative steps proposed by Messick (1989) and Nitko and Brookhart (2007). An ex post facto approach was used, which mixed the confirmatory factor analysis and multiple regression analyses with descriptive interpretations. The quantitative analyses examined the impact of nationality, gender and average time spent on completing the tasks on the five subscales of the Spanish GMU MLA examinations. The analyses provided mixed results related to the predictors' ability to explain the subscale scores. The descriptive analyses revealed numerous validity flaws and gaps in the test construction. Such inadequacies overshadowed the positive aspects and eventually led to my questioning of the hypothesis that the judgments based on data from the Spanish GMU MLA examinations are reliable and valid. Recommendations for possible revisions were made, along with suggestions for future research avenues.
Author: Carol A. Chapelle
Publisher: Routledge
ISBN: 1135602859
Category : Education
Languages : en
Pages : 437
Get Book Here
Book Description
The Test of English as a Foreign Language TM (TOEFL®) is used by more universities worldwide than any other test to assess English language proficiency for academic admission and placement decisions, and to guide English language instruction. This landmark volume provides a detailed description and analysis of Educational Testing Service’s research and development efforts to develop a major revision of the TOEFL® test. The result is a book that serves as a case study of test design drawing upon theory in the complex domain of English language proficiency while attempting to meet standards of educational measurement. Building a Validity Argument for the Test of English as a Foreign LanguageTM is distinctive in its attempt to develop a coherent story of the rationale for a test or its revision, explain the research and development process, and provide the results of the validation process. Through its treatment of one test, it expands on and tests principles and approaches to educational measurement, providing an in-depth, integrated perspective on the overall process of test revision. Moreover, because the conceptual foundation and history are presented alongside the empirical studies and validity argument, these sometimes disparate areas are presented in a way that demonstrates their connections – an approach which represents a departure from, or extension of, conventional materials on test revision. This volume is particularly relevant for professionals and graduate students in educational measurement, applied linguistics, and second language acquisition as well as anyone interested in assessment issues.
Author: Carol A. Chapelle
Publisher: Cambridge University Press
ISBN: 1108484026
Category : Education
Languages : en
Pages : 371
Get Book Here
Book Description
With examples of validation studies, this book demonstrates how to design research investigating the validity of language tests.
Author: National Academies of Sciences, Engineering, and Medicine
Publisher: National Academies Press
ISBN: 0309675480
Category : Education
Languages : en
Pages : 113
Get Book Here
Book Description
The United States is formally represented around the world by approximately 14,000 Foreign Service officers and other personnel in the U.S. Department of State. Roughly one-third of them are required to be proficient in the local languages of the countries to which they are posted. To achieve this language proficiency for its staff, the State Department's Foreign Service Institute (FSI) provides intensive language instruction and assesses the proficiency of personnel before they are posted to a foreign country. The requirement for language proficiency is established in law and is incorporated in personnel decisions related to job placement, promotion, retention, and pay. A Principled Approach to Language Assessment: Considerations for the U.S. Foreign Service Institute evaluates the different approaches that exist to assess foreign language proficiency that FSI could potentially use. This report considers the key assessment approaches in the research literature that are appropriate for language testing, including, but not limited to, assessments that use task-based or performance-based approaches, adaptive online test administration, and portfolios.
Author: Rüdiger Grotjahn
Publisher:
ISBN:
Category : Language and languages
Languages : de
Pages : 300
Get Book Here
Book Description
Author: David Patrick Barnwell
Publisher:
ISBN:
Category : English language
Languages : en
Pages : 214
Get Book Here
Book Description
Author: Alister H. Cumming
Publisher: Multilingual Matters
ISBN: 9781853592966
Category : Language Arts & Disciplines
Languages : en
Pages : 268
Get Book Here
Book Description
"The validation of language tests is widely discussed and expected, but only in recent years have researchers adopted a variety of innovative techniques for developing, assessing and validating specific tests of second or foreign language proficiency and their impact on education and society. Indeed, as the present volume clearly demonstrates, many different techniques for empirical analysis and types of evidence may be used to assess and interpret the validity of diverse aspects of language tests as well as the consequences they may have for language students, educators and society."--BOOK JACKET.Title Summary field provided by Blackwell North America, Inc. All Rights Reserved
Author: Robert W. Lissitz
Publisher: IAP
ISBN: 1617352691
Category : Education
Languages : en
Pages : 271
Get Book Here
Book Description
Validity is widely held to be the most important criterion for an assessment. Nevertheless, assessment professionals have disagreed about the meaning of validity almost from the introduction of the term as applied to testing about 100 years ago. Over the years, the best and brightest people in assessment have contributed their thinking to this problem and the fact that they have not agreed is testimony to the complexity and importance of validity. Even today, ways to define validity are being debated in the published literature in the assessment profession. How can such a fundamental concept be so controversial? This book brings focus to diverse perspectives about validity. Its chapter authors were chosen because of their expertise and because they differ from each other in the ways they think about the validity construct. Its introduction and ten chapters bridge both the theoretical and the practical. Contributors include most prominent names in the field of validity and their perspectives are at once cogent and controversial. From these diverse and well-informed discussions, the reader will gain a deep understanding of the core issues in validity along with directions toward possible resolutions. The debate that exists among these authors is a rich one that will stimulate the reader’s own understanding and opinion. Several chapters are oriented more practically. Ways to study validity are presented by professionals who blend current assessment practice with new suggestions for what sort of evidence to develop and how to generate the needed information. In addition they provide examples of some of the options on how to present the validity argument in the most effective ways. The initial chapter by the Editor is an effort to orient the reader as well as providing an overview of the book. Bob Lissitz has provided a brief perspective on each of the subsequent chapters as well as presenting a series of questions regarding validation that the reader will want to try to answer for themselves, as he or she reads through this book. This book’s topic is fundamental to assessment, its authors are distinguished, and its scope is broad. It deserves to become established as a fundamental reference on validity for years to come.
Author: Antony John Kunnan
Publisher: Routledge
ISBN: 113649779X
Category : Education
Languages : en
Pages : 294
Get Book Here
Book Description
Validation in Language Assessment contributes to the variety of validation approaches and analytical and interpretive techniques only recently adopted by language assessment researchers. Featuring selected papers from the 17th Language Testing Research Colloquium, the volume presents diverse approaches with an international perspective on validation in language assessment.
