Author: David Brinberg
Publisher:
ISBN: 9780608043012
Category :
Languages : en
Pages : 175
Book Description
Researchers in the social sciences are often in fundamental disagreement about what constitutes validity. Much emphasis has been given to increasing validity through the application of various techniques. Brinberg and McGrath point out that research is not advanced by these diverse concepts of validity nor the uniform stress on technical applications to attain it. Instead, they propose a new way of viewing validity issues -- an abstract and complex set of logical relationships that they call the Validity Network Schema, or VNS. In essence, VNS distinguishes between three 'domains' of the research process (substantive, conceptual, and methodological) and three 'stages' of it (validity as value, validity as correspondence, and validity as robustness). The authors draw their examples from their own areas of expertise: social psychology, consumer behaviour, and organizational research. They present a comprehensive view of the research process that ties together previously separate views of validity. Glossaries at the end of each chapter ensure that the VNS terminology is clearly understood.
Validity and the Research Process
Author: David Brinberg
Publisher:
ISBN: 9780608043012
Category :
Languages : en
Pages : 175
Book Description
Researchers in the social sciences are often in fundamental disagreement about what constitutes validity. Much emphasis has been given to increasing validity through the application of various techniques. Brinberg and McGrath point out that research is not advanced by these diverse concepts of validity nor the uniform stress on technical applications to attain it. Instead, they propose a new way of viewing validity issues -- an abstract and complex set of logical relationships that they call the Validity Network Schema, or VNS. In essence, VNS distinguishes between three 'domains' of the research process (substantive, conceptual, and methodological) and three 'stages' of it (validity as value, validity as correspondence, and validity as robustness). The authors draw their examples from their own areas of expertise: social psychology, consumer behaviour, and organizational research. They present a comprehensive view of the research process that ties together previously separate views of validity. Glossaries at the end of each chapter ensure that the VNS terminology is clearly understood.
Publisher:
ISBN: 9780608043012
Category :
Languages : en
Pages : 175
Book Description
Researchers in the social sciences are often in fundamental disagreement about what constitutes validity. Much emphasis has been given to increasing validity through the application of various techniques. Brinberg and McGrath point out that research is not advanced by these diverse concepts of validity nor the uniform stress on technical applications to attain it. Instead, they propose a new way of viewing validity issues -- an abstract and complex set of logical relationships that they call the Validity Network Schema, or VNS. In essence, VNS distinguishes between three 'domains' of the research process (substantive, conceptual, and methodological) and three 'stages' of it (validity as value, validity as correspondence, and validity as robustness). The authors draw their examples from their own areas of expertise: social psychology, consumer behaviour, and organizational research. They present a comprehensive view of the research process that ties together previously separate views of validity. Glossaries at the end of each chapter ensure that the VNS terminology is clearly understood.
Reliability and Validity Assessment
Author: Edward G. Carmines
Publisher: SAGE Publications, Incorporated
ISBN:
Category : Reference
Languages : en
Pages : 78
Book Description
The authors present an elementary and exceptionally lucid introduction to issues in measurement theory. They define and discuss validity and reliability; proceed to a discussion of three basic types of validity, including criterion, content, and construct validity; present an introductory discussion of classical test theory, with an emphasis on parallel measures; and present a clear discussion of four methods of reliability estimation, including the test-retest, alternative form, split-half, and internal consistency methods of reliability assessment. The text is concluded with a discussion of the use of reliability assessment for purposes of correcting bivariate correlations for attenuation due to random measurement error.
Publisher: SAGE Publications, Incorporated
ISBN:
Category : Reference
Languages : en
Pages : 78
Book Description
The authors present an elementary and exceptionally lucid introduction to issues in measurement theory. They define and discuss validity and reliability; proceed to a discussion of three basic types of validity, including criterion, content, and construct validity; present an introductory discussion of classical test theory, with an emphasis on parallel measures; and present a clear discussion of four methods of reliability estimation, including the test-retest, alternative form, split-half, and internal consistency methods of reliability assessment. The text is concluded with a discussion of the use of reliability assessment for purposes of correcting bivariate correlations for attenuation due to random measurement error.
Validity and Validation in Social, Behavioral, and Health Sciences
Author: Bruno D. Zumbo
Publisher: Springer
ISBN: 3319077945
Category : Social Science
Languages : en
Pages : 329
Book Description
This book combines an overview of validity theory, trends in validation practices and a review of standards and guidelines in several international jurisdictions with research synthesis of the validity evidence in different research areas. An overview of theory is both useful and timely, in view of the increased use of tests and measures for decision-making, ranking and policy purposes in large-scale testing, assessment and social indicators and quality of life research. Research synthesis is needed to help us assemble, critically appraise and integrate the overwhelming volume of research on validity in different contexts. Rather than examining whether any given measure is “valid”, the focus is on a critical appraisal of the kinds of validity evidence reported in the published research literature. The five sources of validity evidence discussed are: content-related, response processes, internal structure, associations with other variables and consequences. The 15 syntheses included here, represent a broad sampling of psychosocial, health, medical and educational research settings, giving us an extensive evidential basis to build upon earlier studies. The book concludes with a meta-synthesis of the 15 syntheses and a discussion of the current thinking of validation practices by leading experts in the field.
Publisher: Springer
ISBN: 3319077945
Category : Social Science
Languages : en
Pages : 329
Book Description
This book combines an overview of validity theory, trends in validation practices and a review of standards and guidelines in several international jurisdictions with research synthesis of the validity evidence in different research areas. An overview of theory is both useful and timely, in view of the increased use of tests and measures for decision-making, ranking and policy purposes in large-scale testing, assessment and social indicators and quality of life research. Research synthesis is needed to help us assemble, critically appraise and integrate the overwhelming volume of research on validity in different contexts. Rather than examining whether any given measure is “valid”, the focus is on a critical appraisal of the kinds of validity evidence reported in the published research literature. The five sources of validity evidence discussed are: content-related, response processes, internal structure, associations with other variables and consequences. The 15 syntheses included here, represent a broad sampling of psychosocial, health, medical and educational research settings, giving us an extensive evidential basis to build upon earlier studies. The book concludes with a meta-synthesis of the 15 syntheses and a discussion of the current thinking of validation practices by leading experts in the field.
Encyclopedia of Research Design
Author: Neil J. Salkind
Publisher: SAGE
ISBN: 1412961270
Category : Philosophy
Languages : en
Pages : 1779
Book Description
"Comprising more than 500 entries, the Encyclopedia of Research Design explains how to make decisions about research design, undertake research projects in an ethical manner, interpret and draw valid inferences from data, and evaluate experiment design strategies and results. Two additional features carry this encyclopedia far above other works in the field: bibliographic entries devoted to significant articles in the history of research design and reviews of contemporary tools, such as software and statistical procedures, used to analyze results. It covers the spectrum of research design strategies, from material presented in introductory classes to topics necessary in graduate research; it addresses cross- and multidisciplinary research needs, with many examples drawn from the social and behavioral sciences, neurosciences, and biomedical and life sciences; it provides summaries of advantages and disadvantages of often-used strategies; and it uses hundreds of sample tables, figures, and equations based on real-life cases."--Publisher's description.
Publisher: SAGE
ISBN: 1412961270
Category : Philosophy
Languages : en
Pages : 1779
Book Description
"Comprising more than 500 entries, the Encyclopedia of Research Design explains how to make decisions about research design, undertake research projects in an ethical manner, interpret and draw valid inferences from data, and evaluate experiment design strategies and results. Two additional features carry this encyclopedia far above other works in the field: bibliographic entries devoted to significant articles in the history of research design and reviews of contemporary tools, such as software and statistical procedures, used to analyze results. It covers the spectrum of research design strategies, from material presented in introductory classes to topics necessary in graduate research; it addresses cross- and multidisciplinary research needs, with many examples drawn from the social and behavioral sciences, neurosciences, and biomedical and life sciences; it provides summaries of advantages and disadvantages of often-used strategies; and it uses hundreds of sample tables, figures, and equations based on real-life cases."--Publisher's description.
Advancing Human Assessment
Author: Randy E. Bennett
Publisher: Springer
ISBN: 3319586890
Category : Education
Languages : en
Pages : 717
Book Description
This book is open access under a CC BY-NC 2.5 license. This book describes the extensive contributions made toward the advancement of human assessment by scientists from one of the world’s leading research institutions, Educational Testing Service. The book’s four major sections detail research and development in measurement and statistics, education policy analysis and evaluation, scientific psychology, and validity. Many of the developments presented have become de-facto standards in educational and psychological measurement, including in item response theory (IRT), linking and equating, differential item functioning (DIF), and educational surveys like the National Assessment of Educational Progress (NAEP), the Programme of international Student Assessment (PISA), the Progress of International Reading Literacy Study (PIRLS) and the Trends in Mathematics and Science Study (TIMSS). In addition to its comprehensive coverage of contributions to the theory and methodology of educational and psychological measurement and statistics, the book gives significant attention to ETS work in cognitive, personality, developmental, and social psychology, and to education policy analysis and program evaluation. The chapter authors are long-standing experts who provide broad coverage and thoughtful insights that build upon decades of experience in research and best practices for measurement, evaluation, scientific psychology, and education policy analysis. Opening with a chapter on the genesis of ETS and closing with a synthesis of the enormously diverse set of contributions made over its 70-year history, the book is a useful resource for all interested in the improvement of human assessment.
Publisher: Springer
ISBN: 3319586890
Category : Education
Languages : en
Pages : 717
Book Description
This book is open access under a CC BY-NC 2.5 license. This book describes the extensive contributions made toward the advancement of human assessment by scientists from one of the world’s leading research institutions, Educational Testing Service. The book’s four major sections detail research and development in measurement and statistics, education policy analysis and evaluation, scientific psychology, and validity. Many of the developments presented have become de-facto standards in educational and psychological measurement, including in item response theory (IRT), linking and equating, differential item functioning (DIF), and educational surveys like the National Assessment of Educational Progress (NAEP), the Programme of international Student Assessment (PISA), the Progress of International Reading Literacy Study (PIRLS) and the Trends in Mathematics and Science Study (TIMSS). In addition to its comprehensive coverage of contributions to the theory and methodology of educational and psychological measurement and statistics, the book gives significant attention to ETS work in cognitive, personality, developmental, and social psychology, and to education policy analysis and program evaluation. The chapter authors are long-standing experts who provide broad coverage and thoughtful insights that build upon decades of experience in research and best practices for measurement, evaluation, scientific psychology, and education policy analysis. Opening with a chapter on the genesis of ETS and closing with a synthesis of the enormously diverse set of contributions made over its 70-year history, the book is a useful resource for all interested in the improvement of human assessment.
Validity and Validation
Author: Catherine S. Taylor
Publisher: Oxford University Press
ISBN: 0199359245
Category : Psychology
Languages : en
Pages : 217
Book Description
The Understanding Research series focuses on the process of writing up social research. The series is broken down into three categories: Understanding Statistics, Understanding Measurement, and Understanding Qualitative Research. The books provide researchers with guides to understanding, writing, and evaluating social research. Each volume demonstrates how research should be represented, including how to write up the methodology as well as the research findings. Each volume also reviews how to appropriately evaluate published research. Validity and Validation is an introduction to validity theory and to the methods used to obtain evidence for the validity of research and assessment results. The book pulls together the best thinking from educational and psychological research and assessment over the past 50 years. It briefly describes validity theory's roots in the philosophy of science. It highlights the ways these philosophical perspectives influence concepts of internal and external validity in research methodology, as well as concepts of validity and reliability in educational and psychological tests and measurements. Each chapter provides multiple examples (e.g., research designs and examples of output) to help the readers see how validation work is done in practice, from the ways we design research studies to the ways we interpret research results. Of particular importance is the practical focus on validation of scores from tests and other measures. The book also addresses strategies for investigating the validity of inferences we make about examinees using scores from assessments, as well as how to investigate score uses, the value implications of score interpretations, and the social consequences of score use. With this foundation, the book presents strategies for minimizing threats for validity as well as quantitative and qualitative methods for gathering evidence for the validity of scores.
Publisher: Oxford University Press
ISBN: 0199359245
Category : Psychology
Languages : en
Pages : 217
Book Description
The Understanding Research series focuses on the process of writing up social research. The series is broken down into three categories: Understanding Statistics, Understanding Measurement, and Understanding Qualitative Research. The books provide researchers with guides to understanding, writing, and evaluating social research. Each volume demonstrates how research should be represented, including how to write up the methodology as well as the research findings. Each volume also reviews how to appropriately evaluate published research. Validity and Validation is an introduction to validity theory and to the methods used to obtain evidence for the validity of research and assessment results. The book pulls together the best thinking from educational and psychological research and assessment over the past 50 years. It briefly describes validity theory's roots in the philosophy of science. It highlights the ways these philosophical perspectives influence concepts of internal and external validity in research methodology, as well as concepts of validity and reliability in educational and psychological tests and measurements. Each chapter provides multiple examples (e.g., research designs and examples of output) to help the readers see how validation work is done in practice, from the ways we design research studies to the ways we interpret research results. Of particular importance is the practical focus on validation of scores from tests and other measures. The book also addresses strategies for investigating the validity of inferences we make about examinees using scores from assessments, as well as how to investigate score uses, the value implications of score interpretations, and the social consequences of score use. With this foundation, the book presents strategies for minimizing threats for validity as well as quantitative and qualitative methods for gathering evidence for the validity of scores.
Reliability and Validity of International Large-Scale Assessment
Author: Hans Wagemaker
Publisher: Springer Nature
ISBN: 3030530817
Category : Education
Languages : en
Pages : 279
Book Description
This open access book describes and reviews the development of the quality control mechanisms and methodologies associated with IEA’s extensive program of educational research. A group of renowned international researchers, directly involved in the design and execution of IEA’s international large-scale assessments (ILSAs), describe the operational and quality control procedures that are employed to address the challenges associated with providing high-quality, comparable data. Throughout the now considerable history of IEA’s international large-scale assessments, establishing the quality of the data has been paramount. Research in the complex multinational context in which IEA studies operate imposes significant burdens and challenges in terms of the methodologies and technologies that have been developed to achieve the stated study goals. The demands of the twin imperatives of validity and reliability must be satisfied in the context of multiple and diverse cultures, languages, orthographies, educational structures, educational histories, and traditions. Readers will learn about IEA’s approach to such challenges, and the methods used to ensure that the quality of the data provided to policymakers and researchers can be trusted. An often neglected area of investigation, namely the consequential validity of ILSAs, is also explored, examining issues related to reporting, dissemination, and impact, including discussion of the limits of interpretation. The final chapters address the question of the influence of ILSAs on policy and reform in education, including a case study from Singapore, a country known for its outstanding levels of achievement, but which nevertheless seeks the means of continual improvement, illustrating best practice use of ILSA data.
Publisher: Springer Nature
ISBN: 3030530817
Category : Education
Languages : en
Pages : 279
Book Description
This open access book describes and reviews the development of the quality control mechanisms and methodologies associated with IEA’s extensive program of educational research. A group of renowned international researchers, directly involved in the design and execution of IEA’s international large-scale assessments (ILSAs), describe the operational and quality control procedures that are employed to address the challenges associated with providing high-quality, comparable data. Throughout the now considerable history of IEA’s international large-scale assessments, establishing the quality of the data has been paramount. Research in the complex multinational context in which IEA studies operate imposes significant burdens and challenges in terms of the methodologies and technologies that have been developed to achieve the stated study goals. The demands of the twin imperatives of validity and reliability must be satisfied in the context of multiple and diverse cultures, languages, orthographies, educational structures, educational histories, and traditions. Readers will learn about IEA’s approach to such challenges, and the methods used to ensure that the quality of the data provided to policymakers and researchers can be trusted. An often neglected area of investigation, namely the consequential validity of ILSAs, is also explored, examining issues related to reporting, dissemination, and impact, including discussion of the limits of interpretation. The final chapters address the question of the influence of ILSAs on policy and reform in education, including a case study from Singapore, a country known for its outstanding levels of achievement, but which nevertheless seeks the means of continual improvement, illustrating best practice use of ILSA data.
Research Concepts for the Practitioner of Educational Leadership
Author: Lee Baldwin
Publisher: BRILL
ISBN: 900436515X
Category : Education
Languages : en
Pages : 74
Book Description
In Research Concepts for the Practitioner of Educational Leadership, the author acquaints the reader with principles of educational research that are most applicable to today’s educational leaders. Educational leaders are facing increasing demands to analyze data and use research to make instructional decisions. School-based educational leaders are facing these demands as well as those in educational leadership at other levels such as school districts and foundations. Instructional leaders are finding it increasingly difficult to lead without having a firm grasp of using data to make informed instructional decisions. This book helps to bridge the gap between the complex world of data analysis with the ever-changing dynamics of education leadership.
Publisher: BRILL
ISBN: 900436515X
Category : Education
Languages : en
Pages : 74
Book Description
In Research Concepts for the Practitioner of Educational Leadership, the author acquaints the reader with principles of educational research that are most applicable to today’s educational leaders. Educational leaders are facing increasing demands to analyze data and use research to make instructional decisions. School-based educational leaders are facing these demands as well as those in educational leadership at other levels such as school districts and foundations. Instructional leaders are finding it increasingly difficult to lead without having a firm grasp of using data to make informed instructional decisions. This book helps to bridge the gap between the complex world of data analysis with the ever-changing dynamics of education leadership.
The Practice of Survey Research
Author: Erin E. Ruel
Publisher: SAGE
ISBN: 1452235279
Category : Reference
Languages : en
Pages : 361
Book Description
Focusing on the use of technology in survey research, this book integrates both theory and application and covers important elements of survey research including survey design, implementation and continuing data management.
Publisher: SAGE
ISBN: 1452235279
Category : Reference
Languages : en
Pages : 361
Book Description
Focusing on the use of technology in survey research, this book integrates both theory and application and covers important elements of survey research including survey design, implementation and continuing data management.
Validity in Educational and Psychological Assessment
Author: Paul Newton
Publisher: SAGE
ISBN: 1473904056
Category : Education
Languages : en
Pages : 465
Book Description
Validity is the hallmark of quality for educational and psychological measurement. But what does quality mean in this context? And to what, exactly, does the concept of validity apply? These apparently innocuous questions parachute the unwary inquirer into a minefield of tricky ideas. This book guides you through this minefield, investigating how the concept of validity has evolved from the nineteenth century to the present day. Communicating complicated concepts straightforwardly, the authors answer questions like: What does ′validity′ mean? What does it mean to ′validate′? How many different kinds of validity are there? When does validation begin and end? Is reliability a part of validity, or distinct from it? This book will be of interest to anyone with a professional or academic interest in evaluating the quality of educational or psychological assessments, measurements and diagnoses.
Publisher: SAGE
ISBN: 1473904056
Category : Education
Languages : en
Pages : 465
Book Description
Validity is the hallmark of quality for educational and psychological measurement. But what does quality mean in this context? And to what, exactly, does the concept of validity apply? These apparently innocuous questions parachute the unwary inquirer into a minefield of tricky ideas. This book guides you through this minefield, investigating how the concept of validity has evolved from the nineteenth century to the present day. Communicating complicated concepts straightforwardly, the authors answer questions like: What does ′validity′ mean? What does it mean to ′validate′? How many different kinds of validity are there? When does validation begin and end? Is reliability a part of validity, or distinct from it? This book will be of interest to anyone with a professional or academic interest in evaluating the quality of educational or psychological assessments, measurements and diagnoses.