Author: Bruno D. Zumbo
Publisher: Springer
ISBN: 3319561294
Category : Social Science
Languages : en
Pages : 374
Get Book Here
Book Description
This volume addresses an urgent need across multiple disciplines to broaden our understanding and use of response processes evidence of test validity. It builds on the themes and findings of the volume Validity and Validation in Social, Behavioral, and Health Sciences (Zumbo & Chan, 2014), with a focus on measurement validity evidence based on response processes. Approximately 1000 studies are published each year examining the validity of inferences made from tests and measures in the social, behavioural, and health sciences. The widely accepted Standards for Educational and Psychological Testing (1999, 2014) present five sources of evidence for validity: content-related, response processes, internal structure, relationships with other variables, and consequences of testing. Many studies focus on internal structure and relationships with other variables sources of evidence, which have a long history in validation research, known methodologies, and numerous exemplars in the literature. Far less is understood by test users and researchers conducting validation work about how to think about and apply new and emerging sources of validity evidence. This groundbreaking volume is the first to present conceptual models of response processes, methodological issues that arise in gathering response processes evidence, as well as applications and exemplars for providing response processes evidence in validation work.
Author: Ulemu Luhanga
Publisher: IAP
ISBN: 1648026044
Category : Education
Languages : en
Pages : 825
Get Book Here
Book Description
In this first book of the series Survey Methods in Educational Research, we have brought together leading authors and scholars in the field to discuss key introductory concepts in the creation, implementation, evaluation and dissemination of survey instruments and their resultant findings. While there are other textbooks that might introduce these concepts adequately well, the authors here have focused on the pragmatic issues that inevitably arise in the development and administration process of survey instruments. Drawing from their rich experiences, the authors present these potential speed bumps or road blocks a survey researcher in education or the social sciences might encounter. Referencing their own work and practice, the authors provide valuable suggestions for dealing with these issues “your advisor never told you about.” And all of the recommendations are aligned with standard protocols and current research on best practices in the field of research methodology. This book is broken into four broad units on creating survey items and instruments, administering surveys, analyzing the data from surveys, and stories of successful administrations modeling the entire research cycle. Each chapter focuses on a different concept in the survey research process, and the authors share their approaches to addressing the issues. These topics include survey item construction, scale development, cognitive interviewing, measuring change with self-report data, translation issues with surveys administered in multiple languages, working with school and program administrators when implementing surveys, a review of current software used in survey research, the use of weights, response styles, assessing validity of results, and effectively communicating your results and findings … and much more. The intended audience of the volume will be practitioners, administrators, teachers as researchers, graduate students, social science and education researchers not experienced in survey research, and students learning program evaluation. In brief, if you are considering doing survey research, this book is meant for you.
Author: Marie-Claire Shanahan
Publisher: Taylor & Francis
ISBN: 1000608123
Category : Education
Languages : en
Pages : 279
Get Book Here
Book Description
The Learning Sciences in Conversation explores the unique pluralities, complex networks, and distinct approaches of the learning scientists of today. Focused on four key scholarly areas – transdisciplinarity, design, cognition, and technology – this cutting-edge volume draws on empirical and theoretical foundations to illustrate the directions, perspectives, methods, and questions that continue to define this evolving field. Contributions by researchers are put in dialogue with one another, offering an exemplary analysis of a field that synthesizes, in situ, various scholarly traditions and orientations to create a critical and heterogenous understanding of learning.
Author: Bryan Maddox
Publisher: Bloomsbury Publishing
ISBN: 1350023612
Category : Education
Languages : en
Pages : 247
Get Book Here
Book Description
This book explores the often controversial international large-scale assessments (ILSAs) in education and offers research-based accounts of international testing as a social practice. Assessment exercises, such as the Organisation for Economic Co-operation and Development's Programme for International Student Assessment (PISA), produce comparable international statistics and rankings on educational performance, and are influential practices that shape educational policy on a global scale. The chapters in this volume, written by expert researchers in the field, take the reader behind the scenes to document a broad range of ILSA practices – from the recruitment of countries into ILSAs, to the production and performance of large-scale testing, and the management, media reception and use of test data. Based on data that is only available to expert researchers with inside access, the international case study material includes examples from Australia, Ecuador, Germany, Japan, Mexico, Norway, Russia, Scotland, Slovenia, Sweden, the UK and the USA. The volume provides important insights for teachers, researchers and policy-makers who use and study assessment data and who wish to evaluate its significance for educational policy and practice.
Author: Olga Zlatkin-Troitschanskaia
Publisher: Springer Nature
ISBN: 3658278862
Category : Education
Languages : en
Pages : 427
Get Book Here
Book Description
This book offers a comprehensive overview of current, innovative approaches to assessing domain-specific and generic student learning and learning outcomes in higher education. The presented work from all projects of the KoKoHs program, the most significant research initiative in German higher education since 2011, describes established tools and empirical results.
Author: Teresa Neidorf
Publisher: Springer Nature
ISBN: 3030301885
Category : Education
Languages : en
Pages : 173
Get Book Here
Book Description
This open access report explores the nature and extent of students’ misconceptions and misunderstandings related to core concepts in physics and mathematics and physics across grades four, eight and 12. Twenty years of data from the IEA’s Trends in International Mathematics and Science Study (TIMSS) and TIMSS Advanced assessments are analyzed, specifically for five countries (Italy, Norway, Russian Federation, Slovenia, and the United States) who participated in all or almost all TIMSS and TIMSS Advanced assessments between 1995 and 2015. The report focuses on students’ understandings related to gravitational force in physics and linear equations in mathematics. It identifies some specific misconceptions, errors, and misunderstandings demonstrated by the TIMSS Advanced grade 12 students for these core concepts, and shows how these can be traced back to poor foundational development of these concepts in earlier grades. Patterns in misconceptions and misunderstandings are reported by grade, country, and gender. In addition, specific misconceptions and misunderstandings are tracked over time, using trend items administered in multiple assessment cycles. The study and associated methodology may enable education systems to help identify specific needs in the curriculum, improve inform instruction across grades and also raise possibilities for future TIMSS assessment design and reporting that may provide more diagnostic outcomes.
Author: Alina A. von Davier
Publisher: Springer Nature
ISBN: 3030743942
Category : Education
Languages : en
Pages : 265
Get Book Here
Book Description
This book defines and describes a new discipline, named “computational psychometrics,” from the perspective of new methodologies for handling complex data from digital learning and assessment. The editors and the contributing authors discuss how new technology drastically increases the possibilities for the design and administration of learning and assessment systems, and how doing so significantly increases the variety, velocity, and volume of the resulting data. Then they introduce methods and strategies to address the new challenges, ranging from evidence identification and data modeling to the assessment and prediction of learners’ performance in complex settings, as in collaborative tasks, game/simulation-based tasks, and multimodal learning and assessment tasks. Computational psychometrics has thus been defined as a blend of theory-based psychometrics and data-driven approaches from machine learning, artificial intelligence, and data science. All these together provide a better methodological framework for analysing complex data from digital learning and assessments. The term “computational” has been widely adopted by many other areas, as with computational statistics, computational linguistics, and computational economics. In those contexts, “computational” has a meaning similar to the one proposed in this book: a data-driven and algorithm-focused perspective on foundations and theoretical approaches established previously, now extended and, when necessary, reconceived. This interdisciplinarity is already a proven success in many disciplines, from personalized medicine that uses computational statistics to personalized learning that uses, well, computational psychometrics. We expect that this volume will be of interest not just within but beyond the psychometric community. In this volume, experts in psychometrics, machine learning, artificial intelligence, data science and natural language processing illustrate their work, showing how the interdisciplinary expertise of each researcher blends into a coherent methodological framework to deal with complex data from complex virtual interfaces. In the chapters focusing on methodologies, the authors use real data examples to demonstrate how to implement the new methods in practice. The corresponding programming codes in R and Python have been included as snippets in the book and are also available in fuller form in the GitHub code repository that accompanies the book.
Author: Markus J. Prutsch
Publisher: Springer
ISBN: 303011208X
Category : Political Science
Languages : en
Pages : 386
Get Book Here
Book Description
This study explores the dynamic relationship between science, numbers and politics. What can scientific evidence realistically do in and for politics? The volume contributes to that debate by focusing on the role of “numbers” as a means by which knowledge is expressed and through which that knowledge can be transferred into the political realm. Based on the assumption that numbers are constantly being actively created, translated, and used, and that they need to be interpreted in their respective and particular contexts, it examines how numbers and quantifications are made ‘politically workable’, examining their production, their transition into the sphere of politics and their eventual use therein. Key questions that are addressed include: In what ways does scientific evidence affect political decision-making in the contemporary world? How and why did quantification come to play such an important role within democratic politics? What kind of work do scientific evidence and numbers do politically?
Author: Jeremy Burrus
Publisher: Taylor & Francis
ISBN: 100059226X
Category : Education
Languages : en
Pages : 275
Get Book Here
Book Description
Assessing Competencies for Social and Emotional Learning explores the conceptualization, development, and application of assessments of competencies and contextual factors related to social and emotional learning (SEL). As programs designed to teach students social and emotional competencies are being adopted at an ever‐increasing rate, new measurements are needed to understand their impact on student attitudes, behaviors, and academic performance. This book integrates standards of fairness, reliability, and validity, and lessons learned from personality and attitude assessment to facilitate the principled development and use of SEL assessments. Education professionals, assessment developers, and researchers will be better prepared to systematically develop and evaluate measures of social and emotional competencies.
Author: Keith A. Markus
Publisher: Taylor & Francis
ISBN: 1040148891
Category : Psychology
Languages : en
Pages : 444
Get Book Here
Book Description
Now in its second edition, this important book examines test validity in the behavioral, social, and educational sciences by exploring three fundamental problems: measurement, causation, and meaning. Psychometric and philosophical perspectives and unresolved issues receive attention, as the authors explore how measurement is conceived from both the classical and modern perspectives. Split into three accessible sections, the first contrasts theories of measurement as applied to the validity of behavioral science measures, and the second considers causal theories of measurement as well as alternative theories of causation. The final section explores the meaning and interpretation of test scores as they apply to test validity, offering a conceptual overview of the field and its current state. Each carefully revised chapter begins with an overview of key theories and literature, concludes with a list of suggested readings, and features boxes with real-life situations that connect theory to practice. Examples of specific issues include: How tests can assess an attribute without measuring it. The role of values in test validity. Interpreting responses to the same question in different languages. Researchers, practitioners, and policy makers interested in test validity or developing tests will appreciate the book's cutting-edge review of test validity. Focusing on both the underlying concepts, as well as practical challenges of test construction and use, it also serves as a supplement in graduate or advanced undergraduate courses on test validity, psychometrics, testing, or measurement taught in psychology, education, sociology, social work, political science, business, criminal justice, and other fields. The book does not assume a background in measurement.
