Credibility, Validity, and Assumptions in Program Evaluation Methodology PDF Download
Are you looking for read ebook online? Search for your book and save it on your Kindle device, PC, phones or tablets. Download Credibility, Validity, and Assumptions in Program Evaluation Methodology PDF full book. Access full book title Credibility, Validity, and Assumptions in Program Evaluation Methodology by Apollo M. Nkwake. Download full books in PDF and EPUB format.
Author: Apollo M. Nkwake
Publisher:
ISBN: 9783319190228
Category :
Languages : en
Pages :
Get Book Here
Book Description
This book focuses on assumptions underlying methods choice in program evaluation. Credible program evaluation extends beyond the accuracy of research designs to include arguments justifying the appropriateness of methods. An important part of this justification is explaining the assumptions made about the validity of methods. This book provides a framework for understanding methodological assumptions, identifying the decisions made at each stage of the evaluation process, the major forms of validity affected by those decisions, and the preconditions for and assumptions about those validities. Though the selection of appropriate research methodology is not a new topic within social development research, previous publications suggest only advantages and disadvantages of using various methods and when to use them. This book goes beyond other publications to analyze the assumptions underlying actual methodological choices in evaluation studies and how these eventually influence evaluation quality. The analysis offered is supported by a collation of assumptions collected from a case study of 34 evaluations. Due to its in-depth analysis, strong theoretical basis, and practice examples, Credibility, Validity and Assumptions in Program Evaluation Methodology, is a must-have resource for researchers, students, university professors, and practitioners in program evaluation. Importantly, it provides tools for the application of appropriate research methods in program evaluation.
Author: Apollo M. Nkwake
Publisher:
ISBN: 9783319190228
Category :
Languages : en
Pages :
Get Book Here
Book Description
This book focuses on assumptions underlying methods choice in program evaluation. Credible program evaluation extends beyond the accuracy of research designs to include arguments justifying the appropriateness of methods. An important part of this justification is explaining the assumptions made about the validity of methods. This book provides a framework for understanding methodological assumptions, identifying the decisions made at each stage of the evaluation process, the major forms of validity affected by those decisions, and the preconditions for and assumptions about those validities. Though the selection of appropriate research methodology is not a new topic within social development research, previous publications suggest only advantages and disadvantages of using various methods and when to use them. This book goes beyond other publications to analyze the assumptions underlying actual methodological choices in evaluation studies and how these eventually influence evaluation quality. The analysis offered is supported by a collation of assumptions collected from a case study of 34 evaluations. Due to its in-depth analysis, strong theoretical basis, and practice examples, Credibility, Validity and Assumptions in Program Evaluation Methodology, is a must-have resource for researchers, students, university professors, and practitioners in program evaluation. Importantly, it provides tools for the application of appropriate research methods in program evaluation.
Author: Apollo M. Nkwake
Publisher: Springer Nature
ISBN: 3031456149
Category : Psychology
Languages : en
Pages : 199
Get Book Here
Book Description
This book focuses on methods of choice in program evaluation. Credible methods choice lies in the assumptions we make about the appropriateness and validity of selected methods and the validity of those assumptions. As evaluators make methodological decisions in various stages of the evaluation process, a number of validity questions arise. Yet unexamined assumptions are a risk to useful evaluation. The first edition of this book discussed the formulation of credible methodological arguments and methods of examining validity assumptions. However, previous publications suggest advantages and disadvantages of using various methods and when to use them. Instead, this book analyzes assumptions underlying actual methodological choices in evaluation studies and how these influence evaluation quality. This analysis is the basis of suggested tools. The second edition extends the review of methodological assumptions to the evaluation of humanitarian assistance. While evaluators of humanitarian action apply conventional research methods and standards, they have to adapt these methods to the challenges and constraints of crisis contexts. For example, the urgency and chaos of humanitarian emergencies makes it hard to obtain program documentation; objectives may be unclear, and early plans may quickly become outdated as the context changes or is clarified. The lack of up-to-date baseline data is not uncommon. Neither is staff turnover. Differences in perspective may intensify and undermine trust. The deviation from ideal circumstances challenges evaluation and calls for methodological innovation. And how do evaluators work with assumptions in non-ideal settings? What tools are most relevant and effective? This revised edition reviews major evaluations of humanitarian action and discusses strategies for working with evaluation assumptions in crises and stable program settings.
Author: Apollo M. Nkwake
Publisher: Springer Nature
ISBN: 3030330044
Category : Social Science
Languages : en
Pages : 223
Get Book Here
Book Description
This book discusses the crucial place that assumptions hold in conceptualizing, implementing, and evaluating development programs. It suggests simple ways for stakeholders and evaluators to 1) examine their assumptions about program theory and environmental conditions and 2) develop and carry out effective program monitoring and evaluation in light of those assumptions. A survey of evaluators from an international development agency reviewed the state of practice on assumptions-aware evaluation. This 2nd edition has been updated with further illustrations, case studies, and frameworks that have been researched and tested in the years since the first edition. Regardless of geography or goal, development programs and policies are fueled by a complex network of implicit ideas. Stakeholders may hold assumptions about purposes, outcomes, methodology, and the value of project evaluation and evaluators—which may or may not be shared by the evaluators. A major barrier to viable program evaluations is that development programs are based on assumptions that often are not well articulated. In designing programs, stakeholders often lack clear outlines for how implemented interventions will bring desired changes. This lack of clarity masks critical risks to program success and makes it challenging to evaluate such programs. Methods that have attempted to address this dilemma have been popularized as theory of change or other theory‐based approaches. Often, however, theory-based methods do not sufficiently clarify how program managers or evaluators should work with the assumptions inherent in the connections between the steps. The critical examination of assumptions in evaluation is essential for effective evaluations and evaluative thinking. "How does one think evaluatively? It all begins with assumptions. Systematically articulating, examining, and testing assumptions is the foundation of evaluative thinking... This book, more than any other, explains how to build a strong foundation for effective interventions and useful evaluation by rigorously working with assumptions." —Michael Quinn Patton, PhD. Author of Utilization-Focused Evaluation and co-editor of THOUGHTWORK: Thinking, Action, and the Fate of the World, USA. "This updated edition presents us with a new opportunity to delve into both the theoretical and practical aspects of paradigmatic, prescriptive, and causal assumptions. We need to learn, and apply these insights with the deep attention they deserve." —Zenda Ofir, PhD. Independent Evaluator, Richard von Weizsäcker Fellow, Robert Bosch Academy, Berlin, Germany. Honorary Professor, School of Public Leadership, Stellenbosch University, South Africa. “This thought-provoking book explains why assumptions are an essential condition within the theories and methodologies of evaluation; and how assumptions influence the ways that evaluators approach their work...It will enrich the ways that evaluators develop their models, devise their methodologies, interpret their data, and interact with their stakeholders.” —Jonny Morell, Ph.D., President, 4.669... Evaluation and Planning, Editor Emeritus, Evaluation and Program Planning
Author: Richard A. Berk
Publisher: SAGE
ISBN: 9780761917656
Category : Business & Economics
Languages : en
Pages : 140
Get Book Here
Book Description
Through the use of specific examples to illustrate evaluation research goals and methods, this book provides readers with an overview of the science and politics of evaluation research. The Second Edition includes coverage of meta-analysis, selection models and instrumental variables.
Author: E. Jane Davidson
Publisher: SAGE
ISBN: 9780761929307
Category : Reference
Languages : en
Pages : 284
Get Book Here
Book Description
Evaluation Methodology Basics introduces evaluation by focusing on the main kinds of 'big picture' questions that evaluations usually need to answer, and how the nature of such questions are linked to evaluation methodology choices. The author: shows how to identify the right criteria for your evaluation; discusses how to objectively figure out which criteria are more important than the others; and, delves into how to combine a mix of qualitative and quantitative data with 'relevant values' (such as needs) to draw explicitly evaluative conclusions.
Author: National Research Council
Publisher: National Academies Press
ISBN: 0309171342
Category : Social Science
Languages : en
Pages : 267
Get Book Here
Book Description
Reform of welfare is one of the nation's most contentious issues, with debate often driven more by politics than by facts and careful analysis. Evaluating Welfare Reform in an Era of Transition identifies the key policy questions for measuring whether our changing social welfare programs are working, reviews the available studies and research, and recommends the most effective ways to answer those questions. This book discusses the development of welfare policy, including the landmark 1996 federal law that devolved most of the responsibility for welfare policies and their implementation to the states. A thorough analysis of the available research leads to the identification of gaps in what is currently known about the effects of welfare reform. Evaluating Welfare Reform in an Era of Transition specifies what-and why-we need to know about the response of individual states to the federal overhaul of welfare and the effects of the many changes in the nation's welfare laws, policies, and practices. With a clear approach to a variety of issues, Evaluating Welfare Reform in an Era of Transition will be important to policy makers, welfare administrators, researchers, journalists, and advocates on all sides of the issue.
Author: Jorge Manzi
Publisher: Springer Nature
ISBN: 3030783901
Category : Education
Languages : en
Pages : 453
Get Book Here
Book Description
This edited volume presents a systematic analysis of conceptual, methodological and applied aspects related to the validation of educational tests used in Latin American countries. Inspired by international standards on educational measurement and evaluation, this book illustrates efforts that have been made in several countries to validate different types of educational assessments, including student learning assessments, measurements of non-cognitive aspects in students, teacher evaluations, and tests for certification and selection. It gathers the experience of validity studies from the main international assessments in Latin America (PISA, TIMSS, ERCE, and ICCS). Additionally, it shows the challenges that must be taken into account when evaluations are used to compare countries, groups or trends of achievement over time. The book builds on the premise that measurements in the educational field should not be used if there are no studies that support the validity of the interpretation of their scores, or the use made of such tests. It shows that, despite the recognition given to validity, relatively few educational measurement assessments have accumulated enough evidence to support their interpretation and use. In doing so, this volume increases awareness about the relevance of validity, especially when assessments are key component of educational policies.
Author: Mohammed Abu-Nimer
Publisher: Walter de Gruyter GmbH & Co KG
ISBN: 3110625083
Category : Religion
Languages : en
Pages : 137
Get Book Here
Book Description
In the emerging fields of religious and interreligious peacebuilding, the question of monitoring and evaluation is a challenging, yet necessary process. The need to develop comprehensive yet fitting evaluation models for religious and interreligious peacebuilding is not only important for donor interests, but also critical as a means of documenting and learning for peacebuilders themselves. Theories and best practices in monitoring and evaluation have become prevalent in many fields, yet the amount of literature on evaluating intercultural and, especially, religious and interreligious projects remains scant in comparison. This volume offers a unique contribution that not only looks at several of the challenges and implications faced by religious and interreligious peacebuilders but also provides concrete examples of new models and tools for monitoring and evaluating religious and interreligious peacebuilding projects. In doing so, this volume serves as a tool and point of reference for individuals and organizations developing and implementing interreligious dialogue and peacebuilding projects.
Author: Donna M. Mertens
Publisher: John Wiley & Sons
ISBN: 1118720458
Category : Education
Languages : en
Pages : 154
Get Book Here
Book Description
Mixed methods in evaluation have the potential to enhance the credibility of evaluation and the outcomes of evaluation. This issue explores advances in understanding mixed methods in philosophical, theoretical, and methodological terms and presents specific illustrations of the application of these concepts in evaluation practice. Leading thinkers in the mixed methods evaluation community provide frameworks and strategies that are associated with improving the probability of reaching the goals of enhanced credibility for evaluations, the evidence they produce, and the actions taken as a result of the evaluation findings. This is the 138th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.
Author: Donna M. Mertens
Publisher: Guilford Press
ISBN: 1462503241
Category : Social Science
Languages : en
Pages : 642
Get Book Here
Book Description
This engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from them to evaluation practice. Featuring helpful checklists, procedural steps, provocative questions that invite readers to explore their own theoretical assumptions, and practical exercises, the book provides concrete guidance for conducting large- and small-scale evaluations. Numerous sample studies—many with reflective commentary from the evaluators—reveal the process through which an evaluator incorporates a paradigm into an actual research project. The book shows how theory informs methodological choices (the specifics of planning, implementing, and using evaluations). It offers balanced coverage of quantitative, qualitative, and mixed methods approaches. Useful pedagogical features include: *Examples of large- and small-scale evaluations from multiple disciplines. *Beginning-of-chapter reflection questions that set the stage for the material covered. *"Extending your thinking" questions and practical activities that help readers apply particular theoretical paradigms in their own evaluation projects. *Relevant Web links, including pathways to more details about sampling, data collection, and analysis. *Boxes offering a closer look at key evaluation concepts and additional studies. *Checklists for readers to determine if they have followed recommended practice. *A companion website with resources for further learning.
