Credibility, Validity, and Assumptions in Program Evaluation Methodology PDF Download
Are you looking for read ebook online? Search for your book and save it on your Kindle device, PC, phones or tablets. Download Credibility, Validity, and Assumptions in Program Evaluation Methodology PDF full book. Access full book title Credibility, Validity, and Assumptions in Program Evaluation Methodology by Apollo M. Nkwake. Download full books in PDF and EPUB format.
Author: Apollo M. Nkwake
Publisher:
ISBN: 9783319190228
Category :
Languages : en
Pages :
Get Book
Book Description
This book focuses on assumptions underlying methods choice in program evaluation. Credible program evaluation extends beyond the accuracy of research designs to include arguments justifying the appropriateness of methods. An important part of this justification is explaining the assumptions made about the validity of methods. This book provides a framework for understanding methodological assumptions, identifying the decisions made at each stage of the evaluation process, the major forms of validity affected by those decisions, and the preconditions for and assumptions about those validities. Though the selection of appropriate research methodology is not a new topic within social development research, previous publications suggest only advantages and disadvantages of using various methods and when to use them. This book goes beyond other publications to analyze the assumptions underlying actual methodological choices in evaluation studies and how these eventually influence evaluation quality. The analysis offered is supported by a collation of assumptions collected from a case study of 34 evaluations. Due to its in-depth analysis, strong theoretical basis, and practice examples, Credibility, Validity and Assumptions in Program Evaluation Methodology, is a must-have resource for researchers, students, university professors, and practitioners in program evaluation. Importantly, it provides tools for the application of appropriate research methods in program evaluation.
Author: Apollo M. Nkwake
Publisher:
ISBN: 9783319190228
Category :
Languages : en
Pages :
Get Book
Book Description
This book focuses on assumptions underlying methods choice in program evaluation. Credible program evaluation extends beyond the accuracy of research designs to include arguments justifying the appropriateness of methods. An important part of this justification is explaining the assumptions made about the validity of methods. This book provides a framework for understanding methodological assumptions, identifying the decisions made at each stage of the evaluation process, the major forms of validity affected by those decisions, and the preconditions for and assumptions about those validities. Though the selection of appropriate research methodology is not a new topic within social development research, previous publications suggest only advantages and disadvantages of using various methods and when to use them. This book goes beyond other publications to analyze the assumptions underlying actual methodological choices in evaluation studies and how these eventually influence evaluation quality. The analysis offered is supported by a collation of assumptions collected from a case study of 34 evaluations. Due to its in-depth analysis, strong theoretical basis, and practice examples, Credibility, Validity and Assumptions in Program Evaluation Methodology, is a must-have resource for researchers, students, university professors, and practitioners in program evaluation. Importantly, it provides tools for the application of appropriate research methods in program evaluation.
Author: Apollo M. Nkwake
Publisher: Springer Nature
ISBN: 3031456149
Category : Psychology
Languages : en
Pages : 199
Get Book
Book Description
This book focuses on methods of choice in program evaluation. Credible methods choice lies in the assumptions we make about the appropriateness and validity of selected methods and the validity of those assumptions. As evaluators make methodological decisions in various stages of the evaluation process, a number of validity questions arise. Yet unexamined assumptions are a risk to useful evaluation. The first edition of this book discussed the formulation of credible methodological arguments and methods of examining validity assumptions. However, previous publications suggest advantages and disadvantages of using various methods and when to use them. Instead, this book analyzes assumptions underlying actual methodological choices in evaluation studies and how these influence evaluation quality. This analysis is the basis of suggested tools. The second edition extends the review of methodological assumptions to the evaluation of humanitarian assistance. While evaluators of humanitarian action apply conventional research methods and standards, they have to adapt these methods to the challenges and constraints of crisis contexts. For example, the urgency and chaos of humanitarian emergencies makes it hard to obtain program documentation; objectives may be unclear, and early plans may quickly become outdated as the context changes or is clarified. The lack of up-to-date baseline data is not uncommon. Neither is staff turnover. Differences in perspective may intensify and undermine trust. The deviation from ideal circumstances challenges evaluation and calls for methodological innovation. And how do evaluators work with assumptions in non-ideal settings? What tools are most relevant and effective? This revised edition reviews major evaluations of humanitarian action and discusses strategies for working with evaluation assumptions in crises and stable program settings.
Author: Apollo M. Nkwake
Publisher: Springer Nature
ISBN: 3030330044
Category : Social Science
Languages : en
Pages : 212
Get Book
Book Description
This book discusses the crucial place that assumptions hold in conceptualizing, implementing, and evaluating development programs. It suggests simple ways for stakeholders and evaluators to 1) examine their assumptions about program theory and environmental conditions and 2) develop and carry out effective program monitoring and evaluation in light of those assumptions. A survey of evaluators from an international development agency reviewed the state of practice on assumptions-aware evaluation. This 2nd edition has been updated with further illustrations, case studies, and frameworks that have been researched and tested in the years since the first edition. Regardless of geography or goal, development programs and policies are fueled by a complex network of implicit ideas. Stakeholders may hold assumptions about purposes, outcomes, methodology, and the value of project evaluation and evaluators—which may or may not be shared by the evaluators. A major barrier to viable program evaluations is that development programs are based on assumptions that often are not well articulated. In designing programs, stakeholders often lack clear outlines for how implemented interventions will bring desired changes. This lack of clarity masks critical risks to program success and makes it challenging to evaluate such programs. Methods that have attempted to address this dilemma have been popularized as theory of change or other theory‐based approaches. Often, however, theory-based methods do not sufficiently clarify how program managers or evaluators should work with the assumptions inherent in the connections between the steps. The critical examination of assumptions in evaluation is essential for effective evaluations and evaluative thinking. "How does one think evaluatively? It all begins with assumptions. Systematically articulating, examining, and testing assumptions is the foundation of evaluative thinking... This book, more than any other, explains how to build a strong foundation for effective interventions and useful evaluation by rigorously working with assumptions." —Michael Quinn Patton, PhD. Author of Utilization-Focused Evaluation and co-editor of THOUGHTWORK: Thinking, Action, and the Fate of the World, USA. "This updated edition presents us with a new opportunity to delve into both the theoretical and practical aspects of paradigmatic, prescriptive, and causal assumptions. We need to learn, and apply these insights with the deep attention they deserve." —Zenda Ofir, PhD. Independent Evaluator, Richard von Weizsäcker Fellow, Robert Bosch Academy, Berlin, Germany. Honorary Professor, School of Public Leadership, Stellenbosch University, South Africa. “This thought-provoking book explains why assumptions are an essential condition within the theories and methodologies of evaluation; and how assumptions influence the ways that evaluators approach their work...It will enrich the ways that evaluators develop their models, devise their methodologies, interpret their data, and interact with their stakeholders.” —Jonny Morell, Ph.D., President, 4.669... Evaluation and Planning, Editor Emeritus, Evaluation and Program Planning
Author: William R. Shadish
Publisher: SAGE
ISBN: 9780803953017
Category : Social Science
Languages : en
Pages : 544
Get Book
Book Description
Foundations of Program Evaluationheralds a thorough exploration of the field of program evaluation--looking back on its origins. By summarizing, comparing, and contrasting the work of seven major theorists of program evaluation, this book provides an important perspective on the current state of evaluation theory and provides suggestions for ways of improving its practice. Beginning in Chapter Two, the authors develop a conceptual framework to analyze how successfully each theory meets the specific criteria of its framework. Each subsequent chapter is devoted to the presentation of the theoretical and practical advice of a significant theorist--Michael Scriven, Donald Campbell, Carol Weiss, Joseph Wholey, Robert Stake, Lee Cronbach, and Peter Rossi.
Author: Jorge Manzi
Publisher: Springer Nature
ISBN: 3030783901
Category : Education
Languages : en
Pages : 453
Get Book
Book Description
This edited volume presents a systematic analysis of conceptual, methodological and applied aspects related to the validation of educational tests used in Latin American countries. Inspired by international standards on educational measurement and evaluation, this book illustrates efforts that have been made in several countries to validate different types of educational assessments, including student learning assessments, measurements of non-cognitive aspects in students, teacher evaluations, and tests for certification and selection. It gathers the experience of validity studies from the main international assessments in Latin America (PISA, TIMSS, ERCE, and ICCS). Additionally, it shows the challenges that must be taken into account when evaluations are used to compare countries, groups or trends of achievement over time. The book builds on the premise that measurements in the educational field should not be used if there are no studies that support the validity of the interpretation of their scores, or the use made of such tests. It shows that, despite the recognition given to validity, relatively few educational measurement assessments have accumulated enough evidence to support their interpretation and use. In doing so, this volume increases awareness about the relevance of validity, especially when assessments are key component of educational policies.
Author: Mohammed Abu-Nimer
Publisher: Walter de Gruyter GmbH & Co KG
ISBN: 3110625083
Category : Religion
Languages : en
Pages : 137
Get Book
Book Description
In the emerging fields of religious and interreligious peacebuilding, the question of monitoring and evaluation is a challenging, yet necessary process. The need to develop comprehensive yet fitting evaluation models for religious and interreligious peacebuilding is not only important for donor interests, but also critical as a means of documenting and learning for peacebuilders themselves. Theories and best practices in monitoring and evaluation have become prevalent in many fields, yet the amount of literature on evaluating intercultural and, especially, religious and interreligious projects remains scant in comparison. This volume offers a unique contribution that not only looks at several of the challenges and implications faced by religious and interreligious peacebuilders but also provides concrete examples of new models and tools for monitoring and evaluating religious and interreligious peacebuilding projects. In doing so, this volume serves as a tool and point of reference for individuals and organizations developing and implementing interreligious dialogue and peacebuilding projects.
Author: National Research Council
Publisher: National Academies Press
ISBN: 0309171342
Category : Social Science
Languages : en
Pages : 267
Get Book
Book Description
Reform of welfare is one of the nation's most contentious issues, with debate often driven more by politics than by facts and careful analysis. Evaluating Welfare Reform in an Era of Transition identifies the key policy questions for measuring whether our changing social welfare programs are working, reviews the available studies and research, and recommends the most effective ways to answer those questions. This book discusses the development of welfare policy, including the landmark 1996 federal law that devolved most of the responsibility for welfare policies and their implementation to the states. A thorough analysis of the available research leads to the identification of gaps in what is currently known about the effects of welfare reform. Evaluating Welfare Reform in an Era of Transition specifies what-and why-we need to know about the response of individual states to the federal overhaul of welfare and the effects of the many changes in the nation's welfare laws, policies, and practices. With a clear approach to a variety of issues, Evaluating Welfare Reform in an Era of Transition will be important to policy makers, welfare administrators, researchers, journalists, and advocates on all sides of the issue.
Author: Kathryn E. Newcomer
Publisher: John Wiley & Sons
ISBN: 1118893697
Category : Business & Economics
Languages : en
Pages : 912
Get Book
Book Description
The leading program evaluation reference, updated with the latest tools and techniques The Handbook of Practical Program Evaluation provides tools for managers and evaluators to address questions about the performance of public and nonprofit programs. Neatly integrating authoritative, high-level information with practicality and readability, this guide gives you the tools and processes you need to analyze your program's operations and outcomes more accurately. This new fourth edition has been thoroughly updated and revised, with new coverage of the latest evaluation methods, including: Culturally responsive evaluation Adopting designs and tools to evaluate multi-service community change programs Using role playing to collect data Using cognitive interviewing to pre-test surveys Coding qualitative data You'll discover robust analysis methods that produce a more accurate picture of program results, and learn how to trace causality back to the source to see how much of the outcome can be directly attributed to the program. Written by award-winning experts at the top of the field, this book also contains contributions from the leading evaluation authorities among academics and practitioners to provide the most comprehensive, up-to-date reference on the topic. Valid and reliable data constitute the bedrock of accurate analysis, and since funding relies more heavily on program analysis than ever before, you cannot afford to rely on weak or outdated methods. This book gives you expert insight and leading edge tools that help you paint a more accurate picture of your program's processes and results, including: Obtaining valid, reliable, and credible performance data Engaging and working with stakeholders to design valuable evaluations and performance monitoring systems Assessing program outcomes and tracing desired outcomes to program activities Providing robust analyses of both quantitative and qualitative data Governmental bodies, foundations, individual donors, and other funding bodies are increasingly demanding information on the use of program funds and program results. The Handbook of Practical Program Evaluation shows you how to collect and present valid and reliable data about programs.
Author: Dr.V.V.L.N. Sastry
Publisher: Idea Publishing
ISBN:
Category : Business & Economics
Languages : en
Pages : 212
Get Book
Book Description
Brexit will lead to fundamental changes in the trade relations between the UK and other nations. It would pose a challenge to countries such as India that use the UK as a gateway into the EU. The loss of the Single Market would also pose a challenge to the UK and the EU. It is too early to tell how the economic rivalry between the UK and the EU will play out in the long run. Developing economies that depended on the EU are bound to be affected by the rivalry. India is one of the countries that would be affected by the economic rivalry. The paper uses a review method to determine the impact of Brexit on Indian companies both at the local and international level. It undertakes a review of some of the largest companies in India. These companies operate in industries that are bound to be affected by Brexit. Therefore, an analysis of the impact of Brexit on these companies would depict the impact of Brexit on India as a case study. The results of the paper show that India would have a positive net effect from Brexit regardless of the fact that Brexit may lead to losses in trade between the UK and India. As India is the source of FDI of the UK, Brexit would result in making other countries in the EU attractive destinations of the FDI. To avoid losing out, the UK would try harder to ensure that more capital comes from India. The UK may do this by wooing Indian companies to ensure they invest in the UK It may provide tax breaks and other incentives. Nevertheless, it is vital for India to form stronger ties with the EU since the UK has been India’s gateway to the EU. This will provide India with a wider access to the EU market. Loss of subsidies for EU students to study in the UK would necessitate the country to look for an alternative source of students. India is one of the markets that the UK would explore in the aftermath of Brexit.
Author: Douglas H. Sprenkle
Publisher: Guilford Press
ISBN: 160918114X
Category : Psychology
Languages : en
Pages : 473
Get Book
Book Description
In this widely adopted text and professional reference, leading contributors provide the knowledge needed to design strong qualitative, quantitative, and mixed-method studies; analyze the resulting data; and translate findings into improved practices and programs. Following a consistent format, user-friendly chapters thoroughly describe the various methodologies and illustrate their applications with helpful concrete examples.
