Investigating Variation in Replicability

Investigating Variation in Replicability PDF Author: Richard A. Klein
Publisher:
ISBN:
Category :
Languages : en
Pages : 31

Get Book Here

Book Description
Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of thirteen classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, ten effects replicated consistently. One effect - imagined contact reducing prejudice - showed weak support for replicability. And two effects - flag priming influencing conservatism and currency priming influencing system justification - did not replicate. We compared whether the conditions such as lab versus online or U.S. versus international sample predicted effect magnitudes. By and large they did not. The results of this small sample of effects suggest that replicability is more dependent on the effect itself than on the sample and setting used to investigate the effect.

Investigating Variation in Replicability

Investigating Variation in Replicability PDF Author: Richard A. Klein
Publisher:
ISBN:
Category :
Languages : en
Pages : 31

Get Book Here

Book Description
Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of thirteen classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, ten effects replicated consistently. One effect - imagined contact reducing prejudice - showed weak support for replicability. And two effects - flag priming influencing conservatism and currency priming influencing system justification - did not replicate. We compared whether the conditions such as lab versus online or U.S. versus international sample predicted effect magnitudes. By and large they did not. The results of this small sample of effects suggest that replicability is more dependent on the effect itself than on the sample and setting used to investigate the effect.

Reproducibility and Replicability in Science

Reproducibility and Replicability in Science PDF Author: National Academies of Sciences, Engineering, and Medicine
Publisher: National Academies Press
ISBN: 0309486165
Category : Science
Languages : en
Pages : 257

Get Book Here

Book Description
One of the pathways by which the scientific community confirms the validity of a new scientific discovery is by repeating the research that produced it. When a scientific effort fails to independently confirm the computations or results of a previous study, some fear that it may be a symptom of a lack of rigor in science, while others argue that such an observed inconsistency can be an important precursor to new discovery. Concerns about reproducibility and replicability have been expressed in both scientific and popular media. As these concerns came to light, Congress requested that the National Academies of Sciences, Engineering, and Medicine conduct a study to assess the extent of issues related to reproducibility and replicability and to offer recommendations for improving rigor and transparency in scientific research. Reproducibility and Replicability in Science defines reproducibility and replicability and examines the factors that may lead to non-reproducibility and non-replicability in research. Unlike the typical expectation of reproducibility between two computations, expectations about replicability are more nuanced, and in some cases a lack of replicability can aid the process of scientific discovery. This report provides recommendations to researchers, academic institutions, journals, and funders on steps they can take to improve reproducibility and replicability in science.

Towards Bayesian Model-Based Demography

Towards Bayesian Model-Based Demography PDF Author: Jakub Bijak
Publisher: Springer Nature
ISBN: 303083039X
Category : Social Science
Languages : en
Pages : 277

Get Book Here

Book Description
This open access book presents a ground-breaking approach to developing micro-foundations for demography and migration studies. It offers a unique and novel methodology for creating empirically grounded agent-based models of international migration – one of the most uncertain population processes and a top-priority policy area. The book discusses in detail the process of building a simulation model of migration, based on a population of intelligent, cognitive agents, their networks and institutions, all interacting with one another. The proposed model-based approach integrates behavioural and social theory with formal modelling, by embedding the interdisciplinary modelling process within a wider inductive framework based on the Bayesian statistical reasoning. Principles of uncertainty quantification are used to devise innovative computer-based simulations, and to learn about modelling the simulated individuals and the way they make decisions. The identified knowledge gaps are subsequently filled with information from dedicated laboratory experiments on cognitive aspects of human decision-making under uncertainty. In this way, the models are built iteratively, from the bottom up, filling an important epistemological gap in migration studies, and social sciences more broadly.

Advanced Research Methods for the Social and Behavioral Sciences

Advanced Research Methods for the Social and Behavioral Sciences PDF Author: John E. Edlund
Publisher: Cambridge University Press
ISBN: 1108425933
Category : Psychology
Languages : en
Pages : 389

Get Book Here

Book Description
Written by an interdisciplinary team of global experts, this book is an invaluable tool for anyone learning about research methods.

Statistical Challenges in Assessing and Fostering the Reproducibility of Scientific Results

Statistical Challenges in Assessing and Fostering the Reproducibility of Scientific Results PDF Author: National Academies of Sciences, Engineering, and Medicine
Publisher: National Academies Press
ISBN: 0309392020
Category : Mathematics
Languages : en
Pages : 133

Get Book Here

Book Description
Questions about the reproducibility of scientific research have been raised in numerous settings and have gained visibility through several high-profile journal and popular press articles. Quantitative issues contributing to reproducibility challenges have been considered (including improper data measurement and analysis, inadequate statistical expertise, and incomplete data, among others), but there is no clear consensus on how best to approach or to minimize these problems. A lack of reproducibility of scientific results has created some distrust in scientific findings among the general public, scientists, funding agencies, and industries. While studies fail for a variety of reasons, many factors contribute to the lack of perfect reproducibility, including insufficient training in experimental design, misaligned incentives for publication and the implications for university tenure, intentional manipulation, poor data management and analysis, and inadequate instances of statistical inference. The workshop summarized in this report was designed not to address the social and experimental challenges but instead to focus on the latter issues of improper data management and analysis, inadequate statistical expertise, incomplete data, and difficulties applying sound statistic inference to the available data. Many efforts have emerged over recent years to draw attention to and improve reproducibility of scientific work. This report uniquely focuses on the statistical perspective of three issues: the extent of reproducibility, the causes of reproducibility failures, and the potential remedies for these failures.

Avoiding Questionable Research Practices in Applied Psychology

Avoiding Questionable Research Practices in Applied Psychology PDF Author: William O'Donohue
Publisher: Springer Nature
ISBN: 3031049683
Category : Psychology
Languages : en
Pages : 439

Get Book Here

Book Description
This authoritative volume presents a detailed analysis of the replication crisis and the use of questionable research practices (QRPs) in psychology, as well as recommended practices for combatting these problems. Ultimately, the book aims to provide a comprehensive, current, and accessible account of the adverse effects of QRPs. The replication crisis in psychology and allied fields has exposed critical flaws in the standard views of research methods, which allow for extensive flexibility in data analysis by investigators and permit the widespread use of QRPs. Chapters examine the intentional use of QRPs such as data fabrication and falsification, along with subtler, unintentional practices such as p-hacking and HARKING (hypothesizing after results are known). Drawing on the growing awareness of these problems, contributors also highlight potential strategies to detect QRPs and minimize their negative impact through open data practices, preregistration of hypotheses and analyses, and adversarial collaborations, in which investigators holding opposing positions on a scientific issue agree to work together on a study in an effort to counteract their respective biases. Among the topics covered: History of controversies in statistics and replication Embracing intellectual humility while designing research Confirmatory vs. exploratory analyses Publication bias and negative results Promoting honest and transparent report writing Avoiding Questionable Research Practices in Applied Psychology provides a deeper understanding of how QRPs impede the reliability and trustworthiness of findings in psychology and the social sciences. It will be a practical, useful resource for students and instructors in graduate and advanced undergraduate level research methods classes, along with psychological researchers interested in improving their own research.

Reproducibility and Replicability in Science

Reproducibility and Replicability in Science PDF Author: National Academies of Sciences, Engineering, and Medicine
Publisher: National Academies Press
ISBN: 030948619X
Category : Science
Languages : en
Pages : 257

Get Book Here

Book Description
One of the pathways by which the scientific community confirms the validity of a new scientific discovery is by repeating the research that produced it. When a scientific effort fails to independently confirm the computations or results of a previous study, some fear that it may be a symptom of a lack of rigor in science, while others argue that such an observed inconsistency can be an important precursor to new discovery. Concerns about reproducibility and replicability have been expressed in both scientific and popular media. As these concerns came to light, Congress requested that the National Academies of Sciences, Engineering, and Medicine conduct a study to assess the extent of issues related to reproducibility and replicability and to offer recommendations for improving rigor and transparency in scientific research. Reproducibility and Replicability in Science defines reproducibility and replicability and examines the factors that may lead to non-reproducibility and non-replicability in research. Unlike the typical expectation of reproducibility between two computations, expectations about replicability are more nuanced, and in some cases a lack of replicability can aid the process of scientific discovery. This report provides recommendations to researchers, academic institutions, journals, and funders on steps they can take to improve reproducibility and replicability in science.

Fostering Integrity in Research

Fostering Integrity in Research PDF Author: National Academies of Sciences, Engineering, and Medicine
Publisher: National Academies Press
ISBN: 0309391253
Category : Science
Languages : en
Pages : 327

Get Book Here

Book Description
The integrity of knowledge that emerges from research is based on individual and collective adherence to core values of objectivity, honesty, openness, fairness, accountability, and stewardship. Integrity in science means that the organizations in which research is conducted encourage those involved to exemplify these values in every step of the research process. Understanding the dynamics that support â€" or distort â€" practices that uphold the integrity of research by all participants ensures that the research enterprise advances knowledge. The 1992 report Responsible Science: Ensuring the Integrity of the Research Process evaluated issues related to scientific responsibility and the conduct of research. It provided a valuable service in describing and analyzing a very complicated set of issues, and has served as a crucial basis for thinking about research integrity for more than two decades. However, as experience has accumulated with various forms of research misconduct, detrimental research practices, and other forms of misconduct, as subsequent empirical research has revealed more about the nature of scientific misconduct, and because technological and social changes have altered the environment in which science is conducted, it is clear that the framework established more than two decades ago needs to be updated. Responsible Science served as a valuable benchmark to set the context for this most recent analysis and to help guide the committee's thought process. Fostering Integrity in Research identifies best practices in research and recommends practical options for discouraging and addressing research misconduct and detrimental research practices.

Investigating Variation

Investigating Variation PDF Author: Intermediate Science Curriculum Study Program
Publisher:
ISBN:
Category : Correlation (Statistics)
Languages : en
Pages : 54

Get Book Here

Book Description


Research in Personnel and Human Resources Management

Research in Personnel and Human Resources Management PDF Author: M. Ronald Buckley
Publisher: Emerald Group Publishing
ISBN: 1837533903
Category : Business & Economics
Languages : en
Pages : 304

Get Book Here

Book Description
Contributions include an analysis of professional touching behaviour, ideas about the state of our science in HRM, novel integration of work-life flexibility issues, processes that occur in expatriate turnover, and suggestions concerning the state of human resource process research.