The assessment of replication success based on relative effect size
Explore this paper's citation graph
Summary
The purpose of this paper is to refine and extend a recently proposed reverse-Bayes approach for the analysis of replication studies, and shows how this method is directly related to the relative effect size, the ratio of the replication to the original effect estimate.
- Type
- preprint
- Published
- 2020-09-16
- Cited by
- 28
- References
- 45
- Access
- Open access
- OpenAlex
- https://openalex.org/W3086458689
- Semantic Scholar
- https://api.semanticscholar.org/CorpusID:221738905
Keywords
Replication (statistics), Sample size determination, Computer science, Sample (material), Statistics
References
- How to say no: single- and dual-process theories of short-term recognition tested on negative probes.
- 014: On the "Probable Error" of a Coefficient of Correlation Deduced from a Small Sample.
- What is Reproducibility
- Sampling and Bayes' inference in scientific modelling and robustness
- Estimating the reproducibility of psychological science
- Investigating Variation in Replicability: A “Many Labs” Replication Project
- Why do implicit and explicit attitude tests diverge? The role of structural fit.
- Why should clinicians care about Bayesian methods
- Statistical Thinking for Non-statisticians in Drug Regulation
- Folk Intuitions on Free Will
- The Well-Calibrated Bayesian
- Bayesianly Justifiable and Relevant Frequency Calculations for the Applied Statistician
- RECONSIDERING SOME ASPECTS OF THE TWO-TRIALS PARADIGM
- Why Testing Improves Memory: Mediator Effectiveness Hypothesis
- Affirmative Action Policies Promote Women and Do Not Harm Efficiency in the Laboratory
- Methods for Assessing the Credibility of Clinical Trial Outcomes
- Why should clinicians care about Bayesian methods
- On the Probable Error of the Correlation Coefficient to a Second Approximation
- Statistical issues in drug development (2nd edn). Stephen Senn, John Wiley & Sons Ltd, Chichester, 2007. No. of pages: xix + 498. Price: $130.00. ISBN 978‐0‐470‐01877‐4
- The Stroop effect: why proportion congruent has nothing to do with congruency and everything to do with contingency.
Cited by
- The sceptical Bayes factor for the assessment of replication success
- How best to quantify replication success? A simulation study on the comparison of replication success metrics
- Comment on “The Role of p-Values in Judging the Strength of Evidence and Realistic Replication Expectations”
- Statistical review of animal trials—A guideline
- Reverse‐Bayes methods for evidence assessment and research synthesis
- Assessing replicability with the sceptical p p ‐value: Type‐I error control and sample size planning
- DESIGN DIFFERENCES EXPLAIN VARIATION IN RESULTS BETWEEN RANDOMIZED TRIALS AND THEIR NON-RANDOMIZED EMULATIONS
- Bayesian approaches to designing replication studies.
- Estimating the false discovery risk of (randomized) clinical trials in medical journals based on published p-values
- Power priors for replication studies
- Replication Success Under Questionable Research Practices—a Simulation Study
- A Comparison of Methods for Synthesizing Results from Previous Research to Obtain Priors for Bayesian Structural Equation Modeling
- Design differences and variation in results between randomised trials and non-randomised emulations: meta-analysis of RCT-DUPLICATE data
- The assessment of replicability using the sum of p-values
- Evaluating meta-analysis as a replication success measure
- To Tweak or Not to Tweak. How Exploiting Flexibilities in Gene Set Analysis Leads to Overoptimism
- Assessing the replicability of RCTs in RWE emulations
- Trends of replication studies in Applied Linguistics journals: A systematic review over half a century
- Meta-regression to explain shrinkage and heterogeneity in large-scale replication projects
- Evaluating the applicability of replication success metrics in animal-to-human translation: A simulation study
Related papers
- Probabilistic forecasting of replication studies
- Factor Selection in Hedge Fund Replication Dynamic Models
- Iterative versus Exhaustive Data Selection for Cross Project Defect Prediction: An Extended Replication Study
- Testing gene-environment interaction in large-scale case-control association studies: possible choices and comparisons.
- A novel, unbiased approach to evaluating subsequent search misses in dual target visual search