Web Science and Digital Libraries Research Group

  According to a report published by National Academies of Sciences, Engineering, and Medicine , " reproducibility refers to instances in which the original researcher's data and computer codes are used to regenerate the results, while replicability refers to instances in which a researcher collects new data to arrive at the same scientific findings as a previous study." In this blog, we will focus on several milestone papers for replicability assessment of SBS  (social and behavioral sciences)  papers. SBS  includes psychology, economics, politics, sociology, etc. SBS papers typically use statistical testing to test hypotheses. A p-value below a significance level (typically 0.05) can be used as evidence to exclude the null hypothesis. However, as pointed out by a previous study , a p-value provides only  partial information about the probability of a tested hypothesis being true.  Statistically significant results from small  studies are ...