2023-08-10: A Study on Reproducibility and Replicability of Table Structure Recognition Methods
Introduction The realm of concerns surrounding reproducibility, replicability, and generalizability (RR&G) of findings has gained substantial attention within the social and behavioral sciences as well as artificial intelligence (AI). While these concerns have evolved over the past decade and have seen recognition in top-tier journals, they have recently extended their reach into the field of AI. Inconsistencies in terminologies have led to the adoption of precise definitions from Goodman et al. (2016) [7]. Reproducibility refers to consistent computational results under the same conditions, replicability involves achieving consistent results on similar datasets, and generalizability pertains to consistent results across different experimental contexts. AI's reproducibility studies have mostly targeted empirical and computational AI, focusing on open datasets, code availability, and metadata documentation. However, efforts towards the replicability of AI research have remained...