We assess how geographers perceive reproducibility and replicability, and to what extent they implement reproducible research practices and attempt reproduction or replication studies. We attempt to reproduce and replicate geographic studies with important societal impacts and/or intellectual merit contributions to the discipline. We also integrate teaching reproducible research practices and attempting reproduction and replication studies into geography curricula at the undergraduate and graduate levels, developing and testing pedagogy to train the next generation of researchers.
Open Science Infrastructure and Model Research Projects
Key Publications
- Kedron, P., Holler, J., & Bardin, S. (2024). Reproducible Research Practices and Barriers to Reproducible Research in Geography: Insights from a Survey. Annals of the American Association of Geographers 114 (2):369–386 DOI:10.1080/24694452.2023.2276115.
- A survey of geographic researchers assessing their understanding of reproducible research and reproducible research practices. Key findings include 1) researchers conflate definitions of reproduction and replication, 2) sub-disciplinary variation in the perceived value of reproduction, and that 3) very few attempt and publish reproduction studies.
- Data Visualization, OSF Project, and GitHub Repository
- Kedron, P., Holler, J. & Bardin, S. (2025). A Survey of Researcher Perceptions of Replication in Geography. Annals of the American Association of Geographers 115 (1): 184–204. DOI:10.1080/24694452.2024.2415695.
- A survey of geographic researchers assessing their understanding of replicable research and replicable research practices. Key findings include 1) researchers conflate definitions of reproduction and replication, 2) large support for important epistemic and pedagogical roles for replication, and 3) low confidence in the replicability of geographic research.
- Data Visualization, OSF Project, and GitHub Repository
- Kedron, P., Bardin, S., Holler, J., Gilman, J., Grady, B., Seeley, M., Wang, X. and Yang, W. (2023). A Framework for Moving Beyond Computational Reproducibility: Lessons from Three Reproductions of Geographical Analyses of COVID-19. Geographical Analysis. DOI:10.1111/gean.12370
- Presents the practical framework and associated template for our approach to conducting reproduction and replication studies. Include three example reproductions of spatial analyses of COVID-19, which are linked to completed, open access project repositories.
- Kedron, P., & Holler, J. (2022). Replication and the search for the laws in the geographic sciences. Annals of GIS, 28(1), 45-56. DOI:10.1080/19475683.2022.2027011.
- Discussion of the role of replication in geography that situates the practice in the literature of the Hartshorne-Schaefer debate.
Reproduction and Replication Studies
We have attempted to reproduce and/or replicate all of the following studies with our undergraduate and graduate students. As we progressed through this overarching project, we continuously improved upon our adoption of open science practices. By extension, we also continue to improve our infrastructure for practicing reproducible and open science in geography.
| Project | Prior Study | GitHub | OSF | Plan | Report | Preprint | Publication |
|---|---|---|---|---|---|---|---|
| Brodie et al 2023 | link | link | link | link | |||
| Chakraborty 2021 | link | link | link | link | link | ||
| DiMaggio et al 2020 | link | link | link | link | link | link | |
| Kang et al 2020 | link | link | link | link | link | ||
| Kodros et al 2022 | link | link | link | link | |||
| Malcomb et al 2014 | link | link | link | link | |||
| Maldonado et al 2023 | link | link | link | link | link | ||
| Molallo et al 2020 | link | link | link | link | link | ||
| Saffary et al 2020 | link | link | link | link | link | ||
| Spielman et al 2020 | link | link | link | link | link | ||
| Vijayan et al 2020 | link | link | link | link | link |
Other Publications
This table outlines the core peer-reviewed journal articles, conference papers, and encyclopedia entries related to our project.
| Project | Publication | Journal | GitHub | OSF | Plan | Report | Preprint | Website |
|---|---|---|---|---|---|---|---|---|
| Reproduction Survey | link | Annals of the American Association of Geographers | link | link | link | link | link | |
| Replication Survey | link | Annals of the American Association of Geographers | link | link | link | link | link | |
| Replication and Laws | link | Annals of GIS | ||||||
| Verification and Validation GISBoK | link | Geographic Information Science & Technology Body of Knowledge | ||||||
| Veridical spatial data science | link | Spatial Data Science Symposium 2021 | ||||||
| Mainstreaming metadata | link | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences | ||||||
| Decentralized infrastructure | link | I-GUIDE Forum 2023 | ||||||
| R&R of Remote Sensing | link | Remote Sensing | ||||||
| Replications as PBL in GIScience | Transactions in GIS | link | link | link | ||||
| Uncertainty and bias in spatial data science education | link | I-GUIDE Forum 2024 | ||||||
| Vermont Pharmacy Accessibility | BMC Health Services | link | link | link | link | link | link |