Examining the generalizability of research findings from archival data

Proceedings of the National Academy of Sciences · 2022 · 54 citations

• Computer Science
• Econometrics
• Psychology

This initiative examined systematically the extent to which a large set of archival research findings generalizes across contexts. We repeated the key analyses for 29 original strategic management effects in the same context (direct reproduction) as well as in 52 novel time periods and geographies; 45% of the reproductions returned results matching the original reports together with 55% of tests in different spans of years and 40% of tests in novel geographies. Some original findings were associated with multiple new tests. Reproducibility was the best predictor of generalizability-for the findings that proved directly reproducible, 84% emerged in other available time periods and 57% emerged in other geographies. Overall, only limited empirical evidence emerged for context sensitivity. In a forecasting survey, independent scientists were able to anticipate which effects would find support in tests in new samples.

Climate change in the American Mind: April 2020

2020 · 124 citations

• Political Science
• Computer Science
• Psychology

This report is based on findings from a nationally representative survey – Climate Change in the American Mind – conducted by the Yale Program on Climate Change Communication (climatecommunication.yale.edu) and the George Mason University Center for Climate Change Communication (climatechangecommunication.org). Interview dates: April 7 – 17, 2020. Interviews: 1,029 Adults (18+). Average margin of error +/- 3 percentage points at the 95% confidence level.

Climate change in the American mind: November 2019

2020 · 91 citations

• Political Science
• Psychology
• Political Science

This report is based on findings from a nationally representative survey – Climate Change in the American Mind – conducted by the Yale Program on Climate Change Communication (climatecommunication.yale.edu) and the George Mason University Center for Climate Change Communication (climatechangecommunication.org). Interview dates: November 8 – 20, 2019. Interviews: 1,303 adults in the U.S. (18+). Average margin of error +/- 3 percentage points at the 95% confidence level. The research was funded by the 11th Hour Project, the Energy Foundation, and the MacArthur Foundation. A special thank you goes to Parrish Bergquist, PhD and MattoMildenberger, PhD for creating an automated version of this report.