Principle 7: Evaluate and document the analysis

Important Considerations
  • Climate data analysis can be an iterative process. It often takes multiple evaluations and iterative data assessments to develop a robust analysis that produces results that sufficiently answer a question.
  • Sometimes the questions we ask of the data cannot be answered, because of the data’s inherent limitations. It is important to understand that a “non-result” can still be a valid answer to your original question and may provide meaningful information about the question and/or analysis (e.g. the uncertainty range is too large to distinguish a signal, or the statistical significance is too low). Do not cherry-pick results to answer the original question.
  • The goal of documenting your workflow should be to ensure that others can replicate or build upon your analysis in the future. Consider focusing on: transformations to the original dataset, spatial or temporal aggregations or disaggregations, coordinate system transformations, metric calculations, statistical tests applied, technical documentation of developed code, and data download format.
  • Consider sharing your results, data, and analysis via an open-source forum, such as an open-access code repository (e.g. GitHub), online blog post, or open-access journal (if appropriate). Be aware that many scientific journals and regulatory institutions strongly recommend — if not require — that code and data be open-access and citable via DOI.