Review Guidelines – Step by Step
For future reuse and reinterpretation it is mandatory for the user to be assured about research data quality. It is the aim of ESSD to provide the quality assessment for datasets which already reside in permanent repositories.
Thus, when reviewing a paper in ESSD we would like you to review not just the manuscript but more importantly, the dataset itself. For your guidance, a step by step review approach is suggested:
Finally: By reading the article and downloading the dataset would you be able to understand and (re-)use the dataset in the future?
Review Criteria – Rating
Reviewers are asked to decide how well the respective datasets presented by an article and the article itself meet the following criteria (rated 1-4, excellent-poor):
Is there any potential of the data being useful? This is obviously the most problematic decision to take. There are at least three sub-criteria to evaluate:
The data must be presented readily and accessible to inspection and analysis to make the reviewer's task possible. Even if a dataset submitted is the first ever published (on a parameter, in a region, etc.), its claimed accuracy, the instrumentation employed and methods of processing should reflect the "state of the art" or "best practises". Considering all conditions and influences presented in the article, these claims and factors must be mutually consistent. The reviewer will then apply his expert knowledge and operational experience in the specific field to perform tests, e.g., statistical tests, and make a judgement whether the claimed findings and its factors - individually and as a whole - are plausible and without detectable faults.
It is not expected to receive long articles. Regarding the style, it is aimed that a stereotypical wording will develop, so that unambiguous meaning can be expressed and received without much effort. The article should express clearly what has been found, where, when and how. The article text and references should contain all information necessary to evaluate all claims about the dataset or collection, whether the claims are explicitly written down in the article, or implicit, through the data being published or their metadata. The authors should point at suitable software or services for simple visualisation and analysis, keeping in mind that neither the reviewer nor the casual "reader" will install or pay for it.
Access Review, Peer-Review & Interactive Public Discussion (ESSDD)
Manuscripts submitted to ESSD at first undergo a rapid access review by the editor (initial manuscript evaluation), which is not meant to be a full scientific review but to identify and sort out manuscripts with obvious major deficiencies in view of the above principal evaluation criteria.
If they are not immediately rejected, they will be published on the Earth System Science Data Discussions (ESSDD) website, the discussion forum of ESSD, where they are subject to full peer-review and Interactive Public Discussion.
Peer-Review Completion (ESSD)
At the end of the Interactive Public Discussion, the authors may make their final response and submit a revised manuscript. Based on the Referee Comments, other relevant comments, and the authors' response in the public discussion, the revised manuscript is re-evaluated and rated by the editor. If rated 1-2 (excellent-good) in all of the principal criteria and specific aspects listed above, it will normally be accepted for publication in ESSD. Additional advice from the referees in the evaluation and rating of the revised manuscript will be requested by the editor if the public discussion in ESSDD is not sufficiently conclusive.