Skip to content

Commit 26526a8

Browse files
lwasserarianesasso
andcommitted
Edits to peer review guide on massive reorganization of guide
Edits to peer review guide Co-authored-by: Ariane Sasso <[email protected]> Update appendices/editor-in-chief-checks.md Co-authored-by: Ariane Sasso <[email protected]> Update appendices/pre-review-package-requirements.md Co-authored-by: Ariane Sasso <[email protected]> Update appendices/pre-review-package-requirements.md Co-authored-by: Ariane Sasso <[email protected]> Update appendices/reviewer-request-template.md Co-authored-by: Alexandre Batisse <[email protected]> Update appendices/reviewer-request-template.md Co-authored-by: Ariane Sasso <[email protected]> Update appendices/reviewer-request-template.md Co-authored-by: Alexandre Batisse <[email protected]> Apply suggestions from code review Co-authored-by: Ariane Sasso <[email protected]> Update appendices/package-approval-template.md Co-authored-by: Ariane Sasso <[email protected]> Apply suggestions from code review Co-authored-by: Ariane Sasso <[email protected]> Co-authored-by: Alexandre Batisse <[email protected]> Apply suggestions from code review Co-authored-by: Ariane Sasso <[email protected]> Update software-peer-review-guide/editor-in-chief-guide.md Co-authored-by: Ariane Sasso <[email protected]> Update software-peer-review-guide/editor-in-chief-guide.md Co-authored-by: Ariane Sasso <[email protected]> Update software-peer-review-guide/editor-in-chief-guide.md Co-authored-by: Ariane Sasso <[email protected]> Update software-peer-review-guide/editor-in-chief-guide.md Co-authored-by: Ariane Sasso <[email protected]> Apply suggestions from code review Co-authored-by: Ariane Sasso <[email protected]> Update software-peer-review-guide/intro.md Co-authored-by: Ariane Sasso <[email protected]> Update software-peer-review-guide/reviewer-guide.md Co-authored-by: Ariane Sasso <[email protected]> Apply suggestions from code review Co-authored-by: Ariane Sasso <[email protected]>
1 parent 8b91214 commit 26526a8

11 files changed

+64
-63
lines changed

about-peer-review/pyopensci-related-joss-ropensci.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -56,5 +56,5 @@ You do not need to go through two reviews!
5656
Once accepted by JOSS, you now have both a pyOpenSci acceptance and one by JOSS.
5757

5858
* JOSS will give you a Crossref DOI for citation.
59-
* And you can display that and your pyOpenSci peer reviewed badge at the top of your package's README.md file.
59+
* You can display that and your pyOpenSci peer reviewed badge at the top of your package's README.md file.
6060

appendices/editor-in-chief-checks.md

+13-13
Original file line numberDiff line numberDiff line change
@@ -6,20 +6,20 @@ review. Below are the basic checks that your package needs to pass
66
to begin our review. If some of these are missing, we will ask you
77
to work on them before the review process begins.
88

9-
- [ ] **Installation** The package can be installed from a community repository such as PyPI (preferred), and/or a community channel on conda (e.g. conda-forge, bioconda)
10-
- [ ] The package imports properly into a standard Python environment `import package-name`
11-
- [ ] **Fit**: The package meets criteria for [fit](https://www.pyopensci.org/peer-review-guide/about-peer-review/aims-and-scope.html#package-scope) and [overlap](https://www.pyopensci.org/peer-review-guide/about-peer-review/aims-and-scope.html#package-overlap).
12-
- [ ] **Documentation** The package has sufficient documentation available online (README, sphinx docs) to allow us to evaluate package function and scope *without installing the package*. This includes:
9+
- [ ] **Installation** The package can be installed from a community repository such as PyPI (preferred), and/or a community channel on conda (e.g. conda-forge, bioconda).
10+
- [ ] The package imports properly into a standard Python environment `import package-name`.
11+
- [ ] **Fit** The package meets criteria for [fit](https://www.pyopensci.org/peer-review-guide/about-peer-review/aims-and-scope.html#package-scope) and [overlap](https://www.pyopensci.org/peer-review-guide/about-peer-review/aims-and-scope.html#package-overlap).
12+
- [ ] **Documentation** The package has sufficient online documentation (README, sphinx docs) to allow us to evaluate package function and scope *without installing the package*. This includes:
1313
- [ ] Short tutorials or [vignettes](https://kbroman.org/pkg_primer/pages/vignettes.html) that help a user understand how to use the package and what it can do for them (often these have a name like "Getting started")
14-
- [ ] API documentation: this includes clearly written docstrings with variables defined using a standard docstring format. *We suggest using the [Numpy](https://numpydoc.readthedocs.io/en/latest/format.html#docstring-standard) docstring format.*
15-
- [ ] **README:** The package has a `README.md` file with clear explanation of what the package does, instructions on how to install it, and a link to development instructions.
16-
- [ ] **Contributing File:** The package has a `CONTRIBUTING.md` file that details how to install and contribute to the package.
17-
- [ ] **Issue Submission Documentation**: All of the information is filled out in the `YAML` header of the issue (located at the top of the issue template).
18-
- [ ] **Automated tests:** Package has a testing suite and is tested via GitHub actions or another Continuous Integration service.
19-
- [ ] **License:** The package has an [OSI approved license](https://opensource.org/licenses)
20-
- [ ] **Repository:** The repository link resolves correctly
21-
- [ ] **Package overlap:** That package doesn't fully overlap with functionality of other packages that have already been submitted to pyOpenSci
22-
- [ ] **Archive** (JOSS only, may be post-review): The repository DOI resolves correctly
14+
- [ ] API documentation: this includes clearly written docstrings with variables defined using a standard docstring format. *We suggest using the [Numpy](https://numpydoc.readthedocs.io/en/latest/format.html#docstring-standard) docstring format*.
15+
- [ ] **README** The package has a `README.md` file with clear explanation of what the package does, instructions on how to install it, and a link to development instructions.
16+
- [ ] **Contributing File** The package has a `CONTRIBUTING.md` file that details how to install and contribute to the package.
17+
- [ ] **Issue Submission Documentation** All of the information is filled out in the `YAML` header of the issue (located at the top of the issue template).
18+
- [ ] **Automated tests** Package has a testing suite and is tested via GitHub actions or another Continuous Integration service.
19+
- [ ] **License** The package has an [OSI approved license](https://opensource.org/licenses).
20+
- [ ] **Repository** The repository link resolves correctly.
21+
- [ ] **Package overlap** The package doesn't entirely overlap with the functionality of other packages that have already been submitted to pyOpenSci.
22+
- [ ] **Archive** (JOSS only, may be post-review): The repository DOI resolves correctly.
2323
- [ ] **Version** (JOSS only, may be post-review): Does the release version given match the GitHub release (v1.0.0)?
2424

2525
---

appendices/package-approval-template.md

+3-3
Original file line numberDiff line numberDiff line change
@@ -5,15 +5,15 @@
55
There are a few things left to do to wrap up this submission:
66
- [ ] Activate [Zenodo](https://zenodo.org/) watching the repo if you haven't already done so.
77
- [ ] Tag and create a release to create a Zenodo version and DOI.
8-
- [ ] Add the badge for pyOpenSci peer-review to the README.md of <package-name-here>. The badge should be `[![pyOpenSci](https://tinyurl.com/y22nb8up)](https://github.com/pyOpenSci/software-review/issues/issue-number)`
9-
- [ ] Add <package-name> to the pyOpenSci website. <maintainer-name>, please open a pr to update [this file](https://github.com/pyOpenSci/pyopensci.github.io/blob/main/_data/packages.yml): to add your package and name to the list of contributors
8+
- [ ] Add the badge for pyOpenSci peer-review to the README.md of <package-name-here>. The badge should be `[![pyOpenSci](https://tinyurl.com/y22nb8up)](https://github.com/pyOpenSci/software-review/issues/issue-number)`.
9+
- [ ] Add <package-name> to the pyOpenSci website. <maintainer-name>, please open a pr to update [this file](https://github.com/pyOpenSci/pyopensci.github.io/blob/main/_data/packages.yml): to add your package and name to the list of contributors.
1010
- [ ] <reviewers-and-maintainers> if you have time and are open to being listed on our website, please add yourselves to [this file](https://github.com/pyOpenSci/pyopensci.github.io/blob/main/_data/contributors.yml) via a pr so we can list you on our website as contributors!
1111

1212
<IF JOSS SUBMISSION>
1313
It looks like you would like to submit this package to JOSS. Here are the next steps:
1414

1515
- [ ] Login to the JOSS website and fill out the JOSS submission form using your Zenodo DOI. **When you fill out the form, be sure to mention and link to the approved pyOpenSci review.** JOSS will tag your package for expedited review if it is already pyOpenSci approved.
16-
- [ ] Wait for a JOSS editor to approve the presubmission (which includes a scope check)
16+
- [ ] Wait for a JOSS editor to approve the presubmission (which includes a scope check).
1717
- [ ] Once the package is approved by JOSS, you will be given instructions by JOSS about updating the citation information in your README file.
1818
- [ ] When the JOSS review is complete, add a comment to your review in the pyOpenSci software-review repo that it has been approved by JOSS.
1919

+11-11
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,12 @@
11

2-
- [ ] **Fit**: The package meets criteria for [fit](https://www.pyopensci.org/peer-review-guide/about-peer-review/aims-and-scope.html#package-scope) and [overlap](https://www.pyopensci.org/peer-review-guide/about-peer-review/aims-and-scope.html#package-overlap).
3-
- [ ] **Package overlap:** That package doesn't fully overlap with functionality of other packages that have already been submitted to pyOpenSci
4-
- [ ] **Documentation** The package has sufficient documentation available online (README, sphinx docs) to allow us to evaluate package function and scope *without installing the package*. This includes:
5-
- [ ] Get started vignettes or tutorials that help a user understand how to use the package and what it can do for them
6-
- [ ] API documentation - this includes clearly written doc strings with variables defined using a standard docstring format
7-
- [ ] **README.md File:** The package has a README.md file with clear explanation of what the packages does and instructions on how to install it along with development instructions.
8-
- [ ] the README file clearly articulates the function of the package
9-
- [ ] **CONTRIBUTING.md file:** The package has a `CONTRIBUTING.md` file that details how to install and contribute to the package.
10-
- [ ] **Automated tests:** Package has a testing suite and is tested via GitHub actions or another Continuous Integration service.
11-
- [ ] **License:** The package has an OSI accepted license
12-
- [ ] **Repository:** The package repository link resolves correctly
2+
- [ ] **Fit** The package meets criteria for [fit](https://www.pyopensci.org/peer-review-guide/about-peer-review/aims-and-scope.html#package-scope) and [overlap](https://www.pyopensci.org/peer-review-guide/about-peer-review/aims-and-scope.html#package-overlap).
3+
- [ ] **Package overlap** That package doesn't entirely overlap with the functionality of other packages that have already been submitted to pyOpenSci.
4+
- [ ] **Documentation** The package has sufficient online documentation (README, sphinx docs) to allow us to evaluate package function and scope *without installing the package*. This includes:
5+
- [ ] Get started vignettes or tutorials that help users understand how to use the package and what it can do for them.
6+
- [ ] API documentation - this includes clearly written doc strings with variables defined using a standard docstring format.
7+
- [ ] **README.md File** The package has a README.md file with a clear explanation of what the package does and instructions on how to install it, along with development instructions.
8+
- [ ] README file clearly articulates the function of the package.
9+
- [ ] **CONTRIBUTING.md file** The package has a `CONTRIBUTING.md` file that details how to install and contribute to the package.
10+
- [ ] **Automated tests** Package has a testing suite and is tested via GitHub actions or another Continuous Integration service.
11+
- [ ] **License** The package has an OSI accepted license.
12+
- [ ] **Repository** The package repository link resolves correctly.

appendices/reviewer-request-template.md

+3-3
Original file line numberDiff line numberDiff line change
@@ -2,15 +2,15 @@
22
Dear [REVIEWER-Name],
33

44
Hi, this is [EDITOR-Name]. [FRIENDLY BANTER]. I'm writing to ask if you have time
5-
to review a package for pyOpenSci. pyOpenSci has an ope peer review of open source Python packages that support science. Accepted packages become a part of our pyOpenSci ecosystem of vetted community-adopted tools. Our review process is similar to that
5+
to review a package for pyOpenSci. pyOpenSci has an open peer review of open source Python packages that support science. Accepted packages become a part of our pyOpenSci ecosystem of vetted community-adopted tools. Our review process is similar to that
66
of open journals however it focuses on ensuring high quality packaging approaches
77
that are inline with community adopted Python standards.
88

99
The package, [PACKAGE] by [AUTHOR(S)], does [FUNCTION]. You can find it on GitHub here: [REPO LINK]. We conduct our open review process via GitHub as well, here: [ONBOARDING ISSUE]
1010

11-
If you accept, note that we ask reviewers to complete reviews in three weeks. (We’ve found it takes a similar amount of time to review a package as an academic paper.)
11+
If you accept, note that we ask reviewers to complete reviews in three weeks (We’ve found it takes a similar amount of time to review a package as an academic paper.).
1212

13-
Our [reviewers guide](https://www.pyopensci.org/peer-review-guide/software-peer-review-guide/reviewer-guide.html) details what we look for in a package review, and includes links to example reviews. We also include a reviewer template on that page that you can use to guide your review. Our Python packaging standards are detailed in our [packaging guide](https://www.pyopensci.org/python-package-guide).
13+
Our [reviewers guide](https://www.pyopensci.org/peer-review-guide/software-peer-review-guide/reviewer-guide.html) details what we look for in a package review, and includes links to example reviews. We also include a reviewer template on that page that you can use to guide your review. Our Python packaging standards are detailed in our [packaging guide](https://www.pyopensci.org/python-package-guide).
1414

1515
If you have time, please have a look at the package first, to make
1616
sure that you do not have a conflict of interest with the package authors.

appendices/scope.md

+6-6
Original file line numberDiff line numberDiff line change
@@ -16,9 +16,9 @@ pyOpenSci domain scope.
1616

1717
To be in technical scope for a pyOpenSci review, your package:
1818

19-
* Should have maintenance workflows documented
20-
* Should be structured in a way that someone else could contribute to it
21-
* Should vendor dependencies using standard approaches rather than including code from other packages within your repository.
19+
* Should have maintenance workflows documented.
20+
* Should be structured in a way that someone else could contribute to it.
21+
* Should declare vendor dependencies using standard approaches rather than including code from other packages within your repository.
2222

2323
### Notes on scope categories
2424
- pyOpenSci is still developing as a community. If your scientific Python
@@ -28,11 +28,11 @@ questions, we'd encourage you to open a pre-submission inquiry. We're happy to h
2828
hyper-specific methods for one type of data to general, do-it-all packages
2929
(e.g. matplotlib). pyOpenSci accepts packages that are somewhere in between the
3030
two. If you're interested in submitting your data visualization package, please
31-
open a pre-submission inquiry on first.
31+
open a pre-submission inquiry first.
3232

3333
## Python package technical scope
3434

35-
pyOpenSci is may continue to update it's technical scope criteria for package
35+
pyOpenSci may continue to update its technical scope criteria for package
3636
review as more packages with varying structural approaches are reviewed.
3737
Your package **may not be in technical scope** for us to review at this time if
3838
fits any of the out-of-technical-scope criteria listed below.
@@ -56,7 +56,7 @@ package repository to a new organization along with PyPI credentials. A new
5656
organization would allow transfer of ownership of package maintenance rather
5757
than several forks existing.
5858
59-
Of your package is a divergent fork of a maintained repository we will encourage you
59+
If your package is a divergent fork of a maintained repository we will encourage you
6060
to work with the original maintainers to merge efforts.
6161
6262
However, if there is a case where a forked repository is warranted, please

software-peer-review-guide/author-guide.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -154,7 +154,7 @@ will evaluated by JOSS through the pyOpenSci review
154154
- To complete the JOSS submission, you will also need to craft a **paper.md**
155155
file describing the package following JOSS' standards (see below). More detail on the requirements for JOSS can be found on [their website](https://joss.readthedocs.io/en/latest/submitting.html#what-should-my-paper-contain).
156156
- If you choose to opt into the pyOpenSci / JOSS partnership in your review,
157-
you do NOT need to go through a second review with JOSS. JOSS accepts our review
157+
you DO NOT need to go through a second review with JOSS. JOSS accepts our review
158158
for theirs. Please start a review process with JOSS and reference the pyOpenSci
159159
review issue where your package was accepted. Make sure
160160
that you let the JOSS editor know that we have already accepted your package. The JOSS editor will review your paper and once that is accepted you now have a JOSS DOI and badge to display on your README file as well!

software-peer-review-guide/editor-in-chief-guide.md

+12-12
Original file line numberDiff line numberDiff line change
@@ -49,9 +49,9 @@ It is important that this step occur in one post rather than a string of
4949
conversational feedback that is more difficult to follow. This allows the author to address all issues at
5050
one time. Thus the EIC should:
5151
52-
1. Review the checklist
53-
1. Give the author a rough estimate of how long the checks might take to complete
54-
1. Perform all of the checks locally
52+
1. Review the checklist.
53+
1. Give the author a rough estimate of how long the checks might take to complete.
54+
1. Perform all of the checks locally.
5555
1. When all of the above are complete, post the checklist with any feedback for the author in the issue. This should be one single post.
5656
```
5757

@@ -65,10 +65,10 @@ improve the quality of the package.
6565

6666
In some situations, the editor-in-chief initial checks may be passed down to an editor as follows:
6767

68-
* If the Editor in Chief is overwhelmed with package submissions to evaluate
69-
* If the Editor in Chief simply is busy at the time and needs support with checks
68+
* If the Editor in Chief is overwhelmed with package submissions to evaluate.
69+
* If the Editor in Chief simply is busy at the time and needs support with checks.
7070
* If the Editor in Chief thinks that the checks might be better served if done by an Editor
71-
(For instance if a specific domain or technical expertise would support more effective checks)
71+
(For instance, if a specific domain or technical expertise would support more effective checks).
7272

7373
(editor-checklist-template)=
7474
### Editor-in-chief checklist
@@ -97,18 +97,18 @@ for the package. [Check out the editor guide for more information on this proces
9797

9898
Once all of the above is complete, the Editor in Chief should:
9999

100-
* Add any comments to the bottom of your editor checks comment
101-
* Update the yaml in the header of the issue with the editor assigned to the review
100+
* Add any comments to the bottom of your editor checks comment.
101+
* Update the YAML in the issue's header with the editor assigned to the review.
102102
* Add the tag `2/seeking-reviewer(s)` to the issue.
103103

104104
## A note about submissions that are incomplete or vague
105105

106106
In some cases:
107107

108-
* online documentation of a package is sparse,
109-
* the README is minimal or hard to understand or
110-
* there is no clear documentation setup.
111-
* elements of the YAML template at the top of the issue are not filled out.
108+
* Online documentation of a package is sparse.
109+
* README is minimal or hard to understand.
110+
* No clear documentation setup.
111+
* Elements of the YAML template at the top of the issue are not filled out.
112112

113113
This makes assessment of the package's scope much harder.
114114
In this case, please ask the author for more information. Even if the package is deemed

0 commit comments

Comments
 (0)