Skip to content

Remote data access tutorial for CMIP6 Zarr data #132

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 11 commits into from
Aug 23, 2022
Merged

Remote data access tutorial for CMIP6 Zarr data #132

merged 11 commits into from
Aug 23, 2022

Conversation

weiji14
Copy link
Member

@weiji14 weiji14 commented Jul 16, 2022

Draft tutorial on accessing cloud-native CMIP6 datasets on Google Cloud. Covers opening Zarr files using xarray.open_zarr. Also did a basic sea level change (between 2015 and 2100) calculation and plot to show the result.

Tutorial adapted from https://colab.research.google.com/drive/19iEVxE_9QoTeg4st7MmucHJUmO93NXHp?usp=sharing#scrollTo=4M8ypd9jOzh9

Might pay if a sea level rise expert double checks if the calculation is ok. I feel like the results still differ from what's shown at the IPCC interactive map

Fixes #103.

Draft tutorial on accessing cloud-native CMIP6 datasets on Google Cloud. Covers opening Zarr files using xarray.open_zarr. Also did a basic sea level change (between 2015 and 2100) calculation and plot to show the result.
@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@dcherian
Copy link
Contributor

@jbusecke would you mind doing a review here?

@jbusecke
Copy link
Contributor

jbusecke commented Jul 21, 2022

Nice example @weiji14

Might pay if a sea level rise expert double checks if the calculation is ok. I feel like the results still differ from what's shown at the IPCC interactive map

Not a sea level expert at all, but the fact that this is only one experiment might explain the discrepancy. I would be happy to extend this example for more models/members (similar to what I have done for Scipy and which will be further developed in this repo).

Also reading in the data is shown nicely here, but it is only one of many ways (this really needs some improvement from our side). A suggestion would be to point to the official pangeo docs for the data, so that if we update this in the future this example points to the updated methodology?

@dcherian
Copy link
Contributor

Thanks for the review @jbusecke

I would be happy to extend this example for more models/member

I think not necessary here; we could just link to your efforts at easy_ipcc (cool repo name btw). The goal is demo cloud access, and do some simple calculation.

suggestion would be to point to the official pangeo docs for the data,

Yeah this would be great! I think the xarray-tutorial should illustrate concepts and point out to any other resource we can.

@jbusecke
Copy link
Contributor

That all sounds great!

@jbusecke
Copy link
Contributor

(cool repo name btw)

Obvi that was @TomNicholas s idea, cause I am not the best name-giver...

@weiji14
Copy link
Member Author

weiji14 commented Jul 29, 2022

Thanks @jbusecke for the review (again)! Felt like it was too much of a coincidence that you've reviewed this PR and the PyOpenSci/PyGMT one on the same day, haha.

I would be happy to extend this example for more models/member

I think not necessary here; we could just link to your efforts at easy_ipcc (cool repo name btw). The goal is demo cloud access, and do some simple calculation.

Yes, looking at the ensemble is always nice, but probably a bit overkill for this tutorial. Thanks for the link to https://github.com/jbusecke/easy_ipcc though! Will be very helpful if I ever need to reproduce any of those plots!

suggestion would be to point to the official pangeo docs for the data,

Yeah this would be great! I think the xarray-tutorial should illustrate concepts and point out to any other resource we can.

Ok, I've pointed to the Pangeo/ESGF Cloud Data Working Group documentation link in 5711d9e. Hopefully that's ok.

Oh, and the notebook has also been added to the table of contents at 5711d9e. Let me know if any more changes are needed!

@weiji14 weiji14 marked this pull request as ready for review August 10, 2022 21:18
@dcherian dcherian changed the title Remote data access tutorial for CMIP6 sea surface height Zarr data Remote data access tutorial for CMIP6 Zarr data Aug 23, 2022
@dcherian dcherian enabled auto-merge (squash) August 23, 2022 17:35
@dcherian dcherian merged commit f4c7e51 into xarray-contrib:main Aug 23, 2022
@weiji14 weiji14 deleted the remote-data-access branch August 23, 2022 17:54
dcherian added a commit to dcherian/xarray-tutorial that referenced this pull request Nov 5, 2022
* main:
  Correct minor tutorial typos (xarray-contrib#149)
  Update backends.md (xarray-contrib#148)
  [pre-commit.ci] pre-commit autoupdate (xarray-contrib#147)
  [pre-commit.ci] pre-commit autoupdate (xarray-contrib#143)
  remove user survery banner (xarray-contrib#145)
  fix typo (xarray-contrib#146)
  Remote data access tutorial for CMIP6 Zarr data (xarray-contrib#132)
  Update 45 minute overview for OceanHackWeek 2022 (xarray-contrib#140)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add intermediate remote data access tutorial
3 participants