Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

save era5 and xbt data to azure #15

Closed
stevehadd opened this issue Apr 22, 2022 · 3 comments
Closed

save era5 and xbt data to azure #15

stevehadd opened this issue Apr 22, 2022 · 3 comments
Assignees

Comments

@stevehadd
Copy link
Member

In order to make the notebooks work as seamlessly as possiblt, we should create a copy of the XBT and ER5 data loaded in the notebooks to azure storage, as accessing the data on AWS S3 requires AWS credentials (its public, but you need to have credentials), which I expect most participants will not have. The XBT data is fairly small, and we can pick a subset of era 5 data to copy.

@stevehadd stevehadd added this to the CDT lectures 2022 milestone Apr 22, 2022
@stevehadd stevehadd self-assigned this Apr 22, 2022
@stevehadd
Copy link
Member Author

we should also demonstrate getting data from the copernicus data store.
https://cds.climate.copernicus.eu/api-how-to

@stevehadd
Copy link
Member Author

create a zarr file from the downloaded era5 data to demonstrate how it is different to netcdf5 and better for cloud data acess.

stevehadd added a commit that referenced this issue Apr 27, 2022
… zarr to demonstrate this technology. #7 Demonstrate using azure ML datastores and datasets.
@stevehadd
Copy link
Member Author

this is now working. The notebooks do not contain the secret key, so we might need to think about a better long term solution. created #16 to look into that so closing this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant