Skip to content

Commit

Permalink
Merge pull request ESIPFed#3 from amanda-tan/master
Browse files Browse the repository at this point in the history
Update everything
  • Loading branch information
amanda-tan authored Apr 1, 2021
2 parents b2f3d80 + 23810cf commit 1a81a47
Show file tree
Hide file tree
Showing 16 changed files with 5,379 additions and 63 deletions.
Original file line number Diff line number Diff line change
@@ -1,22 +1,22 @@
{
"cells": [
{
"cell_type": "code",
"execution_count": null,
"cell_type": "raw",
"metadata": {},
"outputs": [],
"source": [
"#Introduction to Cloud Computing\n",
"#-- Systems administration (user roles, tagging, cost management), cloud best practices\n",
"#-- Data storage, getting data in and out of the cloud"
"#-- Data storage, getting data in and out of the cloud\n",
"##Overview\n",
"Here you will learn briefly about cloud computing best practices, why you would utilize cloud computing for big data and "
]
}
],
"metadata": {
"kernelspec": {
"display_name": "Python [conda env:notebook] *",
"display_name": "Python 3",
"language": "python",
"name": "conda-env-notebook-py"
"name": "python3"
},
"language_info": {
"codemirror_mode": {
Expand All @@ -28,7 +28,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.7.6"
"version": "3.7.0"
}
},
"nbformat": 4,
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -400,7 +400,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.7.6"
"version": "3.7.0"
}
},
"nbformat": 4,
Expand Down
17 changes: 8 additions & 9 deletions x-array.ipynb → ...nts/03_multidim_analysis-checkpoint.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -4,14 +4,13 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"# Introduction to Xarray\n"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"We discuss here the basic utility of Xarray here."
"## Multi-dimensional Analysis with xarray\n",
"\n",
"### Questions\n",
"- How do I work with multidimensional data like NetCDF files? \n",
"\n",
"### Objectives\n",
"- Learn how xarray can change your life"
]
},
{
Expand Down Expand Up @@ -750,7 +749,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.7.6"
"version": "3.7.0"
}
},
"nbformat": 4,
Expand Down
8 changes: 6 additions & 2 deletions Dask.ipynb → ...ts/04_parallel_computing-checkpoint.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,11 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"We create a Dask client"
"## Parallel Computing with Dask\n",
"### Questions\n",
"- How do I start working with larger datase\n",
"### Objectives\n",
"- Introduce the concept of Dask, a free and open-source library for parallel computing in Python"
]
},
{
Expand Down Expand Up @@ -285,7 +289,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.7.6"
"version": "3.7.0"
}
},
"nbformat": 4,
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,12 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"## Data Visualization\n",
"\n",
"### Questions\n",
"- How do I visualize re\n",
"### Objectives\n",
"\n",
"Here we explore the same dataset that we used , but now read all the bands and try to visualize thru HoloViews"
]
},
Expand Down Expand Up @@ -2708,7 +2714,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.7.6"
"version": "3.7.0"
}
},
"nbformat": 4,
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -903,7 +903,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.7.6"
"version": "3.7.0"
}
},
"nbformat": 4,
Expand Down
67 changes: 67 additions & 0 deletions .ipynb_checkpoints/README-checkpoint.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,67 @@
<!-- #region -->
# Open Science Education

[![Binder](https://mybinder.org/badge.svg)](https://mybinder.org/v2/gh/ESIPFed/open-data-education/master?urlpath=lab)
[![Build Status](https://travis-ci.org/dask/dask-examples.svg?branch=master)](https://travis-ci.org/ESIPFed/open-data-education)

## Introduction

The goal of this tutorial is to introduce users to working with NASA satellite imagery and utilizing Amazon Web Services' Open Data program. Through a series of modules, the user will develop an end-to-end workflow for working with satellite imagery, learn about geoscientific Python tools, and utilize a parallel computation platform on the cloud (i.e. the Pangeo Platform).

## Description

The contents of this repository consists of a series of Jupyter Notebooks and can be viewed on an open source, free computational platform like Binder. To view the contents of this repo, click the launch binder icon above.


## Installation notes

**Follow the workshop with just your browser?**
You can use the "launch binder" link above at the top of this README, which will launch a notebook instance on Binder with all required libraries installed.

:

```
```
<!-- #endregion -->

## Downloading the tutorial materials

**Note**: *This repository is actively being developed as a tutorial, so we will be updating the materials without notifications. To update your local copy, you can download the latest version again, or do a `git pull` if you are using git.*

If you have git installed, you can always get the tutorial materials by cloning this repo:

```
git clone https://github.com/ESIPFed/open-data-education.git
```

Also, you can download the repository as a .zip file by heading over to the GitHub repository (https://github.com/ESIPFed/open-data-education.git) in
your browser and click the green "Download" button in the upper right:


## Running the tutorial

**Note**: *As it is to be run on public infrastructure, you can use Binder script at the root folder.*

## Tutorial index

|Name |Description|link|
|-----|-----------|----|
|Introduction to Cloud|Details on cloud technologies |[Tutorial 1](/intotocloud.ipynb) |
|Open datasets |Publically availiable datasets | [Tutorial 2](/Opendatasets.ipynb) |
|Xarray |Introduction to Xarray | [Tutorial 3](/x-array.ipynb) |
|Dask |Introduction to Dask | [Tutorial 4](/Dask.ipynb) |
|Visualization |Introduction to HoloViews | [Tutorial 5](/Visualize.ipynb) |
|Scaling-up |Using Dask to process imagery to calculate NDVI via DASK | [Tutorial 6](/Scale-up.ipynb) |

## Issues

**Feedback/new tutotrial**
You can request new content or give general feedback through Gitub issues as well. Additionally, feel free to send us a pull request.

**Notebook related**
You can log issues using the GitHub ticketing, and we will address it at our earliest

## Authors

Aji John and Amanda Tan at University of Washington .
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,10 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"# Introduction to Basic Python Tools for Collaborative, Reproducible and Open Science"
"## Basic Python Tools for Collaborative, Reproducible and Open Science\n",
"\n",
"### Questions\n",
"What are some of the tools used for collab\n"
]
},
{
Expand Down Expand Up @@ -126,9 +129,9 @@
],
"metadata": {
"kernelspec": {
"display_name": "Python [conda env:notebook] *",
"display_name": "Python 3",
"language": "python",
"name": "conda-env-notebook-py"
"name": "python3"
},
"language_info": {
"codemirror_mode": {
Expand All @@ -140,7 +143,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.7.6"
"version": "3.7.0"
}
},
"nbformat": 4,
Expand Down
45 changes: 45 additions & 0 deletions 01_intro_to_cloud.ipynb
Original file line number Diff line number Diff line change
@@ -0,0 +1,45 @@
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Introduction to Cloud Computing\n",
"### Questions \n",
"What is cloud computing and why would I use it? \n",
"\n",
"### Objectives \n",
"- Understand big data on the cloud\n",
"- Understand what kinds of NASA data are available on the cloud"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": []
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.7.0"
}
},
"nbformat": 4,
"nbformat_minor": 4
}
Loading

0 comments on commit 1a81a47

Please sign in to comment.