Session 3 - Nov 2023

[weilu]

For collecting feedback

Databricks access & setup links:

• Databricks workspace: https://adb-6102124407836814.14.azuredatabricks.net/browse?o=6102124407836814
• Instructions: https://docs.google.com/presentation/d/1OWYHTO3dJVl6rG9qo7FXY4OJcEw8ivCQAw-ZwXbl-kY/edit?usp=sharing
• Notebook import URL: https://github.com/worldbank/dec-python-course/blob/main/1-foundations/3-numpy-and-pandas/foundations-s3.ipynb
• Github repo URL: https://github.com/worldbank/dec-python-course

Session Timing

Start: 9:30
Databricks access & Content Overview [10 min]

Python libraries [10 min]
Instruction: 10 minutes
(Time check: 9:50am, actual: 10:05)

Pandas [100 min]
Instruction: 30 minutes
(Time check: 10:20am, actual: 11:00)

3.2.5. Exercises: read and explore excel data: 30 minutes (20 minutes try-out, 10 minutes demo)
(Time check: 10:50am, actual: 11:30)

Instruction: 40 minutes
(Time check: 11:30am, actual: 12:00)

3.3.6. Exercises: improve merging with index difference and outer join: 30 minutes (20 minutes try-out, 10 minutes demo)
(Time check: 12:00pm, actual: -)

NumPy - if there is time [30 min]
Instruction: 15 minutes
2.4. Exercises: vector dot product: 15 minutes
Wei: 2 minutes intro.
breakout rooms: 13 minutes (10 minutes try-out, 3 minutes demo)

[weilu]

Session Timing Dec 2024 Run

Start: 9:30
Databricks access & Content Overview [10 min]

Python libraries [10 min]
Instruction: 10 minutes
(Time check: 9:50am, actual: ?)

Pandas [100 min]
Instruction: 30 minutes
(Time check: 10:20am, actual: 10:30)

3.2.5. Exercises: read and explore excel data: 30 minutes (20 minutes try-out, 10 minutes demo)
(Time check: 10:50am, actual: 11:10)

Instruction: 40 minutes
(Time check: 11:30am, actual: 11:50) spent the last 10 minutes demonstrating how to read operations data into a pandas table:
spark.table(f'prd_corpdata.dm_operation_gold.project').toPandas()

3.3.6. Exercises: improve merging with index difference and outer join: 30 minutes (20 minutes try-out, 10 minutes demo)
(Time check: 12:00pm, actual: -)

NumPy - if there is time [30 min]
Instruction: 15 minutes
2.4. Exercises: vector dot product: 15 minutes
Wei: 2 minutes intro.
breakout rooms: 13 minutes (10 minutes try-out, 3 minutes demo)