New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add answers to Batch Processing Bronze Reflect Questions #4

Open

2 tasks done

kelseymok opened this issue Apr 11, 2023 · 1 comment

Open

2 tasks done

Add answers to Batch Processing Bronze Reflect Questions #4

kelseymok opened this issue Apr 11, 2023 · 1 comment

Contributor

kelseymok commented Apr 11, 2023 •

edited by syed-tw

Loading

At the end of the exercise, there is a "Reflect" section

Add Spark UI screenshots of where people can see how many in-memory partitions have been created (and explanation) as a result of the repartition
Add Spark UI screenshots of how much time the write took (and explanation) - this is due to parquet taking a while to write

Contributor

syed-tw commented Sep 14, 2023

Added the reflect section with answers in the solution notebook. Not able to add the screenshots for now so just added the explanations.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment