PySpark + Scikit-learn = Sparkit-learn

This is a guide to PySpark code style presenting common situations and the associated best practices based on the most frequent recurring topics across the PySpark repos we've encountered.

PySpark-Tutorial provides basic algorithms using PySpark

pyspark methods to enhance developer productivity 📣 👯 🎉

PySpark test helper methods with beautiful error messages

Logging framework for pyspark and ETL project template

A best-practices first project template that allows you to get started on a new pyspark project