Spark-DB-Connector

Sharing Examples for Connecting different databases using Apache Spark 2.4.x

Examples available under com.spark.knowledge.test package

Cassandra

File source : com.spark.knowledge.datastorage.Cassandra

Read and write data to cassandra using Apache Spark with the help of Spark Cassandra connector.

MemSQL

File source : com.spark.knowledge.datastorage.MemSQL

Read and write data to MemSQL using Apache Spark with the help of Spark Memsql connector.

Redis

File source : com.spark.knowledge.datastorage.RedisDB

Read and write data to Redis using Apache Spark with the help of Spark Redis connector.

MongoDB

File source : com.spark.knowledge.datastorage.MongoDB

Read and write data to MongoDB using Apache Spark with the help of Spark Mongo connector.

Mysql

File source : com.spark.knowledge.datastorage.Mysql

Read and write data to Mysql using Apache Spark with the help of Mysql JDBC connector.

PostgresSQL

File source : com.spark.knowledge.datastorage.PostgresSQL

Read and write data to Postgres using Apache Spark with the help of Postgres JDBC connector.

Microsoft SQL server

File source : com.spark.knowledge.datastorage.MSSql

Read and write data to Microsoft SQL server using Apache Spark with the help of Microsoft SQL server JDBC connector.