Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Doc ssl #246

Open
wants to merge 10 commits into
base: master
Choose a base branch
from
Open

Doc ssl #246

Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
0c82d47
add ssl connection test
gkorland May 17, 2020
89a41da
add keystore
gkorland May 17, 2020
ff69238
Update Makefile
gkorland May 19, 2020
6fe3e77
Update Makefile
gkorland May 19, 2020
ee709d5
set keystore
gkorland May 19, 2020
1c36ab6
Merge branch 'ssl-test' of github.com:RedisLabs/spark-redis into ssl-…
gkorland May 19, 2020
eb9bc7c
add ssl to docs
gkorland May 19, 2020
d77e506
Merge branch 'master' into doc-ssl
gkorland May 19, 2020
648714d
Merge branch 'master' into doc-ssl
gkorland Jun 24, 2020
ebe9ab4
Merge branch 'master' into doc-ssl
gkorland Jun 24, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 20 additions & 0 deletions doc/getting-started.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -88,6 +88,26 @@ val spark = SparkSession
val sc = spark.sparkContext
```

The SparkSession can be configured with SSL enabled:

```scala
val spark = SparkSession
.builder()
.appName("myApp")
.master("local[*]")
.config("spark.redis.host", "localhost")
.config("spark.redis.port", "6379")
.config("spark.redis.auth", "passwd")
.config("spark.redis.ssl", "true")
.getOrCreate()

val sc = spark.sparkContext
```

```bash
java -Djavax.net.ssl.trustStorePassword=password -Djavax.net.ssl.trustStore=path/to/keystore -Djavax.net.ssl.trustStoreType=jceks ...
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure we should include this line into the doc. It's only needed if someone starts Redis with a generated CA certificate. And in that case if they submit an app to spark cluster, they will need to configure java options in spark specific way, i.e. using spark.executor.extraJavaOptions and spark.driver.extraJavaOptions (https://spark.apache.org/docs/latest/configuration.html). Maybe we should create a separate doc page describing it since it's more advanced topic (not for a getting-started page). What do you think?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sounds like a good idea.

```

### Create RDD

```scala
Expand Down