Skip to content

Commit

Permalink
docs(pyspark): document ibis.connect using a URL
Browse files Browse the repository at this point in the history
  • Loading branch information
deepyaman committed Dec 13, 2023
1 parent d5da5ad commit dbb367b
Showing 1 changed file with 9 additions and 0 deletions.
9 changes: 9 additions & 0 deletions docs/backends/pyspark.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -92,6 +92,15 @@ from _utils import render_do_connect
render_do_connect("pyspark")
```

### `ibis.connect` URL format

In addition to `ibis.pyspark.connect`, you can also connect to PySpark by
passing a properly-formatted PySpark connection URL to `ibis.connect`:

```python
con = ibis.connect(f"pyspark://{warehouse-dir}?spark.app.name=CountingSheep&spark.master=local[2]")
```

```{python}
#| echo: false
BACKEND = "PySpark"
Expand Down

0 comments on commit dbb367b

Please sign in to comment.