Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[do not merge] Implement dynamic configuration and much more #94

Draft
wants to merge 9 commits into
base: main
Choose a base branch
from
1 change: 1 addition & 0 deletions dev/dags/setup-teardown.py
Original file line number Diff line number Diff line change
Expand Up @@ -42,3 +42,4 @@
# Create ray cluster and submit ray job
setup_cluster.as_setup() >> submit_ray_job >> delete_cluster.as_teardown()
setup_cluster >> delete_cluster

2 changes: 2 additions & 0 deletions docs/getting_started/local_development_setup.rst
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ Install the following software:
1. **Create a Kind Cluster**

a) If you plan to access the Kind Kubernetes cluster from Airflow using Astro CLI, use the following configuration file,

also available in ``dev/kind-config.yaml``, to create the Kind cluster:

.. code-block::
Expand Down Expand Up @@ -356,3 +357,4 @@ The most basic setup will look something like below:
- Disable SSL: Tick the disable SSL boolean if needed

.. image:: ../_static/basic_local_kubernetes_conn.png

1 change: 1 addition & 0 deletions ray_provider/constants.py
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
from ray.job_submission import JobStatus


TERMINAL_JOB_STATUSES = {JobStatus.SUCCEEDED, JobStatus.STOPPED, JobStatus.FAILED}
Loading
Loading