Skip to content

Commit

Permalink
[REM] Remove rest of the example dags code
Browse files Browse the repository at this point in the history
  • Loading branch information
e-galan committed Feb 22, 2024
1 parent a20a3a4 commit 8d3e034
Show file tree
Hide file tree
Showing 2 changed files with 0 additions and 23 deletions.
14 changes: 0 additions & 14 deletions docs/apache-airflow-providers-google/operators/cloud/dataflow.rst
Original file line number Diff line number Diff line change
Expand Up @@ -306,26 +306,12 @@ When job is triggered asynchronously sensors may be used to run checks for speci

:class:`~airflow.providers.google.cloud.sensors.dataflow.DataflowJobAutoScalingEventsSensor`.

.. exampleinclude:: /../../tests/system/providers/google/cloud/dataflow/example_dataflow_native_python_async_deferrable.py
:language: python
:dedent: 4
:start-after: [START howto_sensor_wait_for_job_message_deferrable]
:end-before: [END howto_sensor_wait_for_job_message_defferable]

:class:`~airflow.providers.google.cloud.sensors.dataflow.DataflowJobAutoScalingEventsSensor`.

.. exampleinclude:: /../../tests/system/providers/google/cloud/dataflow/example_dataflow_native_python_async.py
:language: python
:dedent: 4
:start-after: [START howto_sensor_wait_for_job_autoscaling_event]
:end-before: [END howto_sensor_wait_for_job_autoscaling_event]

.. exampleinclude:: /../../tests/system/providers/google/cloud/dataflow/example_dataflow_native_python_async_deferrable.py
:language: python
:dedent: 4
:start-after: [START howto_sensor_wait_for_job_autoscaling_event_deferrable]
:end-before: [END howto_sensor_wait_for_job_autoscaling_event_deferrable]

Reference
^^^^^^^^^

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -128,14 +128,6 @@ def check_autoscaling_event(autoscaling_events: list[dict]) -> bool:
fail_on_terminal_state=False,
)

wait_for_go_job_async_autoscaling_event_deferred = DataflowJobAutoScalingEventsSensor(
task_id="wait_for_go_job_async_autoscaling_event_deferred",
job_id="{{task_instance.xcom_pull('start_go_pipeline_dataflow_runner')['dataflow_job_id']}}",
location=LOCATION,
fail_on_terminal_state=False,
deferrable=True,
)

delete_bucket = GCSDeleteBucketOperator(
task_id="delete_bucket", bucket_name=BUCKET_NAME, trigger_rule=TriggerRule.ALL_DONE
)
Expand All @@ -150,7 +142,6 @@ def check_autoscaling_event(autoscaling_events: list[dict]) -> bool:
wait_for_go_job_async_done,
wait_for_go_job_async_message,
wait_for_go_job_async_autoscaling_event,
wait_for_go_job_async_autoscaling_event_deferred,
]
# TEST TEARDOWN
>> delete_bucket
Expand Down

0 comments on commit 8d3e034

Please sign in to comment.