From 592eafa82af5c39c2268b590c2216c82c39b8a3b Mon Sep 17 00:00:00 2001 From: Maciej Obuchowski Date: Fri, 26 Jul 2024 15:26:20 +0200 Subject: [PATCH] openlineage, docs: add missing execution_timeout conf value (#41042) Signed-off-by: Maciej Obuchowski --- .../guides/user.rst | 20 +++++++++++++++++++ 1 file changed, 20 insertions(+) diff --git a/docs/apache-airflow-providers-openlineage/guides/user.rst b/docs/apache-airflow-providers-openlineage/guides/user.rst index 19b8ef9d789e9..a5ced101f041e 100644 --- a/docs/apache-airflow-providers-openlineage/guides/user.rst +++ b/docs/apache-airflow-providers-openlineage/guides/user.rst @@ -191,6 +191,26 @@ If not set, it's using ``default`` namespace. Provide the name of the namespace .. _options:disable: +Timeout +^^^^^^^ + +To add a layer of isolation between task execution and OpenLineage, adding a level of assurance that OpenLineage execution does not +interfere with task execution in a way other than taking time, OpenLineage methods run in separate process. +The code runs with default timeout of 10 seconds. You can increase this by setting the ``execution_timeout`` value. + +.. code-block:: ini + + [openlineage] + transport = {"type": "http", "url": "http://example.com:5000", "endpoint": "api/v1/lineage"} + execution_timeout = 60 + +``AIRFLOW__OPENLINEAGE__EXECUTION_TIMEOUT`` environment variable is an equivalent. + +.. code-block:: ini + + AIRFLOW__OPENLINEAGE__EXECUTION_TIMEOUT=60 + + Disable ^^^^^^^ You can disable sending OpenLineage events without uninstalling OpenLineage provider by setting