Skip to content

Latest commit

 

History

History
31 lines (19 loc) · 1.45 KB

README.md

File metadata and controls

31 lines (19 loc) · 1.45 KB

License

Airflow-vHive: Workflow Programming and Orchestration with Airflow atop of the vHive Serverless Platform

This fork of Apache Airflow executes DAGs similarly to the Kubernetes Executor shipped with stock Apache Airflow. However, instead of creating and deleting Kubernetes pods to execute tasks, it uses Knative services.

These Knative services must be created ahead of time. However, as Knative works differently, this does not mean that a worker pod is running all time. Instead, Knative creates/scales/deletes the pods automatically as needed. Also, this Knative worker function works seamlessly with other Airflow components, to maximize compatibility.

Airflow Architecture

Airflow-vHive_Architecture

Getting started with Airflow-vHive

Please take a look at Quickstart Guide

Developing Airflow-vHive

Please take a look at Developer's Guide

License and copyright

This fork inherits the license and copyright of the original Apache/Airflow. This code is published under the terms of the Apache 2 license.

The software is maintained by the HyScale Lab in the Nanyang Technological University, Singapore and vHive community.

Maintainer