Official support for kubernetes

[absorbb]

We need to officially support k8s:

• Under k8 environement: Run airbyte source images as k8s pods instead of using DinD of DoD approaches
• Add documentation with example of deployment config
• Provide official jitsu helm chart
• Support for GKE and Amazon EKS

[amadrizwan]

Under k8 environement: Run airbyte source images as k8s pods instead of using DinD of DoD approaches

One option would be to use workflow manager to run airbyte source images.

Some options are as follows:

https://temporal.io/
https://www.prefect.io/
https://argoproj.github.io/
https://airflow.apache.org/

[vklimontovich]

A few updates on this issue:

• We started to use k8s to run part of Jitsu Cloud (Rotor, Bulker and Igest), so we have a strong foundation
• We have a community supported Helm chart, although it's distributed by the owner as zip file, and there's no repo for it. So I can't link it here
• Before we move on with this, we want to sunset Redis dependency first and replace it with Mongo

[hendrikheil]

Another tiny update: We've open sourced our Helm Chart which we use to run Jitsu in production.

https://github.com/stafftastic/jitsu-chart

It's stable for production workloads and we're actively trying to merge Pull Requests and incorporate updates.