DevOps

[dami-moj]

DevOps in Data Engineering (amongst others):

• Apply continuous integration, continuous deployment (CI/CD)
• Utilise infrastructure as code (IaC) tools to automate and streamline data pipelines
• Implement monitoring and logging to ensure data quality and system reliability

[dami-moj]

2021-11: ADOPT

[ThomasHepworth]

2024-08:

1: ADOPT 🚀
2: ASSESS 👍
3: RETAIN 😄
4: REPLACE 😦

[ThomasHepworth]

We've chosen to adopt, but there are questions regarding how much of DevOps as a discipline should be adopted.

[tmpks]

Specifically these bullet points. Beyond that is debatable?

Amount of IaC work is quite unevenly distributed across domains.

[ThomasHepworth]

• Should we all need to know about it?
• Certain DevOps techniques are expected, but as a discipline, should be handled by a dedicated team.

[SoumayaMauthoorMOJ]

Closing since too broad and undefined