Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Deny/Allow list for operators that can be used with dag factory #296

Open
1 task
cmarteepants opened this issue Nov 20, 2024 · 0 comments
Open
1 task
Labels
enhancement New feature or request triage-needed

Comments

@cmarteepants
Copy link
Collaborator

Description

We should create a feature for deployment admins to either allow or restrict users from using certain types of operators. For example, some deployment admins may want to restrict users from using KPOs, or only allow users to use custom operators that were built internally. This should be a configuration that is set at the deployment, not via dag code.

Use case/motivation

To avoid issues when upgrading and ensure that their users are following best practice, some of our customers want to restrict their users from using certain kinds of operators or only allow them to use specific ones, like for example using the databricks operator instead of the python operator. It's possible to write tests via pytest to check for this as part of cicd, but unless cicd is enforced and tests are imported from elsewhere during the cicd process, it is possible for users to get around this. We should have a first class way for people to add an allow/deny list via a proper configuration outside of dag code. Something like DAG_FACTORY__BANNED_OPERATORS='PythonOperator,KubernetesPodOperator'

Related issues

No response

Are you willing to submit a PR?

  • Yes, I am willing to submit a PR!
@cmarteepants cmarteepants added enhancement New feature or request triage-needed labels Nov 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request triage-needed
Projects
None yet
Development

No branches or pull requests

1 participant