Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[proposal] Koordinator supports working with Apache Hadoop YARN #712

Open
zwzhang0107 opened this issue Oct 18, 2022 · 1 comment
Open
Assignees
Labels
kind/proposal Create a report to help us improve

Comments

@zwzhang0107
Copy link
Contributor

What is your proposal:
Koordinator supports working with YARN for resource sharing, so that batch workloads in YARN can share the unused resources of K8s workloads.

Why is this needed:
Although K8s has provided well-designed framework for batch workloads, there are still a lot of BigData jobs running on YARN in reality for some reasons. In order to improve cluster resource utilization, we need to support Koordinator working with YARN for hybrid workloads orchestration.

Is there a suggested solution, if so, please add it:

@zwzhang0107 zwzhang0107 added the kind/proposal Create a report to help us improve label Oct 18, 2022
@zwzhang0107 zwzhang0107 changed the title [proposal] Koordinator supports working with Apache Hadoop YARN [proposal] Koordinator supports working with Apache Hadoop YARN Oct 18, 2022
@FillZpp
Copy link
Member

FillZpp commented Oct 26, 2022

/assign @FillZpp @zwzhang0107

This is a general issue and it should be splitted into multiple sub-task issues to track after we have got an agreement on the approach.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/proposal Create a report to help us improve
Projects
Status: 📋 Backlog
Development

No branches or pull requests

2 participants