Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CORE][umbrella] Configuration enhancements #8326

Open
1 of 5 tasks
yikf opened this issue Dec 24, 2024 · 1 comment
Open
1 of 5 tasks

[CORE][umbrella] Configuration enhancements #8326

yikf opened this issue Dec 24, 2024 · 1 comment
Labels
enhancement New feature or request tracker Tracker of issues in the same category

Comments

@yikf
Copy link
Contributor

yikf commented Dec 24, 2024

Description

As discussed in #6970, we plan to enhance the gluten configuration, and the specific enhancement solutions can be found in section #6970 (comment).

This issue serves as an umbrella to record the task list that we need to include to achieve our goals, because enhance config involves a large number of files, splitting multiple tasks facilitates code review and reduces the risk of introducing other problems.

  1. [GLUTEN-8327][CORE][Part-1] Rename GlutenConfig.getConf to GlutenConfig.get #8395
  2. [GLUTEN-8327][CORE][Part-2] Move GlutenConfig.scala to org.apache.gluten.config package dir  #8426
  3. [GLUTEN-8327][CORE][Part-3] Introduce the ConfigEntry to gluten config #8431
@baibaichen
Copy link
Contributor

baibaichen commented Jan 7, 2025

@yikf as discussed in the offline, there are 2 requirement

  1. Pass spark config to backend. For example, ch backend need spark.sql.caseSensitive to choose compare behavior.
  2. Pass value type to backend. currently we use ConfigMap which assum value is string type.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request tracker Tracker of issues in the same category
Projects
None yet
Development

No branches or pull requests

3 participants