Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-50531][SQL] Update StringType proto to support constraints #49130

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

jovanm-db
Copy link
Contributor

@jovanm-db jovanm-db commented Dec 10, 2024

What changes were proposed in this pull request?

Adding support for StringType constraints to proto.

Why are the changes needed?

This PR would allow us to fully serialize Char/Varchar types through StringType and is a part of the effort to improve char/varchar support.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Existing tests.

Was this patch authored or co-authored using generative AI tooling?

No.

Note for anyone using dev/gen-protos.sh

Make sure you run pip install -r dev/requirements.txt before running this script. Also make sure to have python in your PATH.

@jovanm-db jovanm-db marked this pull request as ready for review December 13, 2024 13:28
@github-actions github-actions bot added the BUILD label Dec 13, 2024
Copy link
Contributor

@mihailom-db mihailom-db left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, could you just update the description to reflect why we are adding this, i.e. in order to be able to fully serialise Char/Varchar types through StringType.

Copy link
Member

@HyukjinKwon HyukjinKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The change itself seems fine cc @MaxGekk

@mihailom-db
Copy link
Contributor

@MJovan2002 could you please sync with master again, so we can merge this in.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants