Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Supported Structures in Transform Functions #19

Open
mendonk opened this issue Feb 1, 2023 · 0 comments
Open

Supported Structures in Transform Functions #19

mendonk opened this issue Feb 1, 2023 · 0 comments

Comments

@mendonk
Copy link
Contributor

mendonk commented Feb 1, 2023

drop-fields - only work with structured objects (only AVRO supported today). But it doesn't have to be KeyValue schema, and even in a KeyValue schema, you only need the part from which you want to drop fields from to be structured, they other part could be primitive
drop - both structured and primitive types supported. In the predicate, you can do things like value == 5 for primitive types or value.field == 5 for structured types. Similar thing for the key (in a KeyValue schema).
compute - both structured and primitive types supported.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant