We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
According to https://orc.apache.org/specification/ORCv1/
Currently ORC union types are limited to 256 variants, which matches the Hive type model.
However in Arrow, UnionArrays are limited to 127 variants: https://arrow.apache.org/docs/format/Columnar.html#union-layout
A union with more than 127 possible types can be modeled as a union of unions.
To support this, would need to do as above and decode into union of union
See initial Union support here: datafusion-contrib/datafusion-orc@ee69b91
The text was updated successfully, but these errors were encountered:
I'd like to pick up this :)
Sorry, something went wrong.
No branches or pull requests
According to https://orc.apache.org/specification/ORCv1/
However in Arrow, UnionArrays are limited to 127 variants: https://arrow.apache.org/docs/format/Columnar.html#union-layout
To support this, would need to do as above and decode into union of union
See initial Union support here: datafusion-contrib/datafusion-orc@ee69b91
The text was updated successfully, but these errors were encountered: