Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Port codegen of arrow datatype to arrow1 #8206

Merged
merged 5 commits into from
Nov 25, 2024
Merged

Port codegen of arrow datatype to arrow1 #8206

merged 5 commits into from
Nov 25, 2024

Conversation

emilk
Copy link
Member

@emilk emilk commented Nov 22, 2024

Copy link

github-actions bot commented Nov 22, 2024

Web viewer built successfully. If applicable, you should also test it:

  • I have tested the web viewer
Result Commit Link
6f7bc78 https://rerun.io/viewer/pr/8206

Note: This comment is updated whenever you push a commit.

@emilk emilk added 🦀 Rust API Rust logging API codegen/idl exclude from changelog PRs with this won't show up in CHANGELOG.md 🚜 refactor Change the code, not the functionality labels Nov 22, 2024
@emilk emilk marked this pull request as ready for review November 22, 2024 14:54
@abey79
Copy link
Member

abey79 commented Nov 25, 2024

@rerun-bot full-check

Copy link

Copy link
Member

@abey79 abey79 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice. Seems rather straightforward. Roundtrip tests passing should be the definitive validation.

@emilk
Copy link
Member Author

emilk commented Nov 25, 2024

@rerun-bot full-check

Copy link

Started a full build: https://github.com/rerun-io/rerun/actions/runs/12007483726

@emilk emilk merged commit a060d06 into main Nov 25, 2024
64 checks passed
@emilk emilk deleted the emilk/arrow1-codegen branch November 25, 2024 10:33
emilk added a commit that referenced this pull request Nov 25, 2024
* Follows #8206
* Part of #3741

## Changes
To implement nullable unions, we have a `_null_marker: Null` variants in
all our unions. This means all our unions are nullable.

Previously we would only mark a struct field as nullable if it was
declared as such in the `.fbs` file, but `arrow-rs` complains about
this. So with this PR, if a struct field refers to a union type, that
struct field will be marked as `nullable: true` in the datatype (in
Rust, Python and C++).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
codegen/idl exclude from changelog PRs with this won't show up in CHANGELOG.md 🚜 refactor Change the code, not the functionality 🦀 Rust API Rust logging API
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants