Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Too many fields end up in attributes for kibana_sample_data_ecommerce index #966

Open
avelanarius opened this issue Nov 8, 2024 · 2 comments
Assignees

Comments

@avelanarius
Copy link
Member

avelanarius commented Nov 8, 2024

When running the latest main (410069d) and the configuration from the kibana-sample-data example, too many fields end up in the attributes, instead of a separate column. With the current version of Quesma it makes it impossible to query the data for those fields.

Zrzut ekranu 2024-11-8 o 11 56 26

Some initial investigation why order_id ends up in attributes: we incorrectly create Nullable(String) column for it, but the data is of type Int64 . And the reason why we create Nullable(String) is because we receive a "PUT /:index/_mapping" that tells us that order_id should be a keyword (so a String).

@pdelewski
Copy link
Contributor

pdelewski commented Nov 14, 2024

Problems discovered for ecommerce:

  • in mapping order_id, customer_id are strings (we create Nullable(String)) but in ingest there are numbers
  • products.discount_amount is created as an array of int64, however there are floats
  • lat, lon are created as Nullable(Strings) but there are floats

@mieciu
Copy link
Member

mieciu commented Nov 20, 2024

@avelanarius I think we're good to call this one done today, right?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants