Table Data with CrateDB - Limited events shown based on time?

[Johnlin1226]

Hi all,

I have a table in Grafana pointing to CrateDB - with about 1mil data inserted incrementally starting from 24th January 18’ till today (insertion still ongoing from connected devices).

Here I have a question: when I select the Time Range starting from January 2018 till now not all data is being shown… (the date range for data is from 24th Jan to 16th Feb)

When I change the Time Range starting from February 2018 onward, the most recent data now appears…(date range for data is from 2nd Feb to 26th Feb)

Question here is, why is this such? and how can I enable such that in selecting any Time Range situation, the Table would show all the data with no limitations?

[chaudum]

The CrateDB datasource only loads a maximum of 100k records which is a hard-coded limit

crate-datasource/src/query_builder.ts

Lines 5 to 7 in a685ae6

	// Maximum LIMIT value
	let MAX_LIMIT = 100000;
	let DEFAULT_LIMIT = 10000;

This is because CrateDB does not support streaming via HTTP and we don't want load all results in the memory which would result in slow query times. https://crate.io/docs/crate/reference/en/latest/general/dql/selects.html#limits