openLooKeng can use omnidata-openlookeng-connector to visit omnidata feature for nearly data process.
Spark can use omnidata-spark-connector to visit omnidata feature for nearly data process.
Hive can use omnidata-hive-connector to visit omnidata feature for nearly data process.
Overview
In this version, the library supports filter, aggregation, and limit pushdown for openLooKeng/Spark SQL/Hive SQL.
This library is developed based on openLooKeng 1.6.1 and provides required JAR files.
This library is developed based on Apache Hive 3.1.0 and provides required JAR files.
This library is developed based on Apache Spark SQL v3.0.0 and Apache Spark SQL v3.1.1 and provides required JAR files.
Changes
This release includes the operator pushdown of openLooKeng/Spark and four zip files:
-feature: Supported filter, aggregation, and limit pushdown of openLooKeng/Spark SQL.
update the omniData to version 13.0.
-boostkit-omnidata-openlookeng-1.6.1-1.3.0-aarch64.zip: Released a zip of openLooKeng Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-spark-sql_2.12-3.0.0-1.3.0-aarch64.zip: Released a zip of Spark v3.0.0 Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-spark-sql_2.12-3.1.1-1.3.0-aarch64.zip: Released a zip of Spark v3.1.1 Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-server-1.3.0-aarch64-lib.zip: Released a zip of OmniData Server which contains JAR files of third-party dependency.
-boostkit-omnidata-udf-1.3.0-aarch64.zip: Released a zip of OmniData UDF which contains JAR files of third-party dependency.
-boostkit-omnidata-hive-udf-loader-1.6.1-1.3.0-aarch64.zip: Released a zip of OmniData External Hive UDF which contains JAR files of third-party dependency.
-boostkit-omnidata-hive-exec-3.1.0-1.3.0.zip: Released a zip of Hive Connector which contains JAR files of third-party dependency and this library packaged.