Parquet files (#13)

adds parquet sample data
deephaven · Jun 16, 2021 · 5897c62 · 5897c62
1 parent 51e308f
commit 5897c62
Show file tree

Hide file tree

Showing 24 changed files with 38 additions and 1 deletion.
diff --git a/README.md b/README.md
@@ -10,14 +10,18 @@ The following folders can be found in this repository:
 - **[`iris`](https://archive.ics.uci.edu/ml/datasets/iris)** - The iris flower data set from Ronald Fisher's 1936 paper
 - **[`metriccentury`](https://github.com/mikeblas/samples-junk/tree/main/metriccentury)** - Data recorded from a 100 km bike ride
 - **[`DeNiro`](https://people.sc.fsu.edu/~jburkardt/data/csv/csv.html)** - Data on Robert De Niro's movies up to 2016
+- **`parquet`** - Sample parquet data in many formats
 
 ## Description
 
-Each folder in this repository has two items within:
+Each folder in this repository except parquet has two items within:
 
  - `README` - An explanation of everything about the data
  - `csv` - A folder with all relevant data in either CSV or TSV format
 
+parquet instead contains a number of standalone .parquet files with different data formats
+
+
 ## Installation Instructions
 
 1. Follow the README instructions on [Deephaven Community Core](https://github.com/deephaven/deephaven-core) for installing the OSS client and all required dependencies.

diff --git a/parquet/.DS_Store b/parquet/.DS_Store
diff --git a/parquet/README.md b/parquet/README.md
@@ -0,0 +1,33 @@
+# Parquet Sample data
+
+This folder contains sample files in various format
+
+## Table of contents
+
+- `alltypes_dictionary.parquet`: Parquet file using int32, int 64, int 96 timestamps
+- `alltypes_plain.parquet`: Parquet file using int32, int 64, int 96 timestamps
+- `alltypes_plain.snappy.parquet`: Parquet file using int32, int 64, int 96 timestamps with snappy compression
+- `customer.impala.GZIP.parquet`: Parquet file with GZIP compression
+- `customer.impala.NONE.parquet`: Parquet file with no compression
+- `customer.impala.SNAPPY.parquet`: Parquet file with snappy compression
+- `flow.snappy.parquet`: Parquet file doubles and with snappy compression
+- `monthlyProductSales.parquet`: Parquet file with whitespace
+- `nation.dict-malformed.parquet`: Non-Standard Parquet file
+- `nation.impala.SNAPPY.parquet`: Parquet file with int32 and binary, snappy compression
+- `nation.impala.GZIP.parquet`: Parquet file with int32 and binary, GZIP compression
+- `nation.impala.NONE.parquet`: Parquet file with int32 and binary, no compression
+- `nested_lists.snappy.parquet`: Nested Parquet file with snappy compression
+- `nested_maps.snappy.parquet`: Nested Parquet map file with snappy compression
+- `nonnullable.impala.parquet`: Nested Parquet file with maps and no nulls
+- `nullable.impala.parquet`: Nested Parquet file with maps and nulls
+- `nulls.snappy.parquet`: Nested Parquet file with maps and nulls, snappy compression
+- `repeated_no_annotation.parquet`: Nested Parquet file with repeat values
+- `stock_simulated.parquet`: Sample stock data in Parquet format
+- `taxi.parquet`: Parquet data with millis timestamps
+- `test_datapage_v2.snappy.parquet`: Nested Parquet list file with snappy compression
+
+
+
+# Source and License
+
+This data was built from data sets publicly available.  It is provided here for demonstrative use without any warranty as to the accuracy, reliability, or completeness of the data.
diff --git a/parquet/alltypes_dictionary.parquet b/parquet/alltypes_dictionary.parquet
diff --git a/parquet/alltypes_plain.parquet b/parquet/alltypes_plain.parquet
diff --git a/parquet/alltypes_plain.snappy.parquet b/parquet/alltypes_plain.snappy.parquet
diff --git a/parquet/customer.impala.GZIP.parquet b/parquet/customer.impala.GZIP.parquet
diff --git a/parquet/customer.impala.NONE.parquet b/parquet/customer.impala.NONE.parquet
diff --git a/parquet/customer.impala.SNAPPY.parquet b/parquet/customer.impala.SNAPPY.parquet
diff --git a/parquet/flow.snappy.parquet b/parquet/flow.snappy.parquet
diff --git a/parquet/monthlyProductSales.parquet b/parquet/monthlyProductSales.parquet
diff --git a/parquet/nation.dict-malformed.parquet b/parquet/nation.dict-malformed.parquet
diff --git a/parquet/nation.impala.GZIP.parquet b/parquet/nation.impala.GZIP.parquet
diff --git a/parquet/nation.impala.NONE.parquet b/parquet/nation.impala.NONE.parquet
diff --git a/parquet/nation.impala.SNAPPY.parquet b/parquet/nation.impala.SNAPPY.parquet
diff --git a/parquet/nested_lists.snappy.parquet b/parquet/nested_lists.snappy.parquet
diff --git a/parquet/nested_maps.snappy.parquet b/parquet/nested_maps.snappy.parquet
diff --git a/parquet/nonnullable.impala.parquet b/parquet/nonnullable.impala.parquet
diff --git a/parquet/nullable.impala.parquet b/parquet/nullable.impala.parquet
diff --git a/parquet/nulls.snappy.parquet b/parquet/nulls.snappy.parquet
diff --git a/parquet/repeated_no_annotation.parquet b/parquet/repeated_no_annotation.parquet
diff --git a/parquet/stock_simulated.parquet b/parquet/stock_simulated.parquet
diff --git a/parquet/taxi.parquet b/parquet/taxi.parquet
diff --git a/parquet/test_datapage_v2.snappy.parquet b/parquet/test_datapage_v2.snappy.parquet