@@ -42,8 +42,8 @@
| [excel](/src/cmd/excel.rs#L2) π | Exports a specified Excel/ODS sheet to a CSV file. |
| [exclude](/src/cmd/exclude.rs#L2) ππ | Removes a set of CSV data from another set based on the specified columns. |
| [explode](/src/cmd/explode.rs#L2) π£π | Explode rows into multiple ones by splitting a column value based on the given separator. |
-| [extdedup](/src/cmd/extdedup.rs#L2) | Remove duplicate rows from an arbitrarily large CSV/text file using a memory-mapped, [on-disk hash table](https://crates.io/crates/odht). Unlike the `dedup` command, this command does not load the entire file into memory nor does it sort the deduped file. |
-| [extsort](/src/cmd/extsort.rs#L2) π | Sort an arbitrarily large CSV/text file using a multithreaded [external merge sort](https://en.wikipedia.org/wiki/External_sorting) algorithm. |
+| [extdedup](/src/cmd/extdedup.rs#L2) π | Remove duplicate rows from an arbitrarily large CSV/text file using a memory-mapped, [on-disk hash table](https://crates.io/crates/odht). Unlike the `dedup` command, this command does not load the entire file into memory nor does it sort the deduped file. |
+| [extsort](/src/cmd/extsort.rs#L2) πππ | Sort an arbitrarily large CSV/text file using a multithreaded [external merge sort](https://en.wikipedia.org/wiki/External_sorting) algorithm. |
| [fetch](/src/cmd/fetch.rs#L3) β¨π§ π | Fetches data from web services for every row using **HTTP Get**. Comes with [HTTP/2](https://http2-explained.haxx.se/en/part1) [adaptive flow control](https://medium.com/coderscorner/http-2-flow-control-77e54f7fd518), [jql](https://github.com/yamafaktory/jql#%EF%B8%8F-usage) JSON query language support, dynamic throttling ([RateLimit](https://www.ietf.org/archive/id/draft-ietf-httpapi-ratelimit-headers-06.html)) & caching with available persistent caching using [Redis](https://redis.io/) or a disk-cache. |
| [fetchpost](/src/cmd/fetchpost.rs#L3) β¨π§ π | Similar to `fetch`, but uses **HTTP Post**. ([HTTP GET vs POST methods](https://www.geeksforgeeks.org/difference-between-http-get-and-post-methods/)) |
| [fill](/src/cmd/fill.rs#L2) π | Fill empty values. |
@@ -87,7 +87,7 @@
| [to](/src/cmd/to.rs#L2) β¨πποΈ | Convert CSV files to [PostgreSQL](https://www.postgresql.org), [SQLite](https://www.sqlite.org/index.html), XLSX and [Data Package](https://datahub.io/docs/data-packages/tabular). |
| [tojsonl](/src/cmd/tojsonl.rs#L3) ππ£ππ£πͺ | Smartly converts CSV to a newline-delimited JSON ([JSONL](https://jsonlines.org/)/[NDJSON](http://ndjson.org/)). By scanning the CSV first, it "smartly" infers the appropriate JSON data type for each column. See `jsonl` command to convert JSONL to CSV. |
| [transpose](/src/cmd/transpose.rs#L2) π€― | Transpose rows/columns of a CSV. |
-| [validate](/src/cmd/validate.rs#L2) πππ | Validate CSV data [_blazingly-fast_](https://github.com/Stranger6667/jsonschema-rs?tab=readme-ov-file#performance "using jsonschema-rs - the fastest JSON Schema validator for Rust") using [JSON Schema Validation (Draft 2020-12)](https://json-schema.org/draft/2020-12/json-schema-validation.html) (e.g. _up to 761,035 rows/second_[^1] using [NYC's 311 schema](https://github.com/jqnatividad/qsv/blob/master/resources/test/311_Service_Requests_from_2010_to_Present-2022-03-04.csv.schema.json) generated by the [`schema`](#schema_deeplink) command) & put invalid records into a separate file with an accompanying detailed validation error report file. Supports a custom `currency` format with [ISO-4217](https://en.wikipedia.org/wiki/ISO_4217) validation, and a custom `dynamicEnum` keyword that supports enum validation against a CSV on the filesystem or on a URL. If no JSON schema file is provided, validates if a CSV conforms to the [RFC 4180 standard](#rfc-4180-csv-standard) and is UTF-8 encoded. |
+| [validate](/src/cmd/validate.rs#L2) πππ | Validate CSV data [_blazingly-fast_](https://github.com/Stranger6667/jsonschema-rs?tab=readme-ov-file#performance "using jsonschema-rs - the fastest JSON Schema validator for Rust") using [JSON Schema Validation (Draft 2020-12)](https://json-schema.org/draft/2020-12/json-schema-validation.html) (e.g. _up to 780,031 rows/second_[^1] using [NYC's 311 schema](https://github.com/jqnatividad/qsv/blob/master/resources/test/311_Service_Requests_from_2010_to_Present-2022-03-04.csv.schema.json) generated by the [`schema`](#schema_deeplink) command) & put invalid records into a separate file with an accompanying detailed validation error report file. Supports a custom `currency` format with [ISO-4217](https://en.wikipedia.org/wiki/ISO_4217) validation, and a custom `dynamicEnum` keyword that supports enum validation against a CSV on the filesystem or on a URL. If no JSON schema file is provided, validates if a CSV conforms to the [RFC 4180 standard](#rfc-4180-csv-standard) and is UTF-8 encoded. |
Performance metrics compiled on an M2 Pro 12-core Mac Mini with 32gb RAM
@@ -97,7 +97,7 @@
π£: uses additional memory proportional to the cardinality of the columns in the CSV.
π§ : expensive operations are memoized with available inter-session Redis/Disk caching for fetch commands.
ποΈ: [Extended input support](#extended-input-support).
-π»ββοΈ: command powered by [ at py-1.9.0 tag](https://github.com/pola-rs/polars/releases/tag/py-1.9.0).
+π»ββοΈ: command powered by [ at py-1.10.0 tag](https://github.com/pola-rs/polars/releases/tag/py-1.10.0).
π€: command uses Natural Language Processing & General AI techniques.
ποΈ: multithreaded and/or faster when an index (π) is available.
π: multithreaded even without an index.
@@ -435,7 +435,7 @@ Luau will also serve as the backbone of a whole library of **qsv recipes** - reu
as command line interfaces go :shrug:. Its commands have numerous options but have sensible defaults. The usage text is written for a data analyst audience, not developers; and there are numerous examples in the usage text, with the tests doubling as examples as well. With [qsv pro](https://qsvpro.dathere.com), it has much expanded functionality while being easier to use with its Graphical User Interface.
* **As Secure as Possible** - qsv is designed to be secure. It has no external runtime dependencies, is [written](https://aws.amazon.com/blogs/opensource/why-aws-loves-rust-and-how-wed-like-to-help/) [in](https://msrc.microsoft.com/blog/2019/07/why-rust-for-safe-systems-programming/) [Rust](https://opensource.googleblog.com/2023/06/rust-fact-vs-fiction-5-insights-from-googles-rust-journey-2022.html), and it's codebase is automatically audited for security vulnerabilities with automated [DevSkim](https://github.com/microsoft/DevSkim#devskim), ["cargo audit"](https://rustsec.org) and [Codacy](https://app.codacy.com/gh/jqnatividad/qsv/dashboard) Github Actions workflows.
It uses the latest stable Rust version, with an aggressive MSRV policy and the latest version of all its dependencies.
-It has an extensive test suite with ~1,550 tests, including several [property tests](https://medium.com/criteo-engineering/introduction-to-property-based-testing-f5236229d237) which [randomly generate](https://github.com/BurntSushi/quickcheck#quickcheck) parameters for oft-used commands.
+It has an extensive test suite with ~1,570 tests, including several [property tests](https://medium.com/criteo-engineering/introduction-to-property-based-testing-f5236229d237) which [randomly generate](https://github.com/BurntSushi/quickcheck#quickcheck) parameters for oft-used commands.
Its prebuilt binary archives are [zipsigned](https://github.com/Kijewski/zipsign#zipsign), so you can [verify their integrity](#verifying-the-integrity-of-the-prebuilt-binaries-zip-archives). Its self-update mechanism automatically verifies the integrity of the prebuilt binaries archive before applying an update.
See [Security](docs/SECURITY.md) for more info.
* **As Easy to Contribute to as Possible** - qsv is designed to be easy to contribute to, with a focus on maintainability. It's modular architecture allows the easy addition of self-contained commands gated by feature flags, the source code is heavily commented, the usage text is embedded, and there are helper functions that make it easy to create additional commands and supporting tests. See [Features](docs/FEATURES.md) and [Contributing](CONTRIBUTING.md) for more info.
@@ -448,7 +448,7 @@ It can process well-formed CSVs in _any_ language so long as its UTF-8 encoded.
Finally, though the default Geonames index of the `geocode` command is English-only, the index can be rebuilt with the `geocode index-update` subcommand with the `--languages` option to return place names in multiple languages ([with support for 254 languages](http://download.geonames.org/export/dump/alternatenames/)).
## Testing
-qsv has ~1,550 tests in the [tests](https://github.com/jqnatividad/qsv/tree/master/tests) directory.
+qsv has ~1,570 tests in the [tests](https://github.com/jqnatividad/qsv/tree/master/tests) directory.
Each command has its own test suite in a separate file with the convention `test_.rs`.
Apart from preventing regressions, the tests also serve as good illustrative examples, and are often linked from the usage text of each corresponding command.
diff --git a/contrib/completions/examples/qsv.bash b/contrib/completions/examples/qsv.bash
index 34c86432f..5b2dc9cc2 100644
--- a/contrib/completions/examples/qsv.bash
+++ b/contrib/completions/examples/qsv.bash
@@ -1180,7 +1180,7 @@ _qsv() {
return 0
;;
qsv__extdedup)
- opts="-h --no-output --dupes-output --human-readable --memory-limit --quiet --help"
+ opts="-h --select --no-output --dupes-output --human-readable --memory-limit --no-headers --delimiter --quiet --help"
if [[ ${cur} == -* || ${COMP_CWORD} -eq 2 ]] ; then
COMPREPLY=( $(compgen -W "${opts}" -- "${cur}") )
return 0
@@ -1194,7 +1194,7 @@ _qsv() {
return 0
;;
qsv__extsort)
- opts="-h --memory-limit --tmp-dir --jobs --no-headers --help"
+ opts="-h --select --reverse --memory-limit --tmp-dir --jobs --delimiter --no-headers --help"
if [[ ${cur} == -* || ${COMP_CWORD} -eq 2 ]] ; then
COMPREPLY=( $(compgen -W "${opts}" -- "${cur}") )
return 0
@@ -1208,7 +1208,7 @@ _qsv() {
return 0
;;
qsv__fetch)
- opts="-h --url-template --new-column --jql --jqlfile --pretty --rate-limit --timeout --http-header --max-retries --max-errors --store-error --cookies --user-agent --report --no-cache --mem-cache-size --disk-cache --disk-cache-dir --redis-cache --cache-error --flush-cache --output --no-headers --delimiter --progressbar --help"
+ opts="-h --url-template --new-column --jaq --jaqfile --pretty --rate-limit --timeout --http-header --max-retries --max-errors --store-error --cookies --user-agent --report --no-cache --mem-cache-size --disk-cache --disk-cache-dir --redis-cache --cache-error --flush-cache --output --no-headers --delimiter --progressbar --help"
if [[ ${cur} == -* || ${COMP_CWORD} -eq 2 ]] ; then
COMPREPLY=( $(compgen -W "${opts}" -- "${cur}") )
return 0
@@ -1222,7 +1222,7 @@ _qsv() {
return 0
;;
qsv__fetchpost)
- opts="-h --new-column --jql --jqlfile --pretty --rate-limit --timeout --http-header --compress --max-retries --max-errors --store-error --cookies --user-agent --report --no-cache --mem-cache-size --disk-cache --disk-cache-dir --redis-cache --cache-error --flush-cache --output --no-headers --delimiter --progressbar --help"
+ opts="-h --new-column --jaq --jaqfile --pretty --rate-limit --timeout --http-header --compress --max-retries --max-errors --store-error --cookies --user-agent --report --no-cache --mem-cache-size --disk-cache --disk-cache-dir --redis-cache --cache-error --flush-cache --output --no-headers --delimiter --progressbar --help"
if [[ ${cur} == -* || ${COMP_CWORD} -eq 2 ]] ; then
COMPREPLY=( $(compgen -W "${opts}" -- "${cur}") )
return 0
@@ -3756,7 +3756,7 @@ _qsv() {
return 0
;;
qsv__sqlp)
- opts="-h --format --try-parsedates --infer-len --streaming --low-memory --no-optimizations --truncate-ragged-lines --ignore-errors --rnull-values --decimal-comma --datetime-format --date-format --time-format --float-precision --wnull-value --compression --compress-level --statistics --output --delimiter --quiet --help"
+ opts="-h --format --try-parsedates --infer-len --cache-schema --streaming --low-memory --no-optimizations --truncate-ragged-lines --ignore-errors --rnull-values --decimal-comma --datetime-format --date-format --time-format --float-precision --wnull-value --compression --compress-level --statistics --output --delimiter --quiet --help"
if [[ ${cur} == -* || ${COMP_CWORD} -eq 2 ]] ; then
COMPREPLY=( $(compgen -W "${opts}" -- "${cur}") )
return 0
diff --git a/contrib/completions/examples/qsv.elv b/contrib/completions/examples/qsv.elv
index 2ad7c31c3..4c6aff843 100644
--- a/contrib/completions/examples/qsv.elv
+++ b/contrib/completions/examples/qsv.elv
@@ -380,18 +380,24 @@ set edit:completion:arg-completer[qsv] = {|@words|
cand --help 'Print help'
}
&'qsv;extdedup'= {
+ cand --select 'select'
cand --no-output 'no-output'
cand --dupes-output 'dupes-output'
cand --human-readable 'human-readable'
cand --memory-limit 'memory-limit'
+ cand --no-headers 'no-headers'
+ cand --delimiter 'delimiter'
cand --quiet 'quiet'
cand -h 'Print help'
cand --help 'Print help'
}
&'qsv;extsort'= {
+ cand --select 'select'
+ cand --reverse 'reverse'
cand --memory-limit 'memory-limit'
cand --tmp-dir 'tmp-dir'
cand --jobs 'jobs'
+ cand --delimiter 'delimiter'
cand --no-headers 'no-headers'
cand -h 'Print help'
cand --help 'Print help'
@@ -407,8 +413,8 @@ set edit:completion:arg-completer[qsv] = {|@words|
&'qsv;fetch'= {
cand --url-template 'url-template'
cand --new-column 'new-column'
- cand --jql 'jql'
- cand --jqlfile 'jqlfile'
+ cand --jaq 'jaq'
+ cand --jaqfile 'jaqfile'
cand --pretty 'pretty'
cand --rate-limit 'rate-limit'
cand --timeout 'timeout'
@@ -435,8 +441,8 @@ set edit:completion:arg-completer[qsv] = {|@words|
}
&'qsv;fetchpost'= {
cand --new-column 'new-column'
- cand --jql 'jql'
- cand --jqlfile 'jqlfile'
+ cand --jaq 'jaq'
+ cand --jaqfile 'jaqfile'
cand --pretty 'pretty'
cand --rate-limit 'rate-limit'
cand --timeout 'timeout'
@@ -1392,6 +1398,7 @@ set edit:completion:arg-completer[qsv] = {|@words|
cand --format 'format'
cand --try-parsedates 'try-parsedates'
cand --infer-len 'infer-len'
+ cand --cache-schema 'cache-schema'
cand --streaming 'streaming'
cand --low-memory 'low-memory'
cand --no-optimizations 'no-optimizations'
diff --git a/contrib/completions/examples/qsv.fig.js b/contrib/completions/examples/qsv.fig.js
index f934df9a9..9d56c217a 100644
--- a/contrib/completions/examples/qsv.fig.js
+++ b/contrib/completions/examples/qsv.fig.js
@@ -743,6 +743,9 @@ const completion: Fig.Spec = {
{
name: "extdedup",
options: [
+ {
+ name: "--select",
+ },
{
name: "--no-output",
},
@@ -755,6 +758,12 @@ const completion: Fig.Spec = {
{
name: "--memory-limit",
},
+ {
+ name: "--no-headers",
+ },
+ {
+ name: "--delimiter",
+ },
{
name: "--quiet",
},
@@ -767,6 +776,12 @@ const completion: Fig.Spec = {
{
name: "extsort",
options: [
+ {
+ name: "--select",
+ },
+ {
+ name: "--reverse",
+ },
{
name: "--memory-limit",
},
@@ -776,6 +791,9 @@ const completion: Fig.Spec = {
{
name: "--jobs",
},
+ {
+ name: "--delimiter",
+ },
{
name: "--no-headers",
},
@@ -816,10 +834,10 @@ const completion: Fig.Spec = {
name: "--new-column",
},
{
- name: "--jql",
+ name: "--jaq",
},
{
- name: "--jqlfile",
+ name: "--jaqfile",
},
{
name: "--pretty",
@@ -897,10 +915,10 @@ const completion: Fig.Spec = {
name: "--new-column",
},
{
- name: "--jql",
+ name: "--jaq",
},
{
- name: "--jqlfile",
+ name: "--jaqfile",
},
{
name: "--pretty",
@@ -3386,6 +3404,9 @@ const completion: Fig.Spec = {
{
name: "--infer-len",
},
+ {
+ name: "--cache-schema",
+ },
{
name: "--streaming",
},
diff --git a/contrib/completions/examples/qsv.fish b/contrib/completions/examples/qsv.fish
index 3ff658281..0e82b0897 100644
--- a/contrib/completions/examples/qsv.fish
+++ b/contrib/completions/examples/qsv.fish
@@ -301,15 +301,21 @@ complete -c qsv -n "__fish_qsv_using_subcommand exclude" -l output
complete -c qsv -n "__fish_qsv_using_subcommand exclude" -l no-headers
complete -c qsv -n "__fish_qsv_using_subcommand exclude" -l delimiter
complete -c qsv -n "__fish_qsv_using_subcommand exclude" -s h -l help -d 'Print help'
+complete -c qsv -n "__fish_qsv_using_subcommand extdedup" -l select
complete -c qsv -n "__fish_qsv_using_subcommand extdedup" -l no-output
complete -c qsv -n "__fish_qsv_using_subcommand extdedup" -l dupes-output
complete -c qsv -n "__fish_qsv_using_subcommand extdedup" -l human-readable
complete -c qsv -n "__fish_qsv_using_subcommand extdedup" -l memory-limit
+complete -c qsv -n "__fish_qsv_using_subcommand extdedup" -l no-headers
+complete -c qsv -n "__fish_qsv_using_subcommand extdedup" -l delimiter
complete -c qsv -n "__fish_qsv_using_subcommand extdedup" -l quiet
complete -c qsv -n "__fish_qsv_using_subcommand extdedup" -s h -l help -d 'Print help'
+complete -c qsv -n "__fish_qsv_using_subcommand extsort" -l select
+complete -c qsv -n "__fish_qsv_using_subcommand extsort" -l reverse
complete -c qsv -n "__fish_qsv_using_subcommand extsort" -l memory-limit
complete -c qsv -n "__fish_qsv_using_subcommand extsort" -l tmp-dir
complete -c qsv -n "__fish_qsv_using_subcommand extsort" -l jobs
+complete -c qsv -n "__fish_qsv_using_subcommand extsort" -l delimiter
complete -c qsv -n "__fish_qsv_using_subcommand extsort" -l no-headers
complete -c qsv -n "__fish_qsv_using_subcommand extsort" -s h -l help -d 'Print help'
complete -c qsv -n "__fish_qsv_using_subcommand explode" -l rename
@@ -319,8 +325,8 @@ complete -c qsv -n "__fish_qsv_using_subcommand explode" -l delimiter
complete -c qsv -n "__fish_qsv_using_subcommand explode" -s h -l help -d 'Print help'
complete -c qsv -n "__fish_qsv_using_subcommand fetch" -l url-template
complete -c qsv -n "__fish_qsv_using_subcommand fetch" -l new-column
-complete -c qsv -n "__fish_qsv_using_subcommand fetch" -l jql
-complete -c qsv -n "__fish_qsv_using_subcommand fetch" -l jqlfile
+complete -c qsv -n "__fish_qsv_using_subcommand fetch" -l jaq
+complete -c qsv -n "__fish_qsv_using_subcommand fetch" -l jaqfile
complete -c qsv -n "__fish_qsv_using_subcommand fetch" -l pretty
complete -c qsv -n "__fish_qsv_using_subcommand fetch" -l rate-limit
complete -c qsv -n "__fish_qsv_using_subcommand fetch" -l timeout
@@ -344,8 +350,8 @@ complete -c qsv -n "__fish_qsv_using_subcommand fetch" -l delimiter
complete -c qsv -n "__fish_qsv_using_subcommand fetch" -l progressbar
complete -c qsv -n "__fish_qsv_using_subcommand fetch" -s h -l help -d 'Print help'
complete -c qsv -n "__fish_qsv_using_subcommand fetchpost" -l new-column
-complete -c qsv -n "__fish_qsv_using_subcommand fetchpost" -l jql
-complete -c qsv -n "__fish_qsv_using_subcommand fetchpost" -l jqlfile
+complete -c qsv -n "__fish_qsv_using_subcommand fetchpost" -l jaq
+complete -c qsv -n "__fish_qsv_using_subcommand fetchpost" -l jaqfile
complete -c qsv -n "__fish_qsv_using_subcommand fetchpost" -l pretty
complete -c qsv -n "__fish_qsv_using_subcommand fetchpost" -l rate-limit
complete -c qsv -n "__fish_qsv_using_subcommand fetchpost" -l timeout
@@ -1070,6 +1076,7 @@ complete -c qsv -n "__fish_qsv_using_subcommand split" -s h -l help -d 'Print he
complete -c qsv -n "__fish_qsv_using_subcommand sqlp" -l format
complete -c qsv -n "__fish_qsv_using_subcommand sqlp" -l try-parsedates
complete -c qsv -n "__fish_qsv_using_subcommand sqlp" -l infer-len
+complete -c qsv -n "__fish_qsv_using_subcommand sqlp" -l cache-schema
complete -c qsv -n "__fish_qsv_using_subcommand sqlp" -l streaming
complete -c qsv -n "__fish_qsv_using_subcommand sqlp" -l low-memory
complete -c qsv -n "__fish_qsv_using_subcommand sqlp" -l no-optimizations
diff --git a/contrib/completions/examples/qsv.nu b/contrib/completions/examples/qsv.nu
index 87dd07b1d..2e32d7eb1 100644
--- a/contrib/completions/examples/qsv.nu
+++ b/contrib/completions/examples/qsv.nu
@@ -298,18 +298,24 @@ module completions {
]
export extern "qsv extdedup" [
+ --select
--no-output
--dupes-output
--human-readable
--memory-limit
+ --no-headers
+ --delimiter
--quiet
--help(-h) # Print help
]
export extern "qsv extsort" [
+ --select
+ --reverse
--memory-limit
--tmp-dir
--jobs
+ --delimiter
--no-headers
--help(-h) # Print help
]
@@ -325,8 +331,8 @@ module completions {
export extern "qsv fetch" [
--url-template
--new-column
- --jql
- --jqlfile
+ --jaq
+ --jaqfile
--pretty
--rate-limit
--timeout
@@ -353,8 +359,8 @@ module completions {
export extern "qsv fetchpost" [
--new-column
- --jql
- --jqlfile
+ --jaq
+ --jaqfile
--pretty
--rate-limit
--timeout
@@ -1300,6 +1306,7 @@ module completions {
--format
--try-parsedates
--infer-len
+ --cache-schema
--streaming
--low-memory
--no-optimizations
diff --git a/contrib/completions/examples/qsv.ps1 b/contrib/completions/examples/qsv.ps1
index 6d4852baa..4196389f4 100644
--- a/contrib/completions/examples/qsv.ps1
+++ b/contrib/completions/examples/qsv.ps1
@@ -415,19 +415,25 @@ Register-ArgumentCompleter -Native -CommandName 'qsv' -ScriptBlock {
break
}
'qsv;extdedup' {
+ [CompletionResult]::new('--select', 'select', [CompletionResultType]::ParameterName, 'select')
[CompletionResult]::new('--no-output', 'no-output', [CompletionResultType]::ParameterName, 'no-output')
[CompletionResult]::new('--dupes-output', 'dupes-output', [CompletionResultType]::ParameterName, 'dupes-output')
[CompletionResult]::new('--human-readable', 'human-readable', [CompletionResultType]::ParameterName, 'human-readable')
[CompletionResult]::new('--memory-limit', 'memory-limit', [CompletionResultType]::ParameterName, 'memory-limit')
+ [CompletionResult]::new('--no-headers', 'no-headers', [CompletionResultType]::ParameterName, 'no-headers')
+ [CompletionResult]::new('--delimiter', 'delimiter', [CompletionResultType]::ParameterName, 'delimiter')
[CompletionResult]::new('--quiet', 'quiet', [CompletionResultType]::ParameterName, 'quiet')
[CompletionResult]::new('-h', 'h', [CompletionResultType]::ParameterName, 'Print help')
[CompletionResult]::new('--help', 'help', [CompletionResultType]::ParameterName, 'Print help')
break
}
'qsv;extsort' {
+ [CompletionResult]::new('--select', 'select', [CompletionResultType]::ParameterName, 'select')
+ [CompletionResult]::new('--reverse', 'reverse', [CompletionResultType]::ParameterName, 'reverse')
[CompletionResult]::new('--memory-limit', 'memory-limit', [CompletionResultType]::ParameterName, 'memory-limit')
[CompletionResult]::new('--tmp-dir', 'tmp-dir', [CompletionResultType]::ParameterName, 'tmp-dir')
[CompletionResult]::new('--jobs', 'jobs', [CompletionResultType]::ParameterName, 'jobs')
+ [CompletionResult]::new('--delimiter', 'delimiter', [CompletionResultType]::ParameterName, 'delimiter')
[CompletionResult]::new('--no-headers', 'no-headers', [CompletionResultType]::ParameterName, 'no-headers')
[CompletionResult]::new('-h', 'h', [CompletionResultType]::ParameterName, 'Print help')
[CompletionResult]::new('--help', 'help', [CompletionResultType]::ParameterName, 'Print help')
@@ -445,8 +451,8 @@ Register-ArgumentCompleter -Native -CommandName 'qsv' -ScriptBlock {
'qsv;fetch' {
[CompletionResult]::new('--url-template', 'url-template', [CompletionResultType]::ParameterName, 'url-template')
[CompletionResult]::new('--new-column', 'new-column', [CompletionResultType]::ParameterName, 'new-column')
- [CompletionResult]::new('--jql', 'jql', [CompletionResultType]::ParameterName, 'jql')
- [CompletionResult]::new('--jqlfile', 'jqlfile', [CompletionResultType]::ParameterName, 'jqlfile')
+ [CompletionResult]::new('--jaq', 'jaq', [CompletionResultType]::ParameterName, 'jaq')
+ [CompletionResult]::new('--jaqfile', 'jaqfile', [CompletionResultType]::ParameterName, 'jaqfile')
[CompletionResult]::new('--pretty', 'pretty', [CompletionResultType]::ParameterName, 'pretty')
[CompletionResult]::new('--rate-limit', 'rate-limit', [CompletionResultType]::ParameterName, 'rate-limit')
[CompletionResult]::new('--timeout', 'timeout', [CompletionResultType]::ParameterName, 'timeout')
@@ -474,8 +480,8 @@ Register-ArgumentCompleter -Native -CommandName 'qsv' -ScriptBlock {
}
'qsv;fetchpost' {
[CompletionResult]::new('--new-column', 'new-column', [CompletionResultType]::ParameterName, 'new-column')
- [CompletionResult]::new('--jql', 'jql', [CompletionResultType]::ParameterName, 'jql')
- [CompletionResult]::new('--jqlfile', 'jqlfile', [CompletionResultType]::ParameterName, 'jqlfile')
+ [CompletionResult]::new('--jaq', 'jaq', [CompletionResultType]::ParameterName, 'jaq')
+ [CompletionResult]::new('--jaqfile', 'jaqfile', [CompletionResultType]::ParameterName, 'jaqfile')
[CompletionResult]::new('--pretty', 'pretty', [CompletionResultType]::ParameterName, 'pretty')
[CompletionResult]::new('--rate-limit', 'rate-limit', [CompletionResultType]::ParameterName, 'rate-limit')
[CompletionResult]::new('--timeout', 'timeout', [CompletionResultType]::ParameterName, 'timeout')
@@ -1518,6 +1524,7 @@ Register-ArgumentCompleter -Native -CommandName 'qsv' -ScriptBlock {
[CompletionResult]::new('--format', 'format', [CompletionResultType]::ParameterName, 'format')
[CompletionResult]::new('--try-parsedates', 'try-parsedates', [CompletionResultType]::ParameterName, 'try-parsedates')
[CompletionResult]::new('--infer-len', 'infer-len', [CompletionResultType]::ParameterName, 'infer-len')
+ [CompletionResult]::new('--cache-schema', 'cache-schema', [CompletionResultType]::ParameterName, 'cache-schema')
[CompletionResult]::new('--streaming', 'streaming', [CompletionResultType]::ParameterName, 'streaming')
[CompletionResult]::new('--low-memory', 'low-memory', [CompletionResultType]::ParameterName, 'low-memory')
[CompletionResult]::new('--no-optimizations', 'no-optimizations', [CompletionResultType]::ParameterName, 'no-optimizations')
diff --git a/contrib/completions/examples/qsv.zsh b/contrib/completions/examples/qsv.zsh
index d2c54db7d..ad63a26e6 100644
--- a/contrib/completions/examples/qsv.zsh
+++ b/contrib/completions/examples/qsv.zsh
@@ -416,10 +416,13 @@ _arguments "${_arguments_options[@]}" : \
;;
(extdedup)
_arguments "${_arguments_options[@]}" : \
+'--select[]' \
'--no-output[]' \
'--dupes-output[]' \
'--human-readable[]' \
'--memory-limit[]' \
+'--no-headers[]' \
+'--no-delimiter[]' \
'--quiet[]' \
'-h[Print help]' \
'--help[Print help]' \
@@ -427,9 +430,12 @@ _arguments "${_arguments_options[@]}" : \
;;
(extsort)
_arguments "${_arguments_options[@]}" : \
+'--select[]' \
+'--reverse[]' \
'--memory-limit[]' \
'--tmp-dir[]' \
'--jobs[]' \
+'--delimiter[]' \
'--no-headers[]' \
'-h[Print help]' \
'--help[Print help]' \
@@ -449,8 +455,8 @@ _arguments "${_arguments_options[@]}" : \
_arguments "${_arguments_options[@]}" : \
'--url-template[]' \
'--new-column[]' \
-'--jql[]' \
-'--jqlfile[]' \
+'--jaq[]' \
+'--jaqfile[]' \
'--pretty[]' \
'--rate-limit[]' \
'--timeout[]' \
@@ -479,8 +485,8 @@ _arguments "${_arguments_options[@]}" : \
(fetchpost)
_arguments "${_arguments_options[@]}" : \
'--new-column[]' \
-'--jql[]' \
-'--jqlfile[]' \
+'--jaq[]' \
+'--jaqfile[]' \
'--pretty[]' \
'--rate-limit[]' \
'--timeout[]' \
@@ -1680,6 +1686,7 @@ _arguments "${_arguments_options[@]}" : \
'--format[]' \
'--try-parsedates[]' \
'--infer-len[]' \
+'--cache-schema[]' \
'--streaming[]' \
'--low-memory[]' \
'--no-optimizations[]' \
diff --git a/contrib/completions/src/cmd/extdedup.rs b/contrib/completions/src/cmd/extdedup.rs
index 8fd648911..d75b38656 100644
--- a/contrib/completions/src/cmd/extdedup.rs
+++ b/contrib/completions/src/cmd/extdedup.rs
@@ -2,10 +2,13 @@ use clap::{arg, Command};
pub fn extdedup_cmd() -> Command {
Command::new("extdedup").args([
+ arg!(--select),
arg!(--"no-output"),
arg!(--"dupes-output"),
arg!(--"human-readable"),
arg!(--"memory-limit"),
+ arg!(--"no-headers"),
+ arg!(--delimiter),
arg!(--quiet),
])
}
diff --git a/contrib/completions/src/cmd/extsort.rs b/contrib/completions/src/cmd/extsort.rs
index b6f9a6866..730570438 100644
--- a/contrib/completions/src/cmd/extsort.rs
+++ b/contrib/completions/src/cmd/extsort.rs
@@ -2,9 +2,12 @@ use clap::{arg, Command};
pub fn extsort_cmd() -> Command {
Command::new("extsort").args([
+ arg!(--select),
+ arg!(--reverse),
arg!(--"memory-limit"),
arg!(--"tmp-dir"),
arg!(--jobs),
+ arg!(--delimiter),
arg!(--"no-headers"),
])
}
diff --git a/contrib/completions/src/cmd/sqlp.rs b/contrib/completions/src/cmd/sqlp.rs
index 36945ff8f..3afd145d8 100644
--- a/contrib/completions/src/cmd/sqlp.rs
+++ b/contrib/completions/src/cmd/sqlp.rs
@@ -5,6 +5,7 @@ pub fn sqlp_cmd() -> Command {
arg!(--format),
arg!(--"try-parsedates"),
arg!(--"infer-len"),
+ arg!(--"cache-schema"),
arg!(--streaming),
arg!(--"low-memory"),
arg!(--"no-optimizations"),
diff --git a/docs/ENVIRONMENT_VARIABLES.md b/docs/ENVIRONMENT_VARIABLES.md
index ed0a6ea05..d7e1411eb 100644
--- a/docs/ENVIRONMENT_VARIABLES.md
+++ b/docs/ENVIRONMENT_VARIABLES.md
@@ -3,7 +3,7 @@
| Variable | Description |
| --- | --- |
| `QSV_DOTENV_PATH` | The full pathname of the dotenv file to load, OVERRIDING existing environment variables. This takes precedence over any other dotenv files in the filesystem. |
-| `QSV_DEFAULT_DELIMITER` | single ascii character to use as delimiter. Overrides `--delimiter` option. Defaults to "," (comma) for CSV files & "\t" (tab) for TSV files when not set. Note that this will also set the delimiter for qsv's output to stdout. However, using the `--output` option, regardless of this environment variable, will automatically change the delimiter used in the generated file based on the file extension - i.e. comma for `.csv`, tab for `.tsv` & `.tab` files. |
+| `QSV_DEFAULT_DELIMITER` | single ascii character to use as delimiter. Overrides `--delimiter` option. Defaults to "," (comma) for CSV files & "\t" (tab) for TSV files when not set. Note that this will also set the delimiter for qsv's output to stdout. However, using the `--output` option, regardless of this environment variable, will automatically change the delimiter used in the generated file based on the file extension - i.e. comma for `.csv`; tab for `.tsv` & `.tab` ; and semicolon for `.ssv` files |
| `QSV_SNIFF_DELIMITER` | if set, the delimiter is automatically detected. Overrides `QSV_DEFAULT_DELIMITER` & `--delimiter` option. Note that this does not work with stdin. |
| `QSV_NO_HEADERS` | if set, the first row will **NOT** be interpreted as headers. Supersedes `QSV_TOGGLE_HEADERS`. |
| `QSV_TOGGLE_HEADERS` | if set to `1`, toggles header setting - i.e. inverts qsv header behavior, with no headers being the default, & setting `--no-headers` will actually mean headers will not be ignored. |
diff --git a/docs/PERFORMANCE.md b/docs/PERFORMANCE.md
index 95f4a7019..b27ba6054 100644
--- a/docs/PERFORMANCE.md
+++ b/docs/PERFORMANCE.md
@@ -10,9 +10,9 @@ Indexing your CSV files is key for performance. Here's why:
3. **Parallel Processing**: Indexing enables multithreading, dramatically speeding up supported commands like `stats`, `frequency`, `sample`, `split` and `tojsonl`.
-4. **Random Access**: The `luau` command gains random access capabilities.
+4. **Random Access**: The `luau` command gains random access capabilities. `extsort` CSV mode requires an index.
-5. **Low Overhead**: Creating an index is fast and efficient, even for very large files.
+5. **Low Overhead**: Creating an index is fast and efficient, even for very large files. The million row, 41-column, 520mb NYC 311 benchmark file for instance, takes all of 466 ms to index.
Even if you're only handling a CSV file once, and its not reference data, indexing still makes sense if you're `slicing`, `counting`, `sampling` or compiling summary statistics with the `stats` and `frequency` commands.
diff --git a/resources/test/adur-public-toilets-extsorted-csvmode.csv b/resources/test/adur-public-toilets-extsorted-csvmode.csv
new file mode 100644
index 000000000..3a8805846
--- /dev/null
+++ b/resources/test/adur-public-toilets-extsorted-csvmode.csv
@@ -0,0 +1,16 @@
+ExtractDate,OrganisationURI,OrganisationLabel,ServiceTypeURI,ServiceTypeLabel,LocationText,CoordinateReferenceSystem,GeoX,GeoY,GeoPointLicensingURL,Category,AccessibleCategory,RADARKeyNeeded,BabyChange,FamilyToilet,ChangingPlace,AutomaticPublicConvenience,FullTimeStaffing,PartOfCommunityScheme,CommunitySchemeName,ChargeAmount,InfoURL,OpeningHours,ManagedBy,ReportEmail,ReportTel,Notes,UPRN,Postcode,StreetAddress,GeoAreaURI,GeoAreaLabel
+07/07/2014 00:00,http://opendatacommunities.org/id/district-council/adur,Adur,http://id.esd.org.uk/service/579,Public toilets,BEACH TOILETS BASIN ROAD SOUTH SOUTHWICK,OSGB36,522083,105168,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Female and male,Unisex,Yes,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,09.00 - 17.00,ADC,surveyor_15@adur-worthing.gov.uk,01903 221471,,60034215,,PUBLIC CONVENIENCES CIVIC CENTRE HAM ROAD SHOREHAM-BY-SEA,,
+07/07/2014 00:00,http://opendatacommunities.org/id/district-council/adur,Adur,http://id.esd.org.uk/service/579,Public toilets,BEACH TOILETS BASIN ROAD SOUTH SOUTHWICK,OSGB36,522007,106062,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Female and male,None,No,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,,ADC,surveyor_14@adur-worthing.gov.uk,01903 221471,Grounds staff only not public,60032527,,PUBLIC CONVENIENCE NORTH PAVILION BUCKINGHAM PARK UPPER SHOREHAM ROAD SHOREHAM-BY-SEA,,
+07/07/2014 00:00,http://opendatacommunities.org/id/district-council/adur,Adur,http://id.esd.org.uk/service/579,Public toilets,PUBLIC CONVENIENCES CEMETERY MILL LANE SHOREHAM-BY-SEA,OSGB36,521440,105725,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Female and male,None,No,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,,ADC,surveyor_9@adur-worthing.gov.uk,01903 221471,Grounds staff only not public,60014340,,PUBLIC CONVENIENCES CEMETERY MILL LANE SHOREHAM-BY-SEA,,
+07/07/2014 00:00,http://opendatacommunities.org/id/district-council/adur,Adur,http://id.esd.org.uk/service/579,Public toilets,PUBLIC CONVENIENCE SOUTHWICK STREET SOUTHWICK,OSGB36,524401,105405,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Female and male,Unisex,Yes,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,S = 08:00 - 21:00 W = 08:00 - 17:00,ADC,surveyor_11@adur-worthing.gov.uk,01903 221471,,60026354,,PUBLIC CONVENIENCE SOUTHWICK STREET SOUTHWICK,,
+07/07/2014 00:00,http://opendatacommunities.org/id/district-council/adur,Adur,http://id.esd.org.uk/service/579,Public toilets,PUBLIC CONVENIENCES ADUR RECREATION GROUND BRIGHTON ROAD SHOREHAM-BY-SEA,OSGB36,521048,104977,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Female and male,Unisex,Yes,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,S = 08:00 - 21:00 W = 08:00 - 17:00,ADC,surveyor_6@adur-worthing.gov.uk,01903 221471,,60009666,,PUBLIC CONVENIENCES ADUR RECREATION GROUND BRIGHTON ROAD SHOREHAM-BY-SEA,,
+07/07/2014 00:00,http://opendatacommunities.org/id/district-council/adur,Adur,http://id.esd.org.uk/service/579,Public toilets,PUBLIC CONVENIENCES MONKS RECREATION GROUND CRABTREE LANE LANCING,OSGB36,518225,104730,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Female and male,None,Yes,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,S = 09:00 - 15:00 W = 09:00 - 15:00,ADC,surveyor_2@adur-worthing.gov.uk,01903 221471,,60002210,,PUBLIC CONVENIENCES MONKS RECREATION GROUND CRABTREE LANE LANCING,,
+,http://opendatacommunities.org/id/district-council/adur,,http://id.esd.org.uk/service/579,Public toilets,BEACH GREEN PUBLIC CONVENIENCES BRIGHTON ROAD LANCING,OSGB36,518072,103649,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Female and male,Unisex,Yes,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,S = 09:00 - 21:00 W = 09:00 - 17:00 ,ADC,surveyor_1@adur-worthing.gov.uk,01903 221471,,60001449,,BEACH GREEN PUBLIC CONVENIENCES BRIGHTON ROAD LANCING,,
+07/07/2014 00:00,http://opendatacommunities.org/id/district-council/adur,Adur,http://id.esd.org.uk/service/579,Public toilets,BEACH TOILETS BASIN ROAD SOUTH SOUTHWICK,OSGB36,524375,104753,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Female and male,Unisex,Yes,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,S = 09:00 - 21:00 W = 09:00 - 17:00,ADC,surveyor_13@adur-worthing.gov.uk,01903 221471,,60029181,,BEACH TOILETS BASIN ROAD SOUTH SOUTHWICK,,
+07/07/2014 00:00,http://opendatacommunities.org/id/district-council/adur,Adur,http://id.esd.org.uk/service/579,Public toilets,PUBLIC CONVENIENCES BEACH GREEN SHOREHAM-BY-SEA,OSGB36,521299,104515,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Female and male,Unisex,Yes,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,S = 09:00 - 21:00 W = 09:00 - 17:00,ADC,surveyor_5@adur-worthing.gov.uk,01903 221471,,60009402,,PUBLIC CONVENIENCES BEACH GREEN SHOREHAM-BY-SEA,,
+07/07/2014 00:00,http://opendatacommunities.org/id/district-council/adur,Adur,http://id.esd.org.uk/service/579,Public toilets,PUBLIC CONVENIENCES FORTHAVEN SHOREHAM-BY-SEA,OSGB36,523294,104588,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Female and male,Unisex,Yes,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,S = 09:00 - 21:00 W = 09:00 - 17:00,ADC,surveyor_7@adur-worthing.gov.uk,01903 221471,,60011970,,PUBLIC CONVENIENCES FORTHAVEN SHOREHAM-BY-SEA,,
+07/07/2014 00:00,http://opendatacommunities.org/id/district-council/adur,Adur,http://id.esd.org.uk/service/579,Public toilets,PUBLIC CONVENIENCES MIDDLE STREET SHOREHAM-BY-SEA,OSGB36,521515,105083,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Female and male,Unisex,Yes,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,S = 09:00 - 21:00 W = 09:00 - 17:00,ADC,surveyor_8@adur-worthing.gov.uk,01903 221471,,60014163,,PUBLIC CONVENIENCES MIDDLE STREET SHOREHAM-BY-SEA,,
+2014-07-07 00:00,http://opendatacommunities.org/id/district-council/adur,Adur,http://id.esd.org.uk/service/579,Public toilets,PUBLIC CONVENIENCES SHOPSDAM ROAD LANCING,OSGB3,518915,103795,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Mens,Unisex,Yes,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,S = 09:00 - 21:00 W = 09:00 - 17:00,ADC,surveyor_3@adur-worthing.gov.uk,01903 221471,,60007428,,,,
+07/07/2014 00:00,http://opendatacommunities.org/id/district-council/adur,Adur,http://id.esd.org.uk/service/579,Public toilets,PUBLIC CONVENIENCES SOUTH PAVILION BUCKINGHAM PARK UPPER SHOREHAM ROAD SHOREHAM-BY-SEA,OSGB36,522118,105939,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Female and male,None,No,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,S = 09:00 - 21:00 W = 09:00 - 17:00,ADC,surveyor_10@adur-worthing.gov.uk,01903 221471,,60017866,,PUBLIC CONVENIENCES SOUTH PAVILION BUCKINGHAM PARK UPPER SHOREHAM ROAD SHOREHAM-BY-SEA,,
+07/07/2014 00:00,http://opendatacommunities.org/id/district-council/adur,Adur,http://id.esd.org.uk/service/579,Public toilets,PUBLIC CONVENIENCES YEW TREE CLOSE LANCING,OSGB36,518222,104168,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Female and male,Unisex,Yes,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,S = 09:00 - 21:00 W = 09:00 - 17:00,ADC,surveyor_4@adur-worthing.gov.uk,01903 221471,,60008859,,PUBLIC CONVENIENCES YEW TREE CLOSE LANCING,,
+07/07/2014 00:00,http://opendatacommunities.org/id/district-council/adur,Adur,http://id.esd.org.uk/service/579,Public toilets,WEST BEACH PUBLIC CONVENIENCES WEST BEACH ROAD LANCING,OSGB36,520354,104246,http://www.ordnancesurvey.co.uk/business-and-government/help-and-support/public-sector/guidance/derived-data-exemptions.html,Female and male,Unisex,Yes,No,No,No,No,No,No,,,http://www.adur-worthing.gov.uk/streets-and-travel/public-toilets/,S = 09:00 - 21:00 W = 09:00 - 17:00,,surveyor_12@adur-worthing.gov.uk,01903 221471,,60028994,,WEST BEACH PUBLIC CONVENIENCES WEST BEACH ROAD LANCING,,
diff --git a/resources/test/boston311-extdedup-dupeoutput.csv b/resources/test/boston311-extdedup-dupeoutput.csv
new file mode 100644
index 000000000..11b47dd80
--- /dev/null
+++ b/resources/test/boston311-extdedup-dupeoutput.csv
@@ -0,0 +1,21 @@
+dupe_rowno,case_enquiry_id,open_dt,target_dt,closed_dt,ontime,case_status,closure_reason,case_title,subject,reason,type,queue,department,submittedphoto,closedphoto,location,fire_district,pwd_district,city_council_district,police_district,neighborhood,neighborhood_services_district,ward,precinct,location_street_name,location_zipcode,latitude,longitude,source
+40,101004154423,2022-01-31 08:05:00,,,ONTIME,Open, ,Sidewalk Cover / Manhole,Boston Water & Sewer Commission,Sidewalk Cover / Manhole,Sidewalk Cover / Manhole,INFO01_GenericeFormforOtherServiceRequestTypes,INFO,,,8 Putnam St Charlestown MA 02129,3,1A,1,A15,Charlestown,2,Ward 2,0201,8 Putnam St,02129,42.3735,-71.0599,Constituent Call
+46,101004114154,2022-01-02 16:20:00,2022-01-10 08:30:00,,OVERDUE,Open, ,PWD Graffiti,Public Works Department,Highway Maintenance,PWD Graffiti,PWDx_Graffiti,PWDx,,,600 Atlantic Ave Boston MA 02210,3,1C,2,A1,Downtown / Financial District,3,Ward 3,0306,600 Atlantic Ave,02210,42.3527,-71.0536,Citizens Connect App
+51,101004114795,2022-01-03 12:29:00,2022-03-07 12:29:41,,OVERDUE,Open, ,Graffiti: Ward 8 0803 ,Property Management,Graffiti,Graffiti Removal,PROP_GRAF_GraffitiRemoval,PROP,,,2000A Washington St Roxbury MA 02118,7,10B,7,D4,Roxbury,13,Ward 8,0803,2000A Washington St,02118,42.3333,-71.0797,Constituent Call
+57,101004114016,2022-01-02 13:22:10,2022-01-04 08:30:00,2022-01-02 20:24:18,ONTIME,Closed,Case Closed. Closed date : Sun Jan 02 20:24:18 EST 2022 Resolved Has been cleaned up ,Requests for Street Cleaning,Public Works Department,Street Cleaning,Requests for Street Cleaning,PWDx_District 03: North Dorchester,PWDx,https://311.boston.gov/media/boston/report/photos/61d1ed4105bbcf180c2a2d66/report.jpg,,71 Willow Ct Dorchester MA 02125,6,03,2,C6,Dorchester,5,07,0708,71 Willow Ct,02125,42.3246,-71.0636,Citizens Connect App
+58,101004113811,2022-01-02 08:01:29,2022-01-04 08:30:00,2022-01-03 05:59:50,ONTIME,Closed,Case Closed. Closed date : Mon Jan 03 05:59:50 EST 2022 Resolved ,CE Collection,Public Works Department,Street Cleaning,CE Collection,PWDx_District 10A: Roxbury,PWDx,,,INTERSECTION of Sunnyside St & Centre St Jamaica Plain MA ,9,10A,6,E13,Jamaica Plain,11,10,1009,INTERSECTION Sunnyside St & Centre St,,42.3594,-71.0587,City Worker App
+59,101004113906,2022-01-02 10:32:35,2022-01-03 10:32:34,2022-01-03 06:44:23,ONTIME,Closed,Case Closed. Closed date : 2022-01-03 06:44:23.4 Duplicate of Existing Case ,Traffic Signal Inspection,Transportation - Traffic Division,Signs & Signals,Traffic Signal Inspection,BTDT_Traffic Signal_Repair,BTDT,https://311.boston.gov/media/boston/report/photos/61d1c58205bbcf180c2a1816/report.jpg,,INTERSECTION of Gallivan Blvd & Washington St Dorchester MA ,8,07,4,B3,Dorchester,7,17,1704,INTERSECTION Gallivan Blvd & Washington St,,42.3594,-71.0587,Citizens Connect App
+62,101004114033,2022-01-02 13:38:41,2022-01-05 08:30:00,2022-01-03 07:08:35,ONTIME,Closed,Case Closed. Closed date : Mon Jan 03 07:08:35 EST 2022 Resolved No violation found at this time today is trash day. ,Improper Storage of Trash (Barrels),Public Works Department,Code Enforcement,Improper Storage of Trash (Barrels),PWDx_Code Enforcement,PWDx,https://311.boston.gov/media/boston/report/photos/61d1f12405bbcf180c2a3082/report.jpg,,INTERSECTION of Lewis St & North St Boston MA ,3,1B,1,A1,Downtown / Financial District,3,3,,INTERSECTION Lewis St & North St,,42.3594,-71.0587,Citizens Connect App
+65,101004113637,2022-01-01 17:24:56,2022-01-04 08:30:00,2022-01-03 00:03:27,ONTIME,Closed,Case Closed. Closed date : 2022-01-03 00:03:27.62 Case Resolved CLEAR ,Parking Enforcement,Transportation - Traffic Division,Enforcement & Abandoned Vehicles,Parking Enforcement,BTDT_Parking Enforcement,BTDT,,,353-361 Athens St South Boston MA 02127,6,05,2,C6,South Boston / South Boston Waterfront,5,Ward 6,0604,353-361 Athens St,02127,42.3369,-71.0471,Citizens Connect App
+66,101004114724,2022-01-03 11:36:21,,2022-01-04 16:31:31,ONTIME,Closed,Case Closed. Closed date : 2022-01-04 16:31:31.297 Bulk Item Automation ,Schedule Bulk Item Pickup,Public Works Department,Sanitation,Schedule a Bulk Item Pickup SS,PWDx_Schedule a Bulk Item Pickup,PWDx,,,352 Riverway Boston MA 02115,4,10A,8,B2,Mission Hill,14,Ward 10,1004,352 Riverway,02115,42.3335,-71.1113,Self Service
+71,101004113512,2022-01-01 12:43:50,2022-01-31 12:43:50,2022-01-03 10:46:27,ONTIME,Closed,Case Closed. Closed date : 2022-01-03 10:46:27.983 Case Noted BTD will investigate. Thank you for contacting 311 and BTD. ,New Sign Crosswalk or Pavement Marking,Transportation - Traffic Division,Signs & Signals,New Sign Crosswalk or Pavement Marking,BTDT_Engineering_New Sign and Pavement Marking Requests,BTDT,,,43 Oakview Ter Jamaica Plain MA 02130,9,02,6,E13,Jamaica Plain,11,Ward 19,1901,43 Oakview Ter,02130,42.3188,-71.1092,Self Service
+79,101004114807,2022-01-03 12:35:00,,2022-01-10 16:30:33,ONTIME,Closed,Case Closed. Closed date : 2022-01-10 16:30:33.11 Bulk Item Automation ,Schedule a Bulk Item Pickup,Public Works Department,Sanitation,Schedule a Bulk Item Pickup,PWDx_Schedule a Bulk Item Pickup,PWDx,,,21 Ellington St Dorchester MA 02121,7,03,4,B3,Greater Mattapan,13,Ward 14,1403,21 Ellington St,02121,42.3021,-71.0844,Constituent Call
+83,101004113526,2022-01-01 13:14:52,2022-01-04 08:30:00,2022-01-02 06:43:42,ONTIME,Closed,Case Closed. Closed date : Sun Jan 02 06:43:42 EST 2022 Resolved Trash removed ,CE Collection,Public Works Department,Street Cleaning,CE Collection,PWDx_District 10B: Roxbury,PWDx,,,16 Circuit St Roxbury MA 02119,7,10B,7,B2,Roxbury,13,Ward 12,1203,16 Circuit St,02119,42.3235,-71.0852,City Worker App
+87,101004114108,2022-01-02 15:00:52,2022-01-04 08:30:00,2022-01-02 23:40:14,ONTIME,Closed,Case Closed. Closed date : 2022-01-02 23:40:14.32 Case Resolved CLEAR ,Parking Enforcement,Transportation - Traffic Division,Enforcement & Abandoned Vehicles,Parking Enforcement,BTDT_Parking Enforcement,BTDT,https://311.boston.gov/media/boston/report/photos/61d2046805bbcf180c2a418d/report.jpg,,INTERSECTION of Nassau St & Washington St Boston MA ,4,1C,2,A1,Downtown / Financial District,4,3,0308,INTERSECTION Nassau St & Washington St,,42.3594,-71.0587,Citizens Connect App
+88,101004114783,2022-01-03 12:19:00,2022-01-04 12:19:43,2022-01-03 14:05:26,ONTIME,Closed,Case Closed. Closed date : 2022-01-03 14:05:26.86 Case Resolved Area ticketed ,Parking Enforcement,Transportation - Traffic Division,Enforcement & Abandoned Vehicles,Parking Enforcement,BTDT_Parking Enforcement,BTDT,,,32 Mount Vernon St Dorchester MA 02125,6,03,2,C6,Dorchester,5,Ward 7,0709,32 Mount Vernon St,02125,42.322,-71.0573,Constituent Call
+89,101004113721,2022-01-01 21:31:54,2022-01-31 21:31:54,2022-01-04 08:34:40,ONTIME,Closed,Case Closed. Closed date : Tue Jan 04 08:34:40 EST 2022 Noted Investigating area will continue monitoring. ,Rodent Activity,Inspectional Services,Environmental Services,Rodent Activity,ISD_Environmental Services (INTERNAL),ISD,,,INTERSECTION of Asticou Rd & Washington St Jamaica Plain MA ,12,02,6,E13,Jamaica Plain,11,19,1110,INTERSECTION Asticou Rd & Washington St,,42.3594,-71.0587,Citizens Connect App
+91,101004113654,2022-01-01 18:07:52,2022-01-04 08:30:00,2022-01-01 19:07:41,ONTIME,Closed,Case Closed. Closed date : Sat Jan 01 19:07:41 EST 2022 Resolved Belly emptied ,Empty Litter Basket,Public Works Department,Highway Maintenance,Empty Litter Basket,PWDx_District 1B: North End,PWDx,https://311.boston.gov/media/boston/report/photos/61d0debd05bbcf180c29b2c6/report.jpg,,INTERSECTION of Prince St & Causeway St Boston MA ,3,1B,1,A1,Downtown / Financial District,3,3,0302,INTERSECTION Prince St & Causeway St,,42.3594,-71.0587,Citizens Connect App
+94,101004113386,2022-01-01 09:23:39,2022-01-10 08:30:00,2022-01-01 12:56:14,ONTIME,Closed,Case Closed. Closed date : Sat Jan 01 12:56:14 EST 2022 Noted Don't believe this is a city park ,Litter / Ground Maintenance - Wellington Green (BPRD),Parks & Recreation Department,Park Maintenance & Safety,Ground Maintenance,PARK_Maintenance_Ground Maintenance,PARK,https://311.boston.gov/media/boston/report/photos/61d063e505bbcf180c297b6a/photo_20220101_092319.jpg,,563 Columbus Ave Roxbury MA 02118,4,1C,7,D4,South End,6,Ward 4,0404,563 Columbus Ave,02118,42.3412,-71.0815,Citizens Connect App
+95,101004114021,2022-01-02 13:26:36,2022-01-04 08:30:00,2022-01-02 14:49:17,ONTIME,Closed,Case Closed. Closed date : Sun Jan 02 14:49:17 EST 2022 Resolved Dead rat picked up ,Pick up Dead Animal,Public Works Department,Street Cleaning,Pick up Dead Animal,PWDx_District 1B: North End,PWDx,https://311.boston.gov/media/boston/report/photos/61d1ee4b05bbcf180c2a2daf/report.jpg,,23 Charter St Boston MA 02113,3,1B,1,A1,Downtown / Financial District,3,Ward 3,0302,23 Charter St,02113,42.3668,-71.0535,Citizens Connect App
+99,101004113902,2022-01-02 10:27:00,2022-01-10 08:30:00,,OVERDUE,Open, ,PWD Graffiti,Public Works Department,Highway Maintenance,PWD Graffiti,BTDT_BostonBikes,BTDT,https://311.boston.gov/media/boston/report/photos/61d1c45805bbcf180c2a17ee/report.jpg,,201 Massachusetts Ave Boston MA 02115,4,10A,7,D4,Back Bay,14,04,0405,201 Massachusetts Ave,02115,42.3452,-71.0871,Citizens Connect App
+100,101004115118,2022-01-03 16:16:00,2022-01-19 16:16:48,2022-02-28 10:40:30,OVERDUE,Closed,Case Closed. Closed date : 2022-02-28 10:40:30.233 Case Noted Please resubmit with color make and plate number ,Abandoned Vehicles,Transportation - Traffic Division,Enforcement & Abandoned Vehicles,Abandoned Vehicles,BTDT_AVRS Interface Queue,BTDT,https://311.boston.gov/media/boston/report/photos/61d367b405bbcf180c2b1f49/report.jpg,,183 Orleans St East Boston MA 02128,1,09,1,A7,East Boston,1,01,0102,183 Orleans St,02128,42.3715,-71.034,Citizens Connect App
diff --git a/resources/test/boston311-extdedup-neighborhood.csv b/resources/test/boston311-extdedup-neighborhood.csv
new file mode 100644
index 000000000..1406e7051
--- /dev/null
+++ b/resources/test/boston311-extdedup-neighborhood.csv
@@ -0,0 +1,20 @@
+case_enquiry_id,open_dt,target_dt,closed_dt,ontime,case_status,closure_reason,case_title,subject,reason,type,queue,department,submittedphoto,closedphoto,location,fire_district,pwd_district,city_council_district,police_district,neighborhood,neighborhood_services_district,ward,precinct,location_street_name,location_zipcode,latitude,longitude,source
+101004113637,2022-01-01 17:24:56,2022-01-04 08:30:00,2022-01-03 00:03:27,ONTIME,Closed,Case Closed. Closed date : 2022-01-03 00:03:27.62 Case Resolved CLEAR ,Parking Enforcement,Transportation - Traffic Division,Enforcement & Abandoned Vehicles,Parking Enforcement,BTDT_Parking Enforcement,BTDT,,,353-361 Athens St South Boston MA 02127,6,05,2,C6,South Boston / South Boston Waterfront,5,Ward 6,0604,353-361 Athens St,02127,42.3369,-71.0471,Citizens Connect App
+101004114795,2022-01-03 12:29:00,2022-03-07 12:29:41,,OVERDUE,Open, ,Graffiti: Ward 8 0803 ,Property Management,Graffiti,Graffiti Removal,PROP_GRAF_GraffitiRemoval,PROP,,,2000A Washington St Roxbury MA 02118,7,10B,7,D4,Roxbury,13,Ward 8,0803,2000A Washington St,02118,42.3333,-71.0797,Constituent Call
+101004114783,2022-01-03 12:19:00,2022-01-04 12:19:43,2022-01-03 14:05:26,ONTIME,Closed,Case Closed. Closed date : 2022-01-03 14:05:26.86 Case Resolved Area ticketed ,Parking Enforcement,Transportation - Traffic Division,Enforcement & Abandoned Vehicles,Parking Enforcement,BTDT_Parking Enforcement,BTDT,,,32 Mount Vernon St Dorchester MA 02125,6,03,2,C6,Dorchester,5,Ward 7,0709,32 Mount Vernon St,02125,42.322,-71.0573,Constituent Call
+101004141367,2022-01-20 08:15:45,2022-01-21 08:30:00,2022-01-20 08:45:12,ONTIME,Closed,Case Closed. Closed date : Thu Jan 20 08:45:12 EST 2022 Noted ,CE Collection,Public Works Department,Street Cleaning,CE Collection,PWDx_District 1B: North End,PWDx,,,12 Derne St Boston MA 02114,3,1B,1,A1,Beacon Hill,3,Ward 3,0306,12 Derne St,02114,42.3596,-71.0634,City Worker App
+101004114154,2022-01-02 16:20:00,2022-01-10 08:30:00,,OVERDUE,Open, ,PWD Graffiti,Public Works Department,Highway Maintenance,PWD Graffiti,PWDx_Graffiti,PWDx,,,600 Atlantic Ave Boston MA 02210,3,1C,2,A1,Downtown / Financial District,3,Ward 3,0306,600 Atlantic Ave,02210,42.3527,-71.0536,Citizens Connect App
+101004113822,2022-01-02 08:15:00,2022-01-10 08:30:00,2022-01-05 10:37:03,ONTIME,Closed,Case Closed. Closed date : Wed Jan 05 10:37:03 EST 2022 Resolved ,Electrical,Inspectional Services,Building,Electrical,ISD_Building (INTERNAL),ISD,,,156 Everett St East Boston MA 02128,1,09,1,A7,East Boston,1,Ward 1,0101,156 Everett St,02128,42.3666,-71.0323,Constituent Call
+101004113313,2022-01-01 01:56:00,,,ONTIME,Open, ,Loud Parties/Music/People,Boston Police Department,Noise Disturbance,Loud Parties/Music/People,INFO01_GenericeFormforOtherServiceRequestTypes,INFO,,,755 Boylston St Boston MA 02116,4,1C,8,D4,Back Bay,14,Ward 5,0508,755 Boylston St,02116,42.3494,-71.0811,Constituent Call
+101004114624,2022-01-03 10:12:00,2022-05-03 10:12:36,2022-01-13 14:12:46,ONTIME,Closed,Case Closed. Closed date : Thu Jan 13 14:12:46 EST 2022 Noted Violations found. Notice written. ,SCHEDULED Pest Infestation - Residential,Inspectional Services,Housing,Pest Infestation - Residential,ISD_Housing (INTERNAL),ISD,,,20 Washington St Brighton MA 02135,11,04,9,D14,Allston / Brighton,15,Ward 21,2112,20 Washington St,02135,42.3425,-71.1412,Constituent Call
+101004114608,2022-01-03 10:02:57,2022-05-03 10:02:57,2022-01-03 10:11:24,ONTIME,Closed,Case Closed. Closed date : 2022-01-03 10:11:24.96 Case Invalid ,Pest Infestation - Residential,Inspectional Services,Housing,Pest Infestation - Residential,ISD_Housing (INTERNAL),ISD,,,20 Washington St Hyde Park MA 02136,12,08,5,E18,Hyde Park,10,18,1817,20 Washington St,02136,42.3594,-71.0587,Constituent Call
+101004120108,2022-01-08 12:54:49,2022-01-11 08:30:00,2022-01-09 06:43:06,ONTIME,Closed,Case Closed. Closed date : Sun Jan 09 06:43:06 EST 2022 Noted ,CE Collection,Public Works Department,Street Cleaning,CE Collection,PWDx_District 1C: Downtown,PWDx,,,198 W Springfield St Roxbury MA 02118,4,1C,7,D4,South End,6,Ward 9,0902,198 W Springfield St,02118,42.3401,-71.0803,City Worker App
+101004113512,2022-01-01 12:43:50,2022-01-31 12:43:50,2022-01-03 10:46:27,ONTIME,Closed,Case Closed. Closed date : 2022-01-03 10:46:27.983 Case Noted BTD will investigate. Thank you for contacting 311 and BTD. ,New Sign Crosswalk or Pavement Marking,Transportation - Traffic Division,Signs & Signals,New Sign Crosswalk or Pavement Marking,BTDT_Engineering_New Sign and Pavement Marking Requests,BTDT,,,43 Oakview Ter Jamaica Plain MA 02130,9,02,6,E13,Jamaica Plain,11,Ward 19,1901,43 Oakview Ter,02130,42.3188,-71.1092,Self Service
+101004114807,2022-01-03 12:35:00,,2022-01-10 16:30:33,ONTIME,Closed,Case Closed. Closed date : 2022-01-10 16:30:33.11 Bulk Item Automation ,Schedule a Bulk Item Pickup,Public Works Department,Sanitation,Schedule a Bulk Item Pickup,PWDx_Schedule a Bulk Item Pickup,PWDx,,,21 Ellington St Dorchester MA 02121,7,03,4,B3,Greater Mattapan,13,Ward 14,1403,21 Ellington St,02121,42.3021,-71.0844,Constituent Call
+101004113747,2022-01-01 23:46:09,2022-01-17 08:30:00,2022-01-02 11:03:10,ONTIME,Closed,Case Closed. Closed date : Sun Jan 02 11:03:10 EST 2022 Noted Case noted. Duplicate case. Posts already marked for contractor to repair. ,Street Light Outages,Public Works Department,Street Lights,Street Light Outages,PWDx_Street Light Outages,PWDx,https://311.boston.gov/media/boston/report/photos/61d12e0705bbcf180c29cfc2/report.jpg,,103 N Beacon St Brighton MA 02135,11,04,9,D14,Brighton,15,22,2205,103 N Beacon St,02135,42.3549,-71.143,Citizens Connect App
+101004154423,2022-01-31 08:05:00,,,ONTIME,Open, ,Sidewalk Cover / Manhole,Boston Water & Sewer Commission,Sidewalk Cover / Manhole,Sidewalk Cover / Manhole,INFO01_GenericeFormforOtherServiceRequestTypes,INFO,,,8 Putnam St Charlestown MA 02129,3,1A,1,A15,Charlestown,2,Ward 2,0201,8 Putnam St,02129,42.3735,-71.0599,Constituent Call
+101004115093,2022-01-03 16:06:33,,2022-01-04 08:15:58,ONTIME,Closed,Case Closed. Closed date : 2022-01-04 08:15:58.1 Case Invalid This case has been closed as there is not enough information to process this request. If you feel this has been closed in error please dial 311 to submit a new request. Sincerely Boston 311 Team ,City/State Snow Issues,Mayor's 24 Hour Hotline,Programs,City/State Snow Issues,INFO01_GenericeFormforOtherServiceRequestTypes,INFO,,,40 Battery St Boston MA 02109,3,1B,1,A1,Boston,3,03,0301,40 Battery St,02109,42.3594,-71.0587,Constituent Call
+101004114724,2022-01-03 11:36:21,,2022-01-04 16:31:31,ONTIME,Closed,Case Closed. Closed date : 2022-01-04 16:31:31.297 Bulk Item Automation ,Schedule Bulk Item Pickup,Public Works Department,Sanitation,Schedule a Bulk Item Pickup SS,PWDx_Schedule a Bulk Item Pickup,PWDx,,,352 Riverway Boston MA 02115,4,10A,8,B2,Mission Hill,14,Ward 10,1004,352 Riverway,02115,42.3335,-71.1113,Self Service
+101004114391,2022-01-03 08:00:00,2022-01-04 08:30:00,2022-01-03 08:36:14,ONTIME,Closed,Case Closed. Closed date : Mon Jan 03 08:36:14 EST 2022 Resolved Been removed ,Requests for Street Cleaning,Public Works Department,Street Cleaning,Requests for Street Cleaning,PWDx_District 06: West Roxbury and Roslindale,PWDx,,,2432 Centre St West Roxbury MA 02132,12,06,6,E5,West Roxbury,12,Ward 20,2015,2432 Centre St,02132,42.2674,-71.1626,Constituent Call
+101004114656,2022-01-03 10:43:00,2022-01-24 10:43:43,2022-01-18 08:00:19,ONTIME,Closed,Case Closed Case Resolved NEW CART#21026466 DELV ON 1/11/22 ,Request for Recycling Cart,Public Works Department,Recycling,Request for Recycling Cart,PWDx_Recycling Sent to Contractor,PWDx,,,49 Westbourne St Roslindale MA 02131,12,06,5,E5,Roslindale,10,Ward 20,2009,49 Westbourne St,02131,42.2821,-71.1415,Constituent Call
+101004143000,2022-01-21 13:47:00,2022-02-04 13:47:30,,OVERDUE,Open, ,BTDT: Complaint,Mayor's 24 Hour Hotline,Employee & General Comments,General Comments For a Program or Policy,BTDT_Parking Enforcement,BTDT,,, , , , , , , , , ,,,42.3594,-71.0587,Constituent Call
diff --git a/resources/test/fetch_jaq_multiple.jaq b/resources/test/fetch_jaq_multiple.jaq
new file mode 100644
index 000000000..0fab93a4e
--- /dev/null
+++ b/resources/test/fetch_jaq_multiple.jaq
@@ -0,0 +1 @@
+[ ."places"[0]."place name" ,."places"[0]."state abbreviation" ]
diff --git a/resources/test/fetch_jaq_single.jaq b/resources/test/fetch_jaq_single.jaq
new file mode 100644
index 000000000..f472fc7b0
--- /dev/null
+++ b/resources/test/fetch_jaq_single.jaq
@@ -0,0 +1 @@
+."places"[0]."place name"
diff --git a/resources/test/fetch_jql_multiple.jql b/resources/test/fetch_jql_multiple.jql
deleted file mode 100644
index 87a680c92..000000000
--- a/resources/test/fetch_jql_multiple.jql
+++ /dev/null
@@ -1 +0,0 @@
-"places"[0]"place name","places"[0]"state abbreviation"
diff --git a/resources/test/fetch_jql_single.jql b/resources/test/fetch_jql_single.jql
deleted file mode 100644
index 6f96c9703..000000000
--- a/resources/test/fetch_jql_single.jql
+++ /dev/null
@@ -1 +0,0 @@
-"places"[0]"place name"
diff --git a/scripts/benchmarks.sh b/scripts/benchmarks.sh
index 7fe7cb9d7..2dd07a3ad 100755
--- a/scripts/benchmarks.sh
+++ b/scripts/benchmarks.sh
@@ -42,7 +42,7 @@
arg_pat="$1"
# the version of this script
-bm_version=5.1.0
+bm_version=5.3.0
# CONFIGURABLE VARIABLES ---------------------------------------
# change as needed to reflect your environment/workloads
@@ -496,7 +496,9 @@ run exclude_multi_casei "$qsv_bin" exclude --ignore-case \'Incident Zip,Communit
run --index exclude_multi_casei_index "$qsv_bin" exclude --ignore-case \'Incident Zip,Community Board,Agency\' "$data" \'Incident Zip,Community Board,Agency\' data_to_exclude.csv
run explode "$qsv_bin" explode City "-" "$data"
run extdedup "$qsv_bin" extdedup "$data"
+run extdedup_csv "$qsv_bin" extdedup "$data" --select 1-5
run extsort "$qsv_bin" extsort data_unsorted.csv extsort_sorted.csv
+run --index extsort_csv "$qsv_bin" extsort data_unsorted.csv --select 1-5 extsort_sorted.csv
run fill "$qsv_bin" fill -v Unspecified \'Address Type\' "$data"
run fixlengths "$qsv_bin" fixlengths "$data"
run flatten "$qsv_bin" flatten "$data"
@@ -617,6 +619,8 @@ run --index split_chunks_index "$qsv_bin" split --chunks 20 split_tempdir_chunks
run --index split_chunks_index_j1 "$qsv_bin" split --chunks 20 -j 1 split_tempdir_chunks_idx_j1
run sqlp "$qsv_bin" sqlp "$data" -Q --infer-len 100000 '"select * from _t_1 where \"Complaint Type\"='\''Noise'\'' and Borough='\''BROOKLYN'\''"'
run sqlp_aggregations "$qsv_bin" sqlp "$data" -Q --infer-len 100000 '"select Borough, count(*) from _t_1 where \"Complaint Type\"='\''Noise'\'' group by Borough"'
+run sqlp_aggregations_seed_schema_cache "$qsv_bin" sqlp "$data" -Q --infer-len 100000 --cache-schema '"select Borough, count(*) from _t_1 where \"Complaint Type\"='\''Noise'\'' group by Borough"'
+run sqlp_aggregations_use_schema_cache "$qsv_bin" sqlp "$data" -Q --infer-len 100000 --cache-schema '"select Borough, count(*) from _t_1 where \"Complaint Type\"='\''Noise'\'' group by Borough"'
run sqlp_aggregations_vs_duckdb duckdb :memory: '"select Borough, count(*) from read_csv_auto('\'''$data''\'') where \"Complaint Type\"='\''Noise'\'' group by Borough"'
run sqlp_aggregations_expensive "$qsv_bin" sqlp SKIP_INPUT -Q --infer-len 100000 expensive.sql
run sqlp_aggregations_expensive_streaming "$qsv_bin" sqlp SKIP_INPUT -Q --infer-len 100000 --streaming expensive.sql
diff --git a/scripts/results/benchmark_results.csv b/scripts/results/benchmark_results.csv
index 981207684..e2edc9eab 100644
--- a/scripts/results/benchmark_results.csv
+++ b/scripts/results/benchmark_results.csv
@@ -1,4 +1,238 @@
version,tstamp,name,mean,stddev,median,user,system,min,max,recs_per_sec
+0.136.0,2024-10-09-22,apply_calcconv,1.7050352779999998,0.019588303727766737,1.706148542,3.551023666666667,0.20906266666666665,1.684914083,1.724043209,586510
+0.136.0,2024-10-09-22,apply_dynfmt,1.9835509580000001,0.01520292475588627,1.991420625,6.893937666666666,0.23447933333333335,1.966026416,1.9932058330000002,504032
+0.136.0,2024-10-09-22,apply_emptyreplace,1.5998238196666668,0.015927380642159632,1.592549459,2.684836333333333,0.22189199999999998,1.588832459,1.618089541,625000
+0.136.0,2024-10-09-22,apply_op_eudex,1.5777951106666668,0.007463856328587575,1.578263333,2.1339263333333336,0.25768166666666664,1.570108166,1.585013833,633714
+0.136.0,2024-10-09-22,apply_op_sentiment,3.9648692776666663,0.38017112229641026,3.760939625,24.910353999999998,0.294889,3.730174625,4.403493583,252207
+0.136.0,2024-10-09-22,apply_op_similarity,1.6037357640000003,0.011346707375146987,1.600556,2.227638333333333,0.2090173333333333,1.594318167,1.6163331250000001,623441
+0.136.0,2024-10-09-22,apply_op_similarity_batchall,1.4988207913333333,0.018303877114343062,1.492236125,1.7975236666666665,0.173787,1.4847202080000002,1.519506041,667111
+0.136.0,2024-10-09-22,apply_op_string,1.5737780416666667,0.016098774120262248,1.568187583,2.680716,0.19417966666666664,1.56121975,1.5919267920000002,635324
+0.136.0,2024-10-09-22,behead,0.8816215836666667,0.0029518552016063676,0.880686084,0.8362063333333333,0.04412866666666667,0.879250834,0.8849278330000001,1133787
+0.136.0,2024-10-09-22,behead_flexible,0.8807327083333334,0.0007861678845566681,0.8803495,0.8331896666666667,0.04612466666666667,0.880211625,0.881637,1135074
+0.136.0,2024-10-09-22,cat_columns,2.844363097,0.004815946161097188,2.846609875,2.747449,0.09545666666666665,2.8388343330000003,2.847645083,351617
+0.136.0,2024-10-09-22,cat_rows,1.733864903,0.01796410766456159,1.739907917,1.6407429999999998,0.09199366666666668,1.7136585000000002,1.748028292,576701
+0.136.0,2024-10-09-22,cat_rows_flexible,1.7142814723333337,0.005350188438718356,1.7144205000000001,1.6214606666666667,0.09174066666666665,1.7088631250000001,1.719560792,583431
+0.136.0,2024-10-09-22,cat_rowskey,3.1547543889999994,0.025507955662027824,3.144587958,3.05395,0.09971533333333334,3.135897292,3.183777917,316957
+0.136.0,2024-10-09-22,count,0.07404358300000001,0.0033655614659618086,0.074128917,0.4266313333333333,0.052357999999999995,0.070636166,0.077365666,13513514
+0.136.0,2024-10-09-22,count_flexible,0.462141944,0.0017590328841335147,0.462686458,0.417162,0.04387433333333333,0.460175041,0.46356433300000005,2164502
+0.136.0,2024-10-09-22,count_index,0.007620777666666666,0.000044225044650439403,0.007597292,0.0047279999999999996,0.0022673333333333334,0.00759325,0.007671791000000001,125000000
+0.136.0,2024-10-09-22,count_no_polars,0.46205180533333334,0.003785031735211785,0.460538875,0.4169433333333334,0.044038,0.45925725,0.466359291,2164502
+0.136.0,2024-10-09-22,count_polars_lowmem,0.057583291666666675,0.004786411221385849,0.056398750000000004,0.42018833333333333,0.053239,0.053500375,0.06285075000000001,17241379
+0.136.0,2024-10-09-22,count_width,0.4694743473333334,0.0008699056995136294,0.46932366700000006,0.4387203333333333,0.051019333333333326,0.46868962500000005,0.47040975,2132196
+0.136.0,2024-10-09-22,count_width_index,0.47969713900000005,0.0014514370775266074,0.479283334,0.4478786666666667,0.052171666666666665,0.478497541,0.481310542,2083333
+0.136.0,2024-10-09-22,datefmt,1.774153125,0.0035590442597932476,1.774050667,4.817035999999999,0.18269099999999996,1.770646416,1.777762292,563698
+0.136.0,2024-10-09-22,datefmt_formatstr_newcol,1.696654791666667,0.0033475541032160095,1.6982641250000001,4.038033333333334,0.18209666666666666,1.6928065,1.69889375,589275
+0.136.0,2024-10-09-22,datefmt_multi,2.127302097333333,0.004210234557934205,2.129608458,8.931267,0.183364,2.122442625,2.129855209,470146
+0.136.0,2024-10-09-22,datefmt_multi_batchall,2.076182375,0.00452843165628292,2.0749605,8.506684666666667,0.16247333333333333,2.07239025,2.081196375,481696
+0.136.0,2024-10-09-22,datefmt_multi_select,2.3498884996666667,0.010352363040544177,2.349666833,11.608551999999998,0.19084,2.33964875,2.360349916,425532
+0.136.0,2024-10-09-22,dedup,1.2833504163333334,0.006031065668196462,1.285843375,2.0846046666666664,0.13363299999999997,1.276472541,1.287735333,779423
+0.136.0,2024-10-09-22,dedup_sorted,0.988590222,0.0025965061259993253,0.9875626660000001,0.9281836666666666,0.106696,0.9866647500000001,0.9915432500000001,1011122
+0.136.0,2024-10-09-22,diff,2.644915194333333,0.02362920456233022,2.636728375,4.132400666666666,0.1896433333333333,2.626468167,2.671549041,378072
+0.136.0,2024-10-09-22,enum,0.8937754166666667,0.004067882760879962,0.891814875,0.845328,0.047180666666666655,0.891059084,0.898452291,1118568
+0.136.0,2024-10-09-22,enum_constant,0.8840505833333334,0.008684506612208931,0.8846767080000001,0.8348966666666665,0.048019,0.8750699590000001,0.8924050830000001,1131222
+0.136.0,2024-10-09-22,enum_copy,0.893037556,0.01224491038664033,0.890319084,0.8450743333333334,0.04683933333333334,0.882380334,0.9064132500000001,1119821
+0.136.0,2024-10-09-22,enum_hash,1.5074435973333333,0.0061144736970913036,1.5084482920000002,1.4567166666666667,0.04959233333333333,1.500889,1.5129934999999999,663570
+0.136.0,2024-10-09-22,enum_uuid,1.6966366806666666,0.0021752266734352942,1.697039709,0.9602846666666666,0.7351523333333333,1.694288125,1.698582208,589275
+0.136.0,2024-10-09-22,enum_uuid7,1.7300057640000002,0.002183014410172075,1.730594666,0.9914836666666665,0.7373496666666667,1.727588709,1.731833917,578035
+0.136.0,2024-10-09-22,excel,12.393773708333333,0.025221651975008946,12.379599833,12.269890333333331,0.921428,12.378827542,12.42289375,80684
+0.136.0,2024-10-09-22,excel_error_format_formula,21.884125819666668,0.00715533626895283,21.885303042,21.684978333333333,1.0060536666666666,21.876454875,21.890619542,45695
+0.136.0,2024-10-09-22,excel_j1,12.915160528000001,0.04663747179989207,12.901054709,12.124392666666667,0.7840539999999999,12.877204292,12.967222583,77429
+0.136.0,2024-10-09-22,excel_metadata,12.197152514,0.05778919332351246,12.222285042,11.175934333333332,1.0180623333333332,12.131052542,12.238119958,81987
+0.136.0,2024-10-09-22,excel_metadata_short,0.949276556,0.005821559078994813,0.9460756250000001,0.31018933333333326,0.6379016666666666,0.945757834,0.955996209,1053741
+0.136.0,2024-10-09-22,excel_trim,12.549495555666667,0.03768325174515143,12.528584125,13.758439333333333,0.8868153333333333,12.526904917,12.592997625,79688
+0.136.0,2024-10-09-22,excel_trim_j1,14.098593306,0.030775290509148033,14.111557792,13.282066333333333,0.8124296666666666,14.063456917,14.120765209,70927
+0.136.0,2024-10-09-22,exclude,0.5592902643333334,0.000774786047916678,0.559157667,0.5167163333333332,0.041481333333333335,0.558590334,0.560122792,1788909
+0.136.0,2024-10-09-22,exclude_casei,0.5643613056666666,0.0031860825198504364,0.565165125,0.5201456666666666,0.04312633333333333,0.560850292,0.5670685000000001,1773050
+0.136.0,2024-10-09-22,exclude_casei_index,0.5783586943333333,0.003891602650041549,0.577528708,0.533566,0.043393666666666664,0.5749490420000001,0.5825983330000001,1730104
+0.136.0,2024-10-09-22,exclude_index,0.5735247776666667,0.000401239904309557,0.573679083,0.529978,0.04223166666666667,0.573069292,0.573825958,1742160
+0.136.0,2024-10-09-22,exclude_multi,0.8818913613333333,0.010612203719753337,0.877010917,0.8407443333333333,0.04008899999999999,0.874597375,0.894065792,1133787
+0.136.0,2024-10-09-22,exclude_multi_casei,0.889859625,0.007512512836473645,0.8877661250000001,0.849367,0.039474666666666665,0.883615916,0.898196834,1123596
+0.136.0,2024-10-09-22,exclude_multi_casei_index,0.9129257776666667,0.0040803320905515895,0.912865667,0.867269,0.04425866666666667,0.9088758330000001,0.917035833,1095290
+0.136.0,2024-10-09-22,exclude_multi_index,0.9042534306666669,0.0024943746574162032,0.9048569580000001,0.858998,0.043971333333333334,0.9015126670000001,0.906390667,1106195
+0.136.0,2024-10-09-22,explode,1.5868397643333332,0.012723681110287766,1.593969042,1.54249,0.043229333333333335,1.5721498340000002,1.5944004170000001,630120
+0.136.0,2024-10-09-22,extdedup,1.055031389,0.01862670088469005,1.04563,0.9730626666666665,0.07952733333333334,1.042979042,1.076485125,947867
+0.136.0,2024-10-09-22,extsort,0.7629452496666668,0.01000641117909401,0.757770833,1.2839026666666664,0.2641253333333333,0.7565855410000001,0.7744793750000001,1310616
+0.136.0,2024-10-09-22,fill,2.0876410416666666,0.017161149403491567,2.096520375,2.0344270000000004,0.05202266666666666,2.0678595,2.09854325,478927
+0.136.0,2024-10-09-22,fixlengths,1.3367088053333334,0.0037192935909075913,1.336161416,1.2477593333333334,0.08782333333333332,1.333293541,1.340671459,747943
+0.136.0,2024-10-09-22,flatten,5.603500527666665,0.021892915561610844,5.603754292,5.533522333333333,0.06872466666666666,5.581481833,5.625265458,178444
+0.136.0,2024-10-09-22,flatten_condensed,5.987705097,0.014473185810507367,5.995395666,5.915737333333333,0.07072133333333332,5.971010125,5.9967095,167001
+0.136.0,2024-10-09-22,fmt,1.002943764,0.015636441586786093,1.011603417,0.9553783333333333,0.046455666666666666,0.9848932920000001,1.012334583,997009
+0.136.0,2024-10-09-22,fmt_no_crlf,0.9969341666666667,0.010619823384458773,0.9984205420000001,0.9479203333333333,0.047823,0.985649458,1.0067325,1003009
+0.136.0,2024-10-09-22,fmt_no_final_newline,1.0060015279999999,0.002756928572519994,1.007205584,0.9571203333333332,0.04771533333333333,1.002847375,1.007951625,994036
+0.136.0,2024-10-09-22,foreach,0.007608791333333334,0.00019723007370158691,0.0076508750000000006,0.0046619999999999995,0.002355,0.007393916,0.007781583000000001,125000000
+0.136.0,2024-10-09-22,frequency,2.8425398056666666,0.015544831875395617,2.847457958,3.763486333333333,0.15672966666666666,2.825130792,2.8550306670000003,351741
+0.136.0,2024-10-09-22,frequency_ignorecase,3.5406878470000005,0.01270137750083542,3.54438075,4.4127849999999995,0.15055033333333334,3.52654925,3.551133541,282406
+0.136.0,2024-10-09-22,frequency_ignorecase_index,1.1237090693333334,0.05675912448248234,1.151073708,5.658496333333333,0.26584800000000003,1.05845175,1.16160175,889680
+0.136.0,2024-10-09-22,frequency_index,1.0480152363333333,0.05581236833496712,1.06061575,4.836763333333333,0.27762166666666666,0.9869797920000001,1.096450167,954198
+0.136.0,2024-10-09-22,frequency_index_stats_mode_auto,1.0070706113333332,0.008835466506475256,1.010171625,4.776612666666666,0.28615066666666666,0.997102667,1.013937542,993049
+0.136.0,2024-10-09-22,frequency_index_stats_mode_force,1.001722,0.017089296086828448,1.000352042,4.752778999999999,0.2881666666666666,0.985358916,1.019455042,998004
+0.136.0,2024-10-09-22,frequency_index_stats_mode_none,1.1178535139999999,0.008691833816215843,1.11994925,5.200261,0.2872523333333333,1.108305417,1.125305875,894454
+0.136.0,2024-10-09-22,frequency_j1,3.3876877083333334,0.029824394521667963,3.371393833,3.2935416666666666,0.09082966666666666,3.369559625,3.422109667,295159
+0.136.0,2024-10-09-22,frequency_j1_ignorecase,4.097180166666667,0.04444788013603125,4.074708084,3.998699333333333,0.09522966666666666,4.068455375,4.148377041,244081
+0.136.0,2024-10-09-22,frequency_limit20,2.8631531113333337,0.01734257567212987,2.860227167,3.7674983333333336,0.156258,2.847459625,2.881772542,349284
+0.136.0,2024-10-09-22,frequency_limit20_index,1.0633833053333335,0.05690465310295847,1.081311333,4.816441333333334,0.2702363333333333,0.9996737080000001,1.109164875,940734
+0.136.0,2024-10-09-22,frequency_no_limit,4.727112305666668,0.061715317730259046,4.698074208,5.593491,0.180478,4.685272042,4.7979906670000005,211551
+0.136.0,2024-10-09-22,frequency_no_limit_index,2.6022785136666666,0.08396557520664231,2.557269,6.371206666666666,0.30891966666666665,2.55041375,2.699152791,384320
+0.136.0,2024-10-09-22,frequency_notrim,2.4027974446666667,0.008777820223043718,2.398003917,3.2956936666666667,0.15378166666666665,2.397460083,2.412928334,416146
+0.136.0,2024-10-09-22,frequency_notrim_index,0.9821368890000001,0.04746079884980989,0.959449583,4.254895333333334,0.2751093333333333,0.950277625,1.036683459,1018330
+0.136.0,2024-10-09-22,frequency_other_sorted,2.8385583476666665,0.009154976898636062,2.842162375,3.706337,0.15396933333333332,2.828149834,2.845362834,352237
+0.136.0,2024-10-09-22,frequency_other_sorted_index,1.0439775693333333,0.04408596032803923,1.0570245,4.785868333333333,0.278931,0.9948406660000001,1.080067542,957854
+0.136.0,2024-10-09-22,frequency_selregex,0.8031119166666666,0.005922772057214628,0.8064003750000001,0.8800663333333333,0.05293966666666666,0.796274542,0.806660833,1245330
+0.136.0,2024-10-09-22,frequency_selregex_ignorecase,1.0019362636666667,0.003958131683469569,1.000608625,1.0783873333333334,0.05544966666666667,0.998812625,1.006387541,998004
+0.136.0,2024-10-09-22,frequency_sorted,2.670419513666667,0.020978018705839457,2.672767083,3.504291,0.16317866666666667,2.648366458,2.690125,374532
+0.136.0,2024-10-09-22,frequency_sorted_index,2.759115,0.006533081122469273,2.758656042,3.5680853333333338,0.14549066666666666,2.7528235,2.765865458,362450
+0.136.0,2024-10-09-22,geocode_reverse,3.635352513666667,0.02168954742554722,3.638010625,2.964048333333333,10.649058666666667,3.612456416,3.6555905,275103
+0.136.0,2024-10-09-22,geocode_reverse_batchall,3.705906264,0.0007124361086981811,3.706016417,3.307206666666666,10.218860333333334,3.705145167,3.706557208,269833
+0.136.0,2024-10-09-22,geocode_suggest,4.424326458333333,0.01332076052122252,4.41954975,21.383587000000002,2.6517473333333332,4.414052666,4.439376959,226040
+0.136.0,2024-10-09-22,geocode_suggest_batchall,4.436151958,0.011998674399309246,4.440844291,22.09025433333333,1.42405,4.422516208,4.445095375,225428
+0.136.0,2024-10-09-22,index,0.47402747233333337,0.00010761350663523526,0.474064792,0.4296609999999999,0.04324733333333333,0.47390616700000004,0.47411145800000004,2109705
+0.136.0,2024-10-09-22,input,1.6518609443333334,0.005086299425495461,1.6505388330000001,1.5999656666666666,0.05077399999999999,1.6475662500000001,1.65747775,605327
+0.136.0,2024-10-09-22,join,1.8915908750000001,0.001276399396811533,1.8912137910000002,1.351193,0.5393533333333332,1.8905455,1.893013334,528541
+0.136.0,2024-10-09-22,join_casei,1.8990923469999998,0.005914988734221181,1.899654833,1.35911,0.5389416666666667,1.892916208,1.904706,526593
+0.136.0,2024-10-09-22,joinp,0.791479514,0.001933987035821872,0.790972792,1.4077596666666665,0.08986899999999999,0.789849333,0.7936164170000001,1264223
+0.136.0,2024-10-09-22,joinp_streaming,0.025671264000000003,0.00013254458292589571,0.025618625000000003,0.034173,0.010442333333333333,0.025573125000000002,0.025822042,38461538
+0.136.0,2024-10-09-22,json,18.515705639,0.053356714059158934,18.505266583,16.98018433333333,1.5260143333333331,18.468339917,18.573510417,54007
+0.136.0,2024-10-09-22,jsonl,1.4464047779999998,0.0027990031779148127,1.445855125,7.01248,0.19835666666666665,1.443921375,1.449437834,691563
+0.136.0,2024-10-09-22,jsonl_batchall,0.007816459,0.0001457840333335582,0.007748334000000001,0.004854,0.0023936666666666663,0.007717209,0.007983834,125000000
+0.136.0,2024-10-09-22,jsonl_j1,5.819719833333333,0.011475245824118704,5.819589125,5.685633,0.13232933333333333,5.8083105,5.831259875,171821
+0.136.0,2024-10-09-22,luau_filter,7.428935666666667,0.009451951106225287,7.424287958,6.889022999999999,0.5387573333333333,7.422707417,7.439811625,134608
+0.136.0,2024-10-09-22,luau_filter_colidx,9.097977945,0.0250814889252206,9.091565834,8.539466666666666,0.5573443333333333,9.076724959,9.125643042,109914
+0.136.0,2024-10-09-22,luau_filter_no_globals,4.837267319666666,0.006909354815523144,4.840564667,4.306157333333333,0.5299393333333332,4.829327,4.841910292,206740
+0.136.0,2024-10-09-22,luau_filter_no_globals_colidx,6.395455472666666,0.018600087946171094,6.404931084,5.861872000000001,0.5323926666666666,6.374025667,6.407409667,156372
+0.136.0,2024-10-09-22,luau_filter_no_globals_colidx,6.387959667,0.010597093263644972,6.393553959,5.850938333333333,0.535815,6.37573775,6.394587292,156544
+0.136.0,2024-10-09-22,luau_filter_no_globals_no_colidx,4.827248333333333,0.010409160348532303,4.8219105,4.298935666666666,0.5270643333333334,4.820590875,4.839243625,207168
+0.136.0,2024-10-09-22,luau_multi,23.364569847333332,0.06760305298498792,23.363684875,22.726609666666665,0.6363066666666666,23.297413625,23.432611042,42799
+0.136.0,2024-10-09-22,luau_multi_colidx,24.95775619433333,0.026643842878957484,24.947410541,24.30202733333333,0.6541143333333334,24.937836792,24.98802125,40067
+0.136.0,2024-10-09-22,luau_multi_no_globals,20.82279369433333,0.2973751150338541,20.659224458,20.181841666666667,0.6393093333333333,20.643109791,21.166046834,48024
+0.136.0,2024-10-09-22,luau_multi_no_globals_colidx,22.24774802766667,0.07362856474543945,22.240344875,21.590948666666666,0.655243,22.178100708,22.3247985,44948
+0.136.0,2024-10-09-22,luau_script,33.837904138999995,0.050418620727490406,33.840241834,33.180931333333334,0.6551846666666666,33.786357333,33.88711325,29553
+0.136.0,2024-10-09-22,luau_script_colidx,35.36256690233333,0.042258863655929034,35.379295666,34.698109666666674,0.6626286666666666,35.314504625,35.393900416,28278
+0.136.0,2024-10-09-22,luau_script_no_globals,31.057191791666668,0.03675492282724094,31.065451625,30.40201233333333,0.6533836666666666,31.01700975,31.089114,32199
+0.136.0,2024-10-09-22,luau_script_no_globals_colidx,32.38958259733334,0.1005595308660732,32.3332995,31.733821666666667,0.6539403333333333,32.329767458,32.505680834,30874
+0.136.0,2024-10-09-22,partition,2.3267367083333332,0.01474690479917634,2.3239864580000003,0.9367673333333334,1.3608143333333331,2.313558542,2.342665125,429738
+0.136.0,2024-10-09-22,pseudo,1.7149044583333335,0.0013415217707730286,1.7146115000000002,1.6574523333333333,0.055862333333333326,1.7137336250000001,1.71636825,583090
+0.136.0,2024-10-09-22,pseudo_formatstr,1.9270131106666668,0.010054385149304729,1.9285091250000002,1.8668756666666664,0.058633333333333336,1.916294541,1.936235666,518941
+0.136.0,2024-10-09-22,rename,0.9871046526666668,0.0006993774664674101,0.986705166,0.9393923333333333,0.0466,0.9866965830000001,0.9879122090000001,1013171
+0.136.0,2024-10-09-22,replace,2.0904712636666667,0.005182647935350693,2.0914495,2.038176333333333,0.051205333333333325,2.084869208,2.095095083,478469
+0.136.0,2024-10-09-22,reverse,0.9752164030000001,0.003911500340501181,0.974709959,0.8659096666666667,0.10359199999999998,0.9715827920000001,0.979356458,1025641
+0.136.0,2024-10-09-22,reverse_index,6.117939041333334,0.029647164872719674,6.102424291,1.2457633333333333,4.859567999999999,6.099268708,6.152124125,163452
+0.136.0,2024-10-09-22,safenames,0.9873110416666667,0.0017477939056016701,0.9865907500000001,0.9395263333333334,0.04666033333333333,0.9860385,0.989303875,1013171
+0.136.0,2024-10-09-22,sample_10,0.5176511113333334,0.0026381009682744073,0.5161513750000001,0.4723566666666666,0.044233999999999996,0.51610475,0.520697209,1930502
+0.136.0,2024-10-09-22,sample_1000,0.5139957086666668,0.0013784006206823084,0.513462834,0.47076999999999997,0.042213,0.512963292,0.515561,1945525
+0.136.0,2024-10-09-22,sample_100000,0.6506862360000002,0.004323453892143529,0.6495751670000001,0.6026693333333334,0.046593666666666665,0.6470267500000001,0.6554567910000001,1536098
+0.136.0,2024-10-09-22,sample_100000_index,1.1417670003333333,0.002279856408883079,1.143076959,0.18067633333333333,0.9598353333333334,1.139134459,1.143089583,875657
+0.136.0,2024-10-09-22,sample_100000_seeded,0.6475213336666666,0.0007607925677195599,0.6478826670000001,0.5994356666666666,0.046645,0.6466472090000001,0.648034125,1543210
+0.136.0,2024-10-09-22,sample_100000_seeded_faster,0.6370564166666667,0.00255118044164526,0.63679675,0.5895136666666666,0.04610966666666666,0.634645,0.6397275,1569859
+0.136.0,2024-10-09-22,sample_100000_seeded_index,1.1341891393333334,0.008487503092167076,1.132666459,0.178262,0.9546233333333333,1.126566042,1.143334917,881834
+0.136.0,2024-10-09-22,sample_100000_seeded_index_faster,1.11916925,0.004465985590402288,1.117995834,0.17152766666666666,0.946349,1.115407125,1.124104791,893655
+0.136.0,2024-10-09-22,sample_100000_seeded_index_secure,1.129794125,0.013567921456163637,1.125208125,0.17367066666666664,0.9544003333333334,1.1191135,1.14506075,884956
+0.136.0,2024-10-09-22,sample_100000_seeded_secure,0.6438970140000001,0.005995088218259433,0.64145975,0.596007,0.04657666666666666,0.639504417,0.650726875,1552795
+0.136.0,2024-10-09-22,sample_1000_index,0.03282537466666667,0.00026952162709573834,0.03287625,0.017051,0.014543333333333333,0.032534041,0.033065833,30303030
+0.136.0,2024-10-09-22,sample_10_index,0.019179167,0.00016445632517176142,0.019233167000000002,0.015091666666666665,0.003276,0.0189945,0.019309834,52631579
+0.136.0,2024-10-09-22,sample_25pct_index,2.784334319333334,0.010606911422785317,2.781489958,0.41741633333333333,2.3654466666666667,2.775439583,2.796073417,359195
+0.136.0,2024-10-09-22,sample_25pct_seeded_index,2.78099625,0.00379345691057489,2.78093475,0.41989866666666664,2.3597406666666667,2.777233917,2.784820083,359583
+0.136.0,2024-10-09-22,schema,7.8167974026666664,0.040637817784430603,7.831071542,13.272739999999999,0.393381,7.770948333,7.848372333,127926
+0.136.0,2024-10-09-22,schema_index,0.11072668033333334,0.000484563093606325,0.11074679100000001,1.0238993333333333,0.062112666666666656,0.11023237500000001,0.111200875,9009009
+0.136.0,2024-10-09-22,search,0.5870271663333334,0.0010020523424938018,0.5864650410000001,0.5419103333333334,0.043955333333333325,0.586432375,0.588184083,1703578
+0.136.0,2024-10-09-22,search_file,1.0692094583333331,0.0021090949990984855,1.06957,1.021632,0.046468333333333334,1.066943333,1.071115042,935454
+0.136.0,2024-10-09-22,search_file_case_sensitive,0.9843420133333334,0.0007680726995515422,0.984066541,0.9367206666666666,0.046418999999999995,0.983749666,0.9852098330000001,1016260
+0.136.0,2024-10-09-22,search_file_case_sensitive_unicode,0.9835609446666668,0.0015630574535778763,0.9834135,0.9346326666666668,0.047799,0.982076834,0.9851925,1016260
+0.136.0,2024-10-09-22,search_file_flag,1.2531727916666668,0.0008596545780139056,1.253225583,1.203385,0.04862666666666667,1.2522879580000001,1.254004834,798085
+0.136.0,2024-10-09-22,search_file_flag_matchonly,0.8408497920000001,0.0026936119251155933,0.840080292,0.7939083333333333,0.04576266666666667,0.838624667,0.843844417,1189061
+0.136.0,2024-10-09-22,search_file_literal,0.9418367220000001,0.004136733581775356,0.9425460000000001,0.8937806666666667,0.046918999999999995,0.9373912080000001,0.9455729580000001,1061571
+0.136.0,2024-10-09-22,search_file_unicode,1.0884298053333334,0.0018019277360431514,1.0882925,1.0402263333333333,0.047083999999999994,1.086700458,1.090296458,919118
+0.136.0,2024-10-09-22,search_unicode,0.5862996943333334,0.0010450075642292427,0.585999,0.5415249999999999,0.04366233333333333,0.585438,0.587462083,1706485
+0.136.0,2024-10-09-22,searchset,1.2479794026666666,0.0033260528682583397,1.24748775,1.5688736666666667,0.10403333333333332,1.244926542,1.251523916,801282
+0.136.0,2024-10-09-22,searchset_ignorecase,1.4406021803333333,0.001061116164262995,1.4411695,1.7601093333333333,0.10427633333333335,1.439378,1.441259041,693963
+0.136.0,2024-10-09-22,searchset_unicode,1.2449286526666665,0.0048582164261754095,1.243868708,1.5592396666666666,0.10194599999999998,1.240687917,1.250229333,803213
+0.136.0,2024-10-09-22,select,0.4911789306666667,0.000493972853482189,0.491139166,0.4470453333333333,0.04304333333333333,0.490706042,0.491691584,2036660
+0.136.0,2024-10-09-22,select_regex,0.526533139,0.0018390845593602076,0.526113458,0.4818723333333333,0.04352033333333333,0.524940167,0.5285457920000001,1897533
+0.136.0,2024-10-09-22,slice_last_1k,0.008980902666666667,0.00016669415587336408,0.009022959,0.006043666666666666,0.0023713333333333334,0.008797208,0.009122541000000001,111111111
+0.136.0,2024-10-09-22,slice_last_1k_index,0.008859264,0.00013893256714320095,0.008839125,0.005673333333333333,0.0024966666666666666,0.0087315,0.009007167,111111111
+0.136.0,2024-10-09-22,slice_last_1k_json,0.011867916333333334,0.00021738081900741208,0.01192925,0.008818666666666667,0.002439,0.011626458000000001,0.012048041,83333333
+0.136.0,2024-10-09-22,slice_last_1k_json_index,0.012107569,0.000030551562365941323,0.012092708,0.008600666666666666,0.0027273333333333333,0.012087291,0.012142708,83333333
+0.136.0,2024-10-09-22,slice_one_middle,0.2571123886666667,0.0011219957566971101,0.256721875,0.23244233333333333,0.023569666666666666,0.256237833,0.258377458,3891051
+0.136.0,2024-10-09-22,slice_one_middle_index,0.007865847,0.00005689357381110821,0.007883708,0.004748666666666666,0.002436,0.007802166,0.007911667,125000000
+0.136.0,2024-10-09-22,snappy_compress,0.17543269433333333,0.006437975025409485,0.178878375,1.162416,0.10746833333333333,0.16800520800000002,0.1794145,5714286
+0.136.0,2024-10-09-22,snappy_decompress,0.4950796386666667,0.0023225127598840655,0.49471354100000003,0.47328966666666666,0.020706000000000002,0.492961917,0.497563458,2020202
+0.136.0,2024-10-09-22,snappy_validate,0.4778566806666667,0.0004231111302557911,0.47797025000000004,0.45737266666666665,0.019444,0.47738837500000003,0.478211417,2092050
+0.136.0,2024-10-09-22,sort,1.2448715416666667,0.004062296792098928,1.243819625,2.116125,0.12835066666666664,1.241438667,1.249356333,803213
+0.136.0,2024-10-09-22,sort_random_seeded,1.1755278606666666,0.01747898854165516,1.172330541,1.0638263333333333,0.106891,1.15986825,1.194384791,850340
+0.136.0,2024-10-09-22,sort_random_seeded_faster,1.1654890973333334,0.01166500440181754,1.1681225,1.0480146666666668,0.113234,1.1527325,1.175612292,858369
+0.136.0,2024-10-09-22,sort_random_seeded_secure,1.1753826666666667,0.010507493503398389,1.169346375,1.0649463333333333,0.10569433333333333,1.169286,1.187515625,851064
+0.136.0,2024-10-09-22,sortcheck_sorted,0.4984155003333333,0.0002929748303563367,0.49856108400000004,0.4543566666666667,0.04294599999999999,0.49807825000000006,0.498607167,2008032
+0.136.0,2024-10-09-22,sortcheck_unsorted,0.007578639000000001,0.00018884501208133643,0.007486417,0.004672,0.0023496666666666666,0.007453625,0.007795875000000001,125000000
+0.136.0,2024-10-09-22,sortcheck_unsorted_all,0.5326300416666666,0.002544201329297766,0.532960416,0.48673799999999995,0.044769,0.529936792,0.5349929170000001,1876173
+0.136.0,2024-10-09-22,split,0.9717815833333333,0.04966093558043338,0.9652262500000001,0.816767,0.10735266666666665,0.9257238750000001,1.024394625,1028807
+0.136.0,2024-10-09-22,split_chunks,1.0157952636666667,0.02866098694382442,1.024791417,1.2385943333333334,0.156238,0.983715416,1.038878958,984252
+0.136.0,2024-10-09-22,split_chunks_index,0.237130722,0.11520503998050603,0.203406208,1.0650579999999998,0.205462,0.142551541,0.365434417,4219409
+0.136.0,2024-10-09-22,split_chunks_index_j1,0.009002514000000001,0.00007689415139657865,0.009030916,0.005336666666666667,0.004367666666666666,0.008915459,0.009061167,111111111
+0.136.0,2024-10-09-22,split_index,0.20669505566666668,0.05728089425847374,0.23947558300000002,1.0443603333333333,0.19973866666666665,0.14055362500000002,0.240055959,4830918
+0.136.0,2024-10-09-22,split_index_j1,1.0268533613333333,0.03843516155693625,1.010459542,0.8795676666666666,0.11235266666666666,0.9993334170000001,1.070767125,973710
+0.136.0,2024-10-09-22,split_kbsize,2.036766389,0.04346158710737812,2.018941292,1.8980946666666665,0.11043033333333334,2.00505125,2.086306625,490918
+0.136.0,2024-10-09-22,sqlp,1.0465692636666668,0.013914078754769328,1.045776375,2.0121113333333334,0.27294066666666666,1.033068583,1.060862833,955110
+0.136.0,2024-10-09-22,sqlp_aggregations,0.9915284443333334,0.011169118131619549,0.9854105420000001,1.3752786666666665,0.05673066666666667,0.9847549160000001,1.004419875,1008065
+0.136.0,2024-10-09-22,sqlp_aggregations_expensive,0.8579473750000001,0.01071784359307729,0.854041916,1.4292443333333333,0.096925,0.849729917,0.8700702920000001,1165501
+0.136.0,2024-10-09-22,sqlp_aggregations_expensive_streaming,0.8589640693333335,0.007709582229175652,0.856374708,1.4293953333333331,0.09164933333333332,0.8528825000000001,0.867635,1164144
+0.136.0,2024-10-09-22,sqlp_aggregations_expensive_vs_duckdb,0.22032431933333338,0.004612126504017463,0.21811233300000002,0.8804273333333333,0.12304033333333332,0.21723483300000002,0.22562579200000002,4545455
+0.136.0,2024-10-09-22,sqlp_aggregations_vs_duckdb,0.19413722266666666,0.004535591784381205,0.195525792,0.6153073333333333,0.10211199999999998,0.18906966700000002,0.19781620900000002,5154639
+0.136.0,2024-10-09-22,sqlp_format_arrow,1.7363877083333332,0.0031499168238577568,1.735523583,2.212789666666666,0.7271723333333333,1.7337600420000001,1.7398795,576037
+0.136.0,2024-10-09-22,sqlp_format_avro,1.0304819856666667,0.005013535079717769,1.029383666,1.9862596666666665,0.3737723333333333,1.026108666,1.035953625,970874
+0.136.0,2024-10-09-22,sqlp_format_json,1.0228909720000001,0.0014389669238213615,1.023682666,1.964939,0.2585943333333333,1.02123,1.02376025,977517
+0.136.0,2024-10-09-22,sqlp_format_jsonl,1.023724417,0.001900603307837816,1.022800209,1.9640849999999999,0.25551566666666664,1.022462667,1.025910375,976562
+0.136.0,2024-10-09-22,sqlp_format_parquet,1.025136014,0.0019723300715826465,1.024200291,1.9758483333333334,0.270604,1.023805709,1.027402042,975610
+0.136.0,2024-10-09-22,sqlp_format_parquet_statistics,1.025225514,0.0020774838027392698,1.025213792,1.9743553333333332,0.2804173333333333,1.023153916,1.027308834,975610
+0.136.0,2024-10-09-22,sqlp_lowmemory,1.0151198193333333,0.001987065600690942,1.015369,1.963368,0.2535543333333333,1.013019916,1.016970542,985222
+0.136.0,2024-10-09-22,sqlp_nooptimizations,1.0478791386666666,0.0008166565087663174,1.047478,2.0146046666666666,0.18714033333333335,1.047340625,1.048818791,954198
+0.136.0,2024-10-09-22,sqlp_tryparsedates,11.918393847333334,0.013805430703016874,11.914084625000001,12.856793333333334,0.2654393333333333,11.907257,11.933839917,83907
+0.136.0,2024-10-09-22,sqlp_tryparsedates_inferlen,1.9179708060000003,0.006179784729398966,1.9200773340000001,2.8641963333333336,0.25034033333333333,1.9110131670000001,1.922821917,521376
+0.136.0,2024-10-09-22,stats,1.909606736,0.0049196025849774,1.910509792,2.219391333333333,0.09494199999999998,1.904298166,1.91401225,523560
+0.136.0,2024-10-09-22,stats_create_cache,1.9097833056666669,0.004521451395342963,1.9118497090000002,2.2203649999999997,0.09286466666666666,1.904597875,1.912902333,523560
+0.136.0,2024-10-09-22,stats_everything,3.3554944723333335,0.04029503222196921,3.343843042,10.192412666666668,0.3932616666666666,3.322309,3.400331375,298063
+0.136.0,2024-10-09-22,stats_everything_create_cache,3.3900974583333334,0.018655247417147178,3.382474708,10.237715333333332,0.392744,3.376460667,3.411357,294985
+0.136.0,2024-10-09-22,stats_everything_index,1.3312123473333333,0.009204037936792824,1.32928925,10.825936333333331,0.5668519999999999,1.323121792,1.341226,751315
+0.136.0,2024-10-09-22,stats_everything_index_j1,6.614990667000001,0.15419707857364842,6.636688584,6.550748,0.21150966666666668,6.451093875,6.757189542,151172
+0.136.0,2024-10-09-22,stats_everything_index_j1_with_cache,0.007933236333333335,0.00015488744395958354,0.007865750000000001,0.004810333333333333,0.0024836666666666666,0.007823542000000001,0.008110417,125000000
+0.136.0,2024-10-09-22,stats_everything_index_with_cache,0.008150389000000001,0.00004450365283884046,0.008145625,0.004868666666666666,0.002627666666666667,0.008108459,0.008197083,125000000
+0.136.0,2024-10-09-22,stats_everything_infer_dates,7.172214625333333,0.001711103903247197,7.172136042,14.419449,0.4363456666666667,7.170544167,7.173963667,139431
+0.136.0,2024-10-09-22,stats_everything_infer_dates_index,1.892725361,0.026426721653890588,1.9041573330000001,17.084736,0.5867853333333334,1.8625072500000002,1.9115115,528262
+0.136.0,2024-10-09-22,stats_everything_infer_dates_index_with_cache,0.008059833333333334,0.00016426584580287267,0.007988208,0.004905333333333334,0.0025053333333333334,0.007943542000000001,0.00824775,125000000
+0.136.0,2024-10-09-22,stats_everything_j1,6.374932889,0.03861090214131202,6.378022792,6.5876529999999995,0.26058733333333334,6.334869875,6.411906,156863
+0.136.0,2024-10-09-22,stats_everything_sorted,3.3091379170000006,0.01562012204732685,3.309453625,9.845339666666666,0.40390433333333325,3.2933623340000002,3.324597792,302206
+0.136.0,2024-10-09-22,stats_everything_sorted_index,3.3277645556666666,0.006919087020449097,3.326532125,9.828958333333333,0.4096936666666666,3.3215445,3.335217042,300481
+0.136.0,2024-10-09-22,stats_index,0.2264774586666667,0.004532509862893005,0.224717459,2.293756,0.06589166666666667,0.22308891700000003,0.23162600000000003,4424779
+0.136.0,2024-10-09-22,stats_index_j1,1.8859975693333333,0.0014554704378813388,1.8864251250000001,1.8443606666666668,0.04049133333333333,1.884376208,1.887191375,530223
+0.136.0,2024-10-09-22,stats_index_j1_with_cache,0.007778472333333334,0.00011276332092632511,0.007799292,0.004687666666666666,0.002419333333333333,0.00765675,0.007879375000000001,125000000
+0.136.0,2024-10-09-22,stats_index_with_cache,0.007986986,0.000047691702244729985,0.007972625,0.004798,0.0025496666666666667,0.007948125,0.008040208,125000000
+0.136.0,2024-10-09-22,table,6.831468819666667,0.023255516463334465,6.827525417,5.733177333333333,1.0903183333333333,6.810437125,6.856443917,146391
+0.136.0,2024-10-09-22,to_datapackage,0.695291889,0.0036729801911510383,0.6936888750000001,2.0978336666666664,0.30246833333333334,0.6926928750000001,0.6994939170000001,1438849
+0.136.0,2024-10-09-22,to_sqlite,0.6869207916666668,0.006021595270961332,0.688884916,2.080145,0.29434066666666664,0.6801623750000001,0.691715084,1455604
+0.136.0,2024-10-09-22,to_xlsx,30.79641108333333,0.03361517688094782,30.809203667,29.30711633333333,3.063931,30.758277708,30.821751875,32472
+0.136.0,2024-10-09-22,tojsonl,5.255716042,0.02947630512929443,5.257766042,10.161964666666664,0.4150133333333333,5.22526825,5.284113834,190259
+0.136.0,2024-10-09-22,tojsonl_batchall,5.2791820136666665,0.018680752373076034,5.275491625,10.091462666666665,0.37808400000000003,5.262621875,5.299432541,189430
+0.136.0,2024-10-09-22,tojsonl_index,2.8958170693333334,0.07985544815714167,2.86844975,11.432261333333335,0.4399403333333334,2.8332435,2.985757958,345304
+0.136.0,2024-10-09-22,tojsonl_index_j1,8.995612166666666,0.019833368532575935,9.003292875,8.607582666666666,0.3818063333333333,8.973087125,9.0104565,111161
+0.136.0,2024-10-09-22,tojsonl_j1,9.050394528,0.04188608359892298,9.033382667,9.022415666666666,0.430021,9.019690875,9.098110042,110497
+0.136.0,2024-10-09-22,tojsonl_trim,5.348996528000001,0.006708534294621601,5.348959584,10.950814333333334,0.3859336666666667,5.342306542,5.355723458,186951
+0.136.0,2024-10-09-22,tojsonl_trim_j1,9.571418291666667,0.01507952192561961,9.56800225,9.526006333333333,0.4491516666666666,9.558339833,9.587912792000001,104482
+0.136.0,2024-10-09-22,transpose,2.6229285693333333,0.025532015383013567,2.611978792,2.4179046666666664,0.19915433333333332,2.60469775,2.652109166,381243
+0.136.0,2024-10-09-22,transpose_multipass,21.422549930333332,0.02144520581620947,21.414166625,19.688017333333335,1.7326546666666667,21.406562708,21.446920458,46679
+0.136.0,2024-10-09-22,validate,1.3454596946666666,0.011306645865111651,1.344570917,6.256567999999999,0.15226666666666666,1.334623667,1.3571845,743494
+0.136.0,2024-10-09-22,validate_batchall,1.2823367776666668,0.0075023406401299505,1.283977083,5.824079,0.11468199999999999,1.2741500000000001,1.28888325,780031
+0.136.0,2024-10-09-22,validate_batchall_index,1.2857204443333334,0.004130539026058984,1.286295208,5.745959666666667,0.12479633333333333,1.2813326250000001,1.2895335,777605
+0.136.0,2024-10-09-22,validate_dynenum,1.3203521386666666,0.004890651370770679,1.318326208,6.183933333333333,0.14744133333333334,1.3168,1.325930208,757576
+0.136.0,2024-10-09-22,validate_dynenum_batchall,1.272792861,0.0026021360365074747,1.273357416,5.749370666666667,0.11033633333333333,1.269954792,1.275066375,785546
+0.136.0,2024-10-09-22,validate_dynenum_batchall_index,1.271873194,0.006069566186101182,1.273125708,5.687784333333333,0.12177833333333332,1.2652750830000001,1.2772187910000001,786164
+0.136.0,2024-10-09-22,validate_dynenum_index,1.26976775,0.0012953332136516952,1.26936025,5.678887333333333,0.10425066666666666,1.268725167,1.2712178330000001,787402
+0.136.0,2024-10-09-22,validate_dynenum_no_schema,1.3317769723333333,0.00857000757395079,1.335231583,6.148984666666666,0.14937566666666666,1.322018834,1.3380805,750751
+0.136.0,2024-10-09-22,validate_dynenum_no_schema_index,1.267980167,0.004467809592701886,1.269947584,5.694462333333333,0.102148,1.262866292,1.271126625,788644
+0.136.0,2024-10-09-22,validate_dynenum_valid_output,2.2017550413333336,0.0028643772618533727,2.202526583,7.002077333333333,0.19268933333333335,2.198583916,2.204154625,454133
+0.136.0,2024-10-09-22,validate_dynenum_valid_output_index,2.1348443749999997,0.0037203540786369966,2.136084209,6.538800666666667,0.1434173333333333,2.130662416,2.1377865,468384
+0.136.0,2024-10-09-22,validate_index,1.2818570833333334,0.0032141490070814053,1.2826240420000001,5.739469666666666,0.10224566666666667,1.278328833,1.284618375,780031
+0.136.0,2024-10-09-22,validate_no_schema,0.4880847496666667,0.0036591216167233724,0.489340916,0.4425666666666666,0.04411433333333333,0.48396300000000003,0.490950333,2049180
+0.136.0,2024-10-09-22,validate_no_schema_index,0.49482838866666673,0.0009017353931089343,0.49446141600000004,0.45398833333333327,0.039464,0.49416800000000005,0.49585575000000004,2020202
+0.136.0,2024-10-09-22,validate_valid_output,2.2125143473333337,0.004183940417602296,2.21488575,7.101555,0.1944523333333333,2.207683417,2.214973875,451875
+0.136.0,2024-10-09-22,validate_valid_output_index,2.143425805666667,0.008207043638664849,2.138873375,6.604312666666666,0.13987033333333332,2.138503959,2.152900083,466636
0.135.0,2024-09-24-16,apply_calcconv,1.6561738473333334,0.024501838167906777,1.647001417,3.308348666666666,0.18862966666666667,1.6375816250000002,1.6839385,603865
0.135.0,2024-09-24-16,apply_dynfmt,2.0836702916666665,0.10193847447027907,2.039226917,5.589999,0.19001333333333328,2.011498958,2.200285,479846
0.135.0,2024-09-24-16,apply_emptyreplace,1.52477925,0.0037840099082099747,1.5236345,2.2465766666666664,0.15877699999999997,1.521699791,1.5290034590000001,655738
diff --git a/scripts/results/benchmark_results_display.csv b/scripts/results/benchmark_results_display.csv
index 4d741c49c..121285f76 100644
--- a/scripts/results/benchmark_results_display.csv
+++ b/scripts/results/benchmark_results_display.csv
@@ -1,4 +1,238 @@
version,tstamp,name,mean,recs_per_sec,stddev,median,user,system,min,max
+0.136.0,2024-10-09-22,apply_calcconv,1.705,586510,0.02,1.706,3.551,0.209,1.685,1.724
+0.136.0,2024-10-09-22,apply_dynfmt,1.984,504032,0.015,1.991,6.894,0.234,1.966,1.993
+0.136.0,2024-10-09-22,apply_emptyreplace,1.6,625000,0.016,1.593,2.685,0.222,1.589,1.618
+0.136.0,2024-10-09-22,apply_op_eudex,1.578,633714,0.007,1.578,2.134,0.258,1.57,1.585
+0.136.0,2024-10-09-22,apply_op_sentiment,3.965,252207,0.38,3.761,24.91,0.295,3.73,4.403
+0.136.0,2024-10-09-22,apply_op_similarity,1.604,623441,0.011,1.601,2.228,0.209,1.594,1.616
+0.136.0,2024-10-09-22,apply_op_similarity_batchall,1.499,667111,0.018,1.492,1.798,0.174,1.485,1.52
+0.136.0,2024-10-09-22,apply_op_string,1.574,635324,0.016,1.568,2.681,0.194,1.561,1.592
+0.136.0,2024-10-09-22,behead,0.882,1133787,0.003,0.881,0.836,0.044,0.879,0.885
+0.136.0,2024-10-09-22,behead_flexible,0.881,1135074,0.001,0.88,0.833,0.046,0.88,0.882
+0.136.0,2024-10-09-22,cat_columns,2.844,351617,0.005,2.847,2.747,0.095,2.839,2.848
+0.136.0,2024-10-09-22,cat_rows,1.734,576701,0.018,1.74,1.641,0.092,1.714,1.748
+0.136.0,2024-10-09-22,cat_rows_flexible,1.714,583431,0.005,1.714,1.621,0.092,1.709,1.72
+0.136.0,2024-10-09-22,cat_rowskey,3.155,316957,0.026,3.145,3.054,0.1,3.136,3.184
+0.136.0,2024-10-09-22,count,0.074,13513514,0.003,0.074,0.427,0.052,0.071,0.077
+0.136.0,2024-10-09-22,count_flexible,0.462,2164502,0.002,0.463,0.417,0.044,0.46,0.464
+0.136.0,2024-10-09-22,count_index,0.008,125000000,0,0.008,0.005,0.002,0.008,0.008
+0.136.0,2024-10-09-22,count_no_polars,0.462,2164502,0.004,0.461,0.417,0.044,0.459,0.466
+0.136.0,2024-10-09-22,count_polars_lowmem,0.058,17241379,0.005,0.056,0.42,0.053,0.054,0.063
+0.136.0,2024-10-09-22,count_width,0.469,2132196,0.001,0.469,0.439,0.051,0.469,0.47
+0.136.0,2024-10-09-22,count_width_index,0.48,2083333,0.001,0.479,0.448,0.052,0.478,0.481
+0.136.0,2024-10-09-22,datefmt,1.774,563698,0.004,1.774,4.817,0.183,1.771,1.778
+0.136.0,2024-10-09-22,datefmt_formatstr_newcol,1.697,589275,0.003,1.698,4.038,0.182,1.693,1.699
+0.136.0,2024-10-09-22,datefmt_multi,2.127,470146,0.004,2.13,8.931,0.183,2.122,2.13
+0.136.0,2024-10-09-22,datefmt_multi_batchall,2.076,481696,0.005,2.075,8.507,0.162,2.072,2.081
+0.136.0,2024-10-09-22,datefmt_multi_select,2.35,425532,0.01,2.35,11.609,0.191,2.34,2.36
+0.136.0,2024-10-09-22,dedup,1.283,779423,0.006,1.286,2.085,0.134,1.276,1.288
+0.136.0,2024-10-09-22,dedup_sorted,0.989,1011122,0.003,0.988,0.928,0.107,0.987,0.992
+0.136.0,2024-10-09-22,diff,2.645,378072,0.024,2.637,4.132,0.19,2.626,2.672
+0.136.0,2024-10-09-22,enum,0.894,1118568,0.004,0.892,0.845,0.047,0.891,0.898
+0.136.0,2024-10-09-22,enum_constant,0.884,1131222,0.009,0.885,0.835,0.048,0.875,0.892
+0.136.0,2024-10-09-22,enum_copy,0.893,1119821,0.012,0.89,0.845,0.047,0.882,0.906
+0.136.0,2024-10-09-22,enum_hash,1.507,663570,0.006,1.508,1.457,0.05,1.501,1.513
+0.136.0,2024-10-09-22,enum_uuid,1.697,589275,0.002,1.697,0.96,0.735,1.694,1.699
+0.136.0,2024-10-09-22,enum_uuid7,1.73,578035,0.002,1.731,0.991,0.737,1.728,1.732
+0.136.0,2024-10-09-22,excel,12.394,80684,0.025,12.38,12.27,0.921,12.379,12.423
+0.136.0,2024-10-09-22,excel_error_format_formula,21.884,45695,0.007,21.885,21.685,1.006,21.876,21.891
+0.136.0,2024-10-09-22,excel_j1,12.915,77429,0.047,12.901,12.124,0.784,12.877,12.967
+0.136.0,2024-10-09-22,excel_metadata,12.197,81987,0.058,12.222,11.176,1.018,12.131,12.238
+0.136.0,2024-10-09-22,excel_metadata_short,0.949,1053741,0.006,0.946,0.31,0.638,0.946,0.956
+0.136.0,2024-10-09-22,excel_trim,12.549,79688,0.038,12.529,13.758,0.887,12.527,12.593
+0.136.0,2024-10-09-22,excel_trim_j1,14.099,70927,0.031,14.112,13.282,0.812,14.063,14.121
+0.136.0,2024-10-09-22,exclude,0.559,1788909,0.001,0.559,0.517,0.041,0.559,0.56
+0.136.0,2024-10-09-22,exclude_casei,0.564,1773050,0.003,0.565,0.52,0.043,0.561,0.567
+0.136.0,2024-10-09-22,exclude_casei_index,0.578,1730104,0.004,0.578,0.534,0.043,0.575,0.583
+0.136.0,2024-10-09-22,exclude_index,0.574,1742160,0,0.574,0.53,0.042,0.573,0.574
+0.136.0,2024-10-09-22,exclude_multi,0.882,1133787,0.011,0.877,0.841,0.04,0.875,0.894
+0.136.0,2024-10-09-22,exclude_multi_casei,0.89,1123596,0.008,0.888,0.849,0.039,0.884,0.898
+0.136.0,2024-10-09-22,exclude_multi_casei_index,0.913,1095290,0.004,0.913,0.867,0.044,0.909,0.917
+0.136.0,2024-10-09-22,exclude_multi_index,0.904,1106195,0.002,0.905,0.859,0.044,0.902,0.906
+0.136.0,2024-10-09-22,explode,1.587,630120,0.013,1.594,1.542,0.043,1.572,1.594
+0.136.0,2024-10-09-22,extdedup,1.055,947867,0.019,1.046,0.973,0.08,1.043,1.076
+0.136.0,2024-10-09-22,extsort,0.763,1310616,0.01,0.758,1.284,0.264,0.757,0.774
+0.136.0,2024-10-09-22,fill,2.088,478927,0.017,2.097,2.034,0.052,2.068,2.099
+0.136.0,2024-10-09-22,fixlengths,1.337,747943,0.004,1.336,1.248,0.088,1.333,1.341
+0.136.0,2024-10-09-22,flatten,5.604,178444,0.022,5.604,5.534,0.069,5.581,5.625
+0.136.0,2024-10-09-22,flatten_condensed,5.988,167001,0.014,5.995,5.916,0.071,5.971,5.997
+0.136.0,2024-10-09-22,fmt,1.003,997009,0.016,1.012,0.955,0.046,0.985,1.012
+0.136.0,2024-10-09-22,fmt_no_crlf,0.997,1003009,0.011,0.998,0.948,0.048,0.986,1.007
+0.136.0,2024-10-09-22,fmt_no_final_newline,1.006,994036,0.003,1.007,0.957,0.048,1.003,1.008
+0.136.0,2024-10-09-22,foreach,0.008,125000000,0,0.008,0.005,0.002,0.007,0.008
+0.136.0,2024-10-09-22,frequency,2.843,351741,0.016,2.847,3.763,0.157,2.825,2.855
+0.136.0,2024-10-09-22,frequency_ignorecase,3.541,282406,0.013,3.544,4.413,0.151,3.527,3.551
+0.136.0,2024-10-09-22,frequency_ignorecase_index,1.124,889680,0.057,1.151,5.658,0.266,1.058,1.162
+0.136.0,2024-10-09-22,frequency_index,1.048,954198,0.056,1.061,4.837,0.278,0.987,1.096
+0.136.0,2024-10-09-22,frequency_index_stats_mode_auto,1.007,993049,0.009,1.01,4.777,0.286,0.997,1.014
+0.136.0,2024-10-09-22,frequency_index_stats_mode_force,1.002,998004,0.017,1,4.753,0.288,0.985,1.019
+0.136.0,2024-10-09-22,frequency_index_stats_mode_none,1.118,894454,0.009,1.12,5.2,0.287,1.108,1.125
+0.136.0,2024-10-09-22,frequency_j1,3.388,295159,0.03,3.371,3.294,0.091,3.37,3.422
+0.136.0,2024-10-09-22,frequency_j1_ignorecase,4.097,244081,0.044,4.075,3.999,0.095,4.068,4.148
+0.136.0,2024-10-09-22,frequency_limit20,2.863,349284,0.017,2.86,3.767,0.156,2.847,2.882
+0.136.0,2024-10-09-22,frequency_limit20_index,1.063,940734,0.057,1.081,4.816,0.27,1,1.109
+0.136.0,2024-10-09-22,frequency_no_limit,4.727,211551,0.062,4.698,5.593,0.18,4.685,4.798
+0.136.0,2024-10-09-22,frequency_no_limit_index,2.602,384320,0.084,2.557,6.371,0.309,2.55,2.699
+0.136.0,2024-10-09-22,frequency_notrim,2.403,416146,0.009,2.398,3.296,0.154,2.397,2.413
+0.136.0,2024-10-09-22,frequency_notrim_index,0.982,1018330,0.047,0.959,4.255,0.275,0.95,1.037
+0.136.0,2024-10-09-22,frequency_other_sorted,2.839,352237,0.009,2.842,3.706,0.154,2.828,2.845
+0.136.0,2024-10-09-22,frequency_other_sorted_index,1.044,957854,0.044,1.057,4.786,0.279,0.995,1.08
+0.136.0,2024-10-09-22,frequency_selregex,0.803,1245330,0.006,0.806,0.88,0.053,0.796,0.807
+0.136.0,2024-10-09-22,frequency_selregex_ignorecase,1.002,998004,0.004,1.001,1.078,0.055,0.999,1.006
+0.136.0,2024-10-09-22,frequency_sorted,2.67,374532,0.021,2.673,3.504,0.163,2.648,2.69
+0.136.0,2024-10-09-22,frequency_sorted_index,2.759,362450,0.007,2.759,3.568,0.145,2.753,2.766
+0.136.0,2024-10-09-22,geocode_reverse,3.635,275103,0.022,3.638,2.964,10.649,3.612,3.656
+0.136.0,2024-10-09-22,geocode_reverse_batchall,3.706,269833,0.001,3.706,3.307,10.219,3.705,3.707
+0.136.0,2024-10-09-22,geocode_suggest,4.424,226040,0.013,4.42,21.384,2.652,4.414,4.439
+0.136.0,2024-10-09-22,geocode_suggest_batchall,4.436,225428,0.012,4.441,22.09,1.424,4.423,4.445
+0.136.0,2024-10-09-22,index,0.474,2109705,0,0.474,0.43,0.043,0.474,0.474
+0.136.0,2024-10-09-22,input,1.652,605327,0.005,1.651,1.6,0.051,1.648,1.657
+0.136.0,2024-10-09-22,join,1.892,528541,0.001,1.891,1.351,0.539,1.891,1.893
+0.136.0,2024-10-09-22,join_casei,1.899,526593,0.006,1.9,1.359,0.539,1.893,1.905
+0.136.0,2024-10-09-22,joinp,0.791,1264223,0.002,0.791,1.408,0.09,0.79,0.794
+0.136.0,2024-10-09-22,joinp_streaming,0.026,38461538,0,0.026,0.034,0.01,0.026,0.026
+0.136.0,2024-10-09-22,json,18.516,54007,0.053,18.505,16.98,1.526,18.468,18.574
+0.136.0,2024-10-09-22,jsonl,1.446,691563,0.003,1.446,7.012,0.198,1.444,1.449
+0.136.0,2024-10-09-22,jsonl_batchall,0.008,125000000,0,0.008,0.005,0.002,0.008,0.008
+0.136.0,2024-10-09-22,jsonl_j1,5.82,171821,0.011,5.82,5.686,0.132,5.808,5.831
+0.136.0,2024-10-09-22,luau_filter,7.429,134608,0.009,7.424,6.889,0.539,7.423,7.44
+0.136.0,2024-10-09-22,luau_filter_colidx,9.098,109914,0.025,9.092,8.539,0.557,9.077,9.126
+0.136.0,2024-10-09-22,luau_filter_no_globals,4.837,206740,0.007,4.841,4.306,0.53,4.829,4.842
+0.136.0,2024-10-09-22,luau_filter_no_globals_colidx,6.395,156372,0.019,6.405,5.862,0.532,6.374,6.407
+0.136.0,2024-10-09-22,luau_filter_no_globals_colidx,6.388,156544,0.011,6.394,5.851,0.536,6.376,6.395
+0.136.0,2024-10-09-22,luau_filter_no_globals_no_colidx,4.827,207168,0.01,4.822,4.299,0.527,4.821,4.839
+0.136.0,2024-10-09-22,luau_multi,23.365,42799,0.068,23.364,22.727,0.636,23.297,23.433
+0.136.0,2024-10-09-22,luau_multi_colidx,24.958,40067,0.027,24.947,24.302,0.654,24.938,24.988
+0.136.0,2024-10-09-22,luau_multi_no_globals,20.823,48024,0.297,20.659,20.182,0.639,20.643,21.166
+0.136.0,2024-10-09-22,luau_multi_no_globals_colidx,22.248,44948,0.074,22.24,21.591,0.655,22.178,22.325
+0.136.0,2024-10-09-22,luau_script,33.838,29553,0.05,33.84,33.181,0.655,33.786,33.887
+0.136.0,2024-10-09-22,luau_script_colidx,35.363,28278,0.042,35.379,34.698,0.663,35.315,35.394
+0.136.0,2024-10-09-22,luau_script_no_globals,31.057,32199,0.037,31.065,30.402,0.653,31.017,31.089
+0.136.0,2024-10-09-22,luau_script_no_globals_colidx,32.39,30874,0.101,32.333,31.734,0.654,32.33,32.506
+0.136.0,2024-10-09-22,partition,2.327,429738,0.015,2.324,0.937,1.361,2.314,2.343
+0.136.0,2024-10-09-22,pseudo,1.715,583090,0.001,1.715,1.657,0.056,1.714,1.716
+0.136.0,2024-10-09-22,pseudo_formatstr,1.927,518941,0.01,1.929,1.867,0.059,1.916,1.936
+0.136.0,2024-10-09-22,rename,0.987,1013171,0.001,0.987,0.939,0.047,0.987,0.988
+0.136.0,2024-10-09-22,replace,2.09,478469,0.005,2.091,2.038,0.051,2.085,2.095
+0.136.0,2024-10-09-22,reverse,0.975,1025641,0.004,0.975,0.866,0.104,0.972,0.979
+0.136.0,2024-10-09-22,reverse_index,6.118,163452,0.03,6.102,1.246,4.86,6.099,6.152
+0.136.0,2024-10-09-22,safenames,0.987,1013171,0.002,0.987,0.94,0.047,0.986,0.989
+0.136.0,2024-10-09-22,sample_10,0.518,1930502,0.003,0.516,0.472,0.044,0.516,0.521
+0.136.0,2024-10-09-22,sample_1000,0.514,1945525,0.001,0.513,0.471,0.042,0.513,0.516
+0.136.0,2024-10-09-22,sample_100000,0.651,1536098,0.004,0.65,0.603,0.047,0.647,0.655
+0.136.0,2024-10-09-22,sample_100000_index,1.142,875657,0.002,1.143,0.181,0.96,1.139,1.143
+0.136.0,2024-10-09-22,sample_100000_seeded,0.648,1543210,0.001,0.648,0.599,0.047,0.647,0.648
+0.136.0,2024-10-09-22,sample_100000_seeded_faster,0.637,1569859,0.003,0.637,0.59,0.046,0.635,0.64
+0.136.0,2024-10-09-22,sample_100000_seeded_index,1.134,881834,0.008,1.133,0.178,0.955,1.127,1.143
+0.136.0,2024-10-09-22,sample_100000_seeded_index_faster,1.119,893655,0.004,1.118,0.172,0.946,1.115,1.124
+0.136.0,2024-10-09-22,sample_100000_seeded_index_secure,1.13,884956,0.014,1.125,0.174,0.954,1.119,1.145
+0.136.0,2024-10-09-22,sample_100000_seeded_secure,0.644,1552795,0.006,0.641,0.596,0.047,0.64,0.651
+0.136.0,2024-10-09-22,sample_1000_index,0.033,30303030,0,0.033,0.017,0.015,0.033,0.033
+0.136.0,2024-10-09-22,sample_10_index,0.019,52631579,0,0.019,0.015,0.003,0.019,0.019
+0.136.0,2024-10-09-22,sample_25pct_index,2.784,359195,0.011,2.781,0.417,2.365,2.775,2.796
+0.136.0,2024-10-09-22,sample_25pct_seeded_index,2.781,359583,0.004,2.781,0.42,2.36,2.777,2.785
+0.136.0,2024-10-09-22,schema,7.817,127926,0.041,7.831,13.273,0.393,7.771,7.848
+0.136.0,2024-10-09-22,schema_index,0.111,9009009,0,0.111,1.024,0.062,0.11,0.111
+0.136.0,2024-10-09-22,search,0.587,1703578,0.001,0.586,0.542,0.044,0.586,0.588
+0.136.0,2024-10-09-22,search_file,1.069,935454,0.002,1.07,1.022,0.046,1.067,1.071
+0.136.0,2024-10-09-22,search_file_case_sensitive,0.984,1016260,0.001,0.984,0.937,0.046,0.984,0.985
+0.136.0,2024-10-09-22,search_file_case_sensitive_unicode,0.984,1016260,0.002,0.983,0.935,0.048,0.982,0.985
+0.136.0,2024-10-09-22,search_file_flag,1.253,798085,0.001,1.253,1.203,0.049,1.252,1.254
+0.136.0,2024-10-09-22,search_file_flag_matchonly,0.841,1189061,0.003,0.84,0.794,0.046,0.839,0.844
+0.136.0,2024-10-09-22,search_file_literal,0.942,1061571,0.004,0.943,0.894,0.047,0.937,0.946
+0.136.0,2024-10-09-22,search_file_unicode,1.088,919118,0.002,1.088,1.04,0.047,1.087,1.09
+0.136.0,2024-10-09-22,search_unicode,0.586,1706485,0.001,0.586,0.542,0.044,0.585,0.587
+0.136.0,2024-10-09-22,searchset,1.248,801282,0.003,1.247,1.569,0.104,1.245,1.252
+0.136.0,2024-10-09-22,searchset_ignorecase,1.441,693963,0.001,1.441,1.76,0.104,1.439,1.441
+0.136.0,2024-10-09-22,searchset_unicode,1.245,803213,0.005,1.244,1.559,0.102,1.241,1.25
+0.136.0,2024-10-09-22,select,0.491,2036660,0,0.491,0.447,0.043,0.491,0.492
+0.136.0,2024-10-09-22,select_regex,0.527,1897533,0.002,0.526,0.482,0.044,0.525,0.529
+0.136.0,2024-10-09-22,slice_last_1k,0.009,111111111,0,0.009,0.006,0.002,0.009,0.009
+0.136.0,2024-10-09-22,slice_last_1k_index,0.009,111111111,0,0.009,0.006,0.002,0.009,0.009
+0.136.0,2024-10-09-22,slice_last_1k_json,0.012,83333333,0,0.012,0.009,0.002,0.012,0.012
+0.136.0,2024-10-09-22,slice_last_1k_json_index,0.012,83333333,0,0.012,0.009,0.003,0.012,0.012
+0.136.0,2024-10-09-22,slice_one_middle,0.257,3891051,0.001,0.257,0.232,0.024,0.256,0.258
+0.136.0,2024-10-09-22,slice_one_middle_index,0.008,125000000,0,0.008,0.005,0.002,0.008,0.008
+0.136.0,2024-10-09-22,snappy_compress,0.175,5714286,0.006,0.179,1.162,0.107,0.168,0.179
+0.136.0,2024-10-09-22,snappy_decompress,0.495,2020202,0.002,0.495,0.473,0.021,0.493,0.498
+0.136.0,2024-10-09-22,snappy_validate,0.478,2092050,0,0.478,0.457,0.019,0.477,0.478
+0.136.0,2024-10-09-22,sort,1.245,803213,0.004,1.244,2.116,0.128,1.241,1.249
+0.136.0,2024-10-09-22,sort_random_seeded,1.176,850340,0.017,1.172,1.064,0.107,1.16,1.194
+0.136.0,2024-10-09-22,sort_random_seeded_faster,1.165,858369,0.012,1.168,1.048,0.113,1.153,1.176
+0.136.0,2024-10-09-22,sort_random_seeded_secure,1.175,851064,0.011,1.169,1.065,0.106,1.169,1.188
+0.136.0,2024-10-09-22,sortcheck_sorted,0.498,2008032,0,0.499,0.454,0.043,0.498,0.499
+0.136.0,2024-10-09-22,sortcheck_unsorted,0.008,125000000,0,0.007,0.005,0.002,0.007,0.008
+0.136.0,2024-10-09-22,sortcheck_unsorted_all,0.533,1876173,0.003,0.533,0.487,0.045,0.53,0.535
+0.136.0,2024-10-09-22,split,0.972,1028807,0.05,0.965,0.817,0.107,0.926,1.024
+0.136.0,2024-10-09-22,split_chunks,1.016,984252,0.029,1.025,1.239,0.156,0.984,1.039
+0.136.0,2024-10-09-22,split_chunks_index,0.237,4219409,0.115,0.203,1.065,0.205,0.143,0.365
+0.136.0,2024-10-09-22,split_chunks_index_j1,0.009,111111111,0,0.009,0.005,0.004,0.009,0.009
+0.136.0,2024-10-09-22,split_index,0.207,4830918,0.057,0.239,1.044,0.2,0.141,0.24
+0.136.0,2024-10-09-22,split_index_j1,1.027,973710,0.038,1.01,0.88,0.112,0.999,1.071
+0.136.0,2024-10-09-22,split_kbsize,2.037,490918,0.043,2.019,1.898,0.11,2.005,2.086
+0.136.0,2024-10-09-22,sqlp,1.047,955110,0.014,1.046,2.012,0.273,1.033,1.061
+0.136.0,2024-10-09-22,sqlp_aggregations,0.992,1008065,0.011,0.985,1.375,0.057,0.985,1.004
+0.136.0,2024-10-09-22,sqlp_aggregations_expensive,0.858,1165501,0.011,0.854,1.429,0.097,0.85,0.87
+0.136.0,2024-10-09-22,sqlp_aggregations_expensive_streaming,0.859,1164144,0.008,0.856,1.429,0.092,0.853,0.868
+0.136.0,2024-10-09-22,sqlp_aggregations_expensive_vs_duckdb,0.22,4545455,0.005,0.218,0.88,0.123,0.217,0.226
+0.136.0,2024-10-09-22,sqlp_aggregations_vs_duckdb,0.194,5154639,0.005,0.196,0.615,0.102,0.189,0.198
+0.136.0,2024-10-09-22,sqlp_format_arrow,1.736,576037,0.003,1.736,2.213,0.727,1.734,1.74
+0.136.0,2024-10-09-22,sqlp_format_avro,1.03,970874,0.005,1.029,1.986,0.374,1.026,1.036
+0.136.0,2024-10-09-22,sqlp_format_json,1.023,977517,0.001,1.024,1.965,0.259,1.021,1.024
+0.136.0,2024-10-09-22,sqlp_format_jsonl,1.024,976562,0.002,1.023,1.964,0.256,1.022,1.026
+0.136.0,2024-10-09-22,sqlp_format_parquet,1.025,975610,0.002,1.024,1.976,0.271,1.024,1.027
+0.136.0,2024-10-09-22,sqlp_format_parquet_statistics,1.025,975610,0.002,1.025,1.974,0.28,1.023,1.027
+0.136.0,2024-10-09-22,sqlp_lowmemory,1.015,985222,0.002,1.015,1.963,0.254,1.013,1.017
+0.136.0,2024-10-09-22,sqlp_nooptimizations,1.048,954198,0.001,1.047,2.015,0.187,1.047,1.049
+0.136.0,2024-10-09-22,sqlp_tryparsedates,11.918,83907,0.014,11.914,12.857,0.265,11.907,11.934
+0.136.0,2024-10-09-22,sqlp_tryparsedates_inferlen,1.918,521376,0.006,1.92,2.864,0.25,1.911,1.923
+0.136.0,2024-10-09-22,stats,1.91,523560,0.005,1.911,2.219,0.095,1.904,1.914
+0.136.0,2024-10-09-22,stats_create_cache,1.91,523560,0.005,1.912,2.22,0.093,1.905,1.913
+0.136.0,2024-10-09-22,stats_everything,3.355,298063,0.04,3.344,10.192,0.393,3.322,3.4
+0.136.0,2024-10-09-22,stats_everything_create_cache,3.39,294985,0.019,3.382,10.238,0.393,3.376,3.411
+0.136.0,2024-10-09-22,stats_everything_index,1.331,751315,0.009,1.329,10.826,0.567,1.323,1.341
+0.136.0,2024-10-09-22,stats_everything_index_j1,6.615,151172,0.154,6.637,6.551,0.212,6.451,6.757
+0.136.0,2024-10-09-22,stats_everything_index_j1_with_cache,0.008,125000000,0,0.008,0.005,0.002,0.008,0.008
+0.136.0,2024-10-09-22,stats_everything_index_with_cache,0.008,125000000,0,0.008,0.005,0.003,0.008,0.008
+0.136.0,2024-10-09-22,stats_everything_infer_dates,7.172,139431,0.002,7.172,14.419,0.436,7.171,7.174
+0.136.0,2024-10-09-22,stats_everything_infer_dates_index,1.893,528262,0.026,1.904,17.085,0.587,1.863,1.912
+0.136.0,2024-10-09-22,stats_everything_infer_dates_index_with_cache,0.008,125000000,0,0.008,0.005,0.003,0.008,0.008
+0.136.0,2024-10-09-22,stats_everything_j1,6.375,156863,0.039,6.378,6.588,0.261,6.335,6.412
+0.136.0,2024-10-09-22,stats_everything_sorted,3.309,302206,0.016,3.309,9.845,0.404,3.293,3.325
+0.136.0,2024-10-09-22,stats_everything_sorted_index,3.328,300481,0.007,3.327,9.829,0.41,3.322,3.335
+0.136.0,2024-10-09-22,stats_index,0.226,4424779,0.005,0.225,2.294,0.066,0.223,0.232
+0.136.0,2024-10-09-22,stats_index_j1,1.886,530223,0.001,1.886,1.844,0.04,1.884,1.887
+0.136.0,2024-10-09-22,stats_index_j1_with_cache,0.008,125000000,0,0.008,0.005,0.002,0.008,0.008
+0.136.0,2024-10-09-22,stats_index_with_cache,0.008,125000000,0,0.008,0.005,0.003,0.008,0.008
+0.136.0,2024-10-09-22,table,6.831,146391,0.023,6.828,5.733,1.09,6.81,6.856
+0.136.0,2024-10-09-22,to_datapackage,0.695,1438849,0.004,0.694,2.098,0.302,0.693,0.699
+0.136.0,2024-10-09-22,to_sqlite,0.687,1455604,0.006,0.689,2.08,0.294,0.68,0.692
+0.136.0,2024-10-09-22,to_xlsx,30.796,32472,0.034,30.809,29.307,3.064,30.758,30.822
+0.136.0,2024-10-09-22,tojsonl,5.256,190259,0.029,5.258,10.162,0.415,5.225,5.284
+0.136.0,2024-10-09-22,tojsonl_batchall,5.279,189430,0.019,5.275,10.091,0.378,5.263,5.299
+0.136.0,2024-10-09-22,tojsonl_index,2.896,345304,0.08,2.868,11.432,0.44,2.833,2.986
+0.136.0,2024-10-09-22,tojsonl_index_j1,8.996,111161,0.02,9.003,8.608,0.382,8.973,9.01
+0.136.0,2024-10-09-22,tojsonl_j1,9.05,110497,0.042,9.033,9.022,0.43,9.02,9.098
+0.136.0,2024-10-09-22,tojsonl_trim,5.349,186951,0.007,5.349,10.951,0.386,5.342,5.356
+0.136.0,2024-10-09-22,tojsonl_trim_j1,9.571,104482,0.015,9.568,9.526,0.449,9.558,9.588
+0.136.0,2024-10-09-22,transpose,2.623,381243,0.026,2.612,2.418,0.199,2.605,2.652
+0.136.0,2024-10-09-22,transpose_multipass,21.423,46679,0.021,21.414,19.688,1.733,21.407,21.447
+0.136.0,2024-10-09-22,validate,1.345,743494,0.011,1.345,6.257,0.152,1.335,1.357
+0.136.0,2024-10-09-22,validate_batchall,1.282,780031,0.008,1.284,5.824,0.115,1.274,1.289
+0.136.0,2024-10-09-22,validate_batchall_index,1.286,777605,0.004,1.286,5.746,0.125,1.281,1.29
+0.136.0,2024-10-09-22,validate_dynenum,1.32,757576,0.005,1.318,6.184,0.147,1.317,1.326
+0.136.0,2024-10-09-22,validate_dynenum_batchall,1.273,785546,0.003,1.273,5.749,0.11,1.27,1.275
+0.136.0,2024-10-09-22,validate_dynenum_batchall_index,1.272,786164,0.006,1.273,5.688,0.122,1.265,1.277
+0.136.0,2024-10-09-22,validate_dynenum_index,1.27,787402,0.001,1.269,5.679,0.104,1.269,1.271
+0.136.0,2024-10-09-22,validate_dynenum_no_schema,1.332,750751,0.009,1.335,6.149,0.149,1.322,1.338
+0.136.0,2024-10-09-22,validate_dynenum_no_schema_index,1.268,788644,0.004,1.27,5.694,0.102,1.263,1.271
+0.136.0,2024-10-09-22,validate_dynenum_valid_output,2.202,454133,0.003,2.203,7.002,0.193,2.199,2.204
+0.136.0,2024-10-09-22,validate_dynenum_valid_output_index,2.135,468384,0.004,2.136,6.539,0.143,2.131,2.138
+0.136.0,2024-10-09-22,validate_index,1.282,780031,0.003,1.283,5.739,0.102,1.278,1.285
+0.136.0,2024-10-09-22,validate_no_schema,0.488,2049180,0.004,0.489,0.443,0.044,0.484,0.491
+0.136.0,2024-10-09-22,validate_no_schema_index,0.495,2020202,0.001,0.494,0.454,0.039,0.494,0.496
+0.136.0,2024-10-09-22,validate_valid_output,2.213,451875,0.004,2.215,7.102,0.194,2.208,2.215
+0.136.0,2024-10-09-22,validate_valid_output_index,2.143,466636,0.008,2.139,6.604,0.14,2.139,2.153
0.135.0,2024-09-24-16,apply_calcconv,1.656,603865,0.025,1.647,3.308,0.189,1.638,1.684
0.135.0,2024-09-24-16,apply_dynfmt,2.084,479846,0.102,2.039,5.59,0.19,2.011,2.2
0.135.0,2024-09-24-16,apply_emptyreplace,1.525,655738,0.004,1.524,2.247,0.159,1.522,1.529
diff --git a/scripts/results/latest_results.csv b/scripts/results/latest_results.csv
index 024bf4948..47b49b6bc 100644
--- a/scripts/results/latest_results.csv
+++ b/scripts/results/latest_results.csv
@@ -1,234 +1,235 @@
version,tstamp,name,mean,stddev,median,user,system,min,max,recs_per_sec
-0.135.0,2024-09-24-16,apply_calcconv,1.6561738473333334,0.024501838167906777,1.647001417,3.308348666666666,0.18862966666666667,1.6375816250000002,1.6839385,603865
-0.135.0,2024-09-24-16,apply_dynfmt,2.0836702916666665,0.10193847447027907,2.039226917,5.589999,0.19001333333333328,2.011498958,2.200285,479846
-0.135.0,2024-09-24-16,apply_emptyreplace,1.52477925,0.0037840099082099747,1.5236345,2.2465766666666664,0.15877699999999997,1.521699791,1.5290034590000001,655738
-0.135.0,2024-09-24-16,apply_op_eudex,1.4709690000000002,0.004635660128896329,1.4701724170000001,1.6751436666666664,0.17626266666666668,1.46678325,1.475951333,679810
-0.135.0,2024-09-24-16,apply_op_similarity,1.5026988053333332,0.036124805945877386,1.489682083,1.8088156666666666,0.16535066666666665,1.47488625,1.543528083,665336
-0.135.0,2024-09-24-16,apply_op_similarity_batchall,1.6281318333333334,0.013907561155338224,1.620127667,2.1134876666666664,0.42611133333333334,1.620076958,1.644190875,614251
-0.135.0,2024-09-24-16,apply_op_string,1.5299231526666668,0.006093751682075404,1.5332260830000002,2.2687676666666667,0.16097799999999998,1.522891,1.533652375,653595
-0.135.0,2024-09-24-16,behead,0.918768736,0.004973469597498395,0.918477792,0.8748636666666667,0.04174366666666666,0.9139471250000001,0.923881291,1088139
-0.135.0,2024-09-24-16,behead_flexible,0.9622273333333333,0.010936315635725875,0.9673666670000001,0.9192056666666666,0.04088366666666666,0.9496680000000001,0.9696473330000001,1039501
-0.135.0,2024-09-24-16,cat_columns,2.9672721806666664,0.006632064974674839,2.964664042,2.8792030000000004,0.08591366666666667,2.9623406670000003,2.974811833,337041
-0.135.0,2024-09-24-16,cat_rows,1.8585314860000002,0.013529493584203123,1.863656125,1.773313,0.08310933333333333,1.843188292,1.8687500410000002,537924
-0.135.0,2024-09-24-16,cat_rows_flexible,1.8210944586666666,0.0035848271599336215,1.821112792,1.735658,0.08283,1.8175005,1.824670084,549149
-0.135.0,2024-09-24-16,cat_rowskey,3.2519307360000003,0.007564855727902409,3.255147208,3.163473666666667,0.085781,3.243289167,3.257355833,307503
-0.135.0,2024-09-24-16,count,0.06696670833333333,0.0011541730024014311,0.067063833,0.42164599999999997,0.052527333333333336,0.065767042,0.06806925,14925373
-0.135.0,2024-09-24-16,count_flexible,0.461102903,0.0006918031658015236,0.461196667,0.41882133333333327,0.040195666666666664,0.46036900000000003,0.46174304200000005,2169197
-0.135.0,2024-09-24-16,count_index,0.00899275,0.0001997653310762403,0.0090735,0.0048839999999999995,0.0021863333333333335,0.00876525,0.0091395,111111111
-0.135.0,2024-09-24-16,count_no_polars,0.46324341666666663,0.0018735530965847498,0.46391216700000004,0.4188686666666666,0.04220566666666666,0.46112725000000004,0.464690833,2159827
-0.135.0,2024-09-24-16,count_polars_lowmem,0.05739552766666667,0.0019269810759188401,0.057406417,0.40767766666666666,0.052958,0.055463125,0.059317041,17543860
-0.135.0,2024-09-24-16,count_width,0.4720493053333334,0.0063411977419242675,0.46867375000000006,0.44237566666666667,0.04803866666666667,0.468109916,0.47936425000000005,2118644
-0.135.0,2024-09-24-16,count_width_index,0.4930666803333334,0.016577662597782625,0.48702358300000004,0.4615993333333333,0.04938033333333333,0.480358333,0.511818125,2028398
-0.135.0,2024-09-24-16,datefmt,1.7239539170000002,0.0008712174631737919,1.723511875,4.3592059999999995,0.16835433333333336,1.7233923340000001,1.724957542,580046
-0.135.0,2024-09-24-16,datefmt_formatstr_newcol,1.6420713473333333,0.0029293991572182767,1.6422111670000001,3.5576136666666662,0.1609013333333333,1.639074542,1.6449283330000002,609013
-0.135.0,2024-09-24-16,datefmt_multi,2.084292222333333,0.004543992222203884,2.083293625,8.462918333333333,0.16106233333333334,2.080330583,2.089252459,479846
-0.135.0,2024-09-24-16,datefmt_multi_batchall,2.198415069666667,0.002017713862499274,2.197255417,8.809954666666668,0.33751266666666674,2.197244875,2.200744917,454959
-0.135.0,2024-09-24-16,datefmt_multi_select,2.323542041666667,0.009982654504934525,2.319155041,11.266940333333332,0.165737,2.316504125,2.334966959,430293
-0.135.0,2024-09-24-16,dedup,1.3292426666666668,0.007532498844117107,1.333438292,2.1353999999999997,0.12802433333333332,1.320546666,1.333743042,752445
-0.135.0,2024-09-24-16,dedup_sorted,1.0500485560000001,0.0009519418556104904,1.050291417,0.9836123333333333,0.11224633333333334,1.048998709,1.050855542,952381
-0.135.0,2024-09-24-16,diff,2.6763047776666666,0.007511558345475026,2.676419959,4.152838666666667,0.18858233333333332,2.668736291,2.683758083,373692
-0.135.0,2024-09-24-16,enum,0.9571187776666666,0.00011805103588841627,0.95709675,0.9137013333333334,0.041293666666666666,0.9570132920000001,0.957246291,1044932
-0.135.0,2024-09-24-16,enum_constant,0.9562375833333334,0.002867278690866569,0.955433708,0.910845,0.04322433333333333,0.953858042,0.9594210000000001,1046025
-0.135.0,2024-09-24-16,enum_copy,0.9635569446666667,0.0005196529601083491,0.963711834,0.9193009999999999,0.04212933333333333,0.962977458,0.9639815420000001,1037344
-0.135.0,2024-09-24-16,enum_hash,1.5690463053333332,0.0010462513805603616,1.5693133330000002,1.5240173333333331,0.042890000000000005,1.567892417,1.569933166,637349
-0.135.0,2024-09-24-16,enum_uuid,1.759877972,0.002356836554815807,1.760088542,1.0258450000000001,0.7319576666666666,1.757422916,1.762122458,568182
-0.135.0,2024-09-24-16,enum_uuid7,1.7865406110000002,0.003500286745534298,1.788556,1.0520086666666666,0.732247,1.782498833,1.788567,559597
-0.135.0,2024-09-24-16,excel,12.407360777666668,0.013094151597758374,12.411723291,12.295141,0.8913913333333333,12.39264225,12.417716792,80600
-0.135.0,2024-09-24-16,excel_error_format_formula,22.405064653,0.22214262043431157,22.300814542,22.123282,1.0543763333333331,22.254221042,22.660158375,44633
-0.135.0,2024-09-24-16,excel_j1,12.996690555666667,0.033254665839665305,12.9904405,12.195943999999999,0.7920936666666666,12.967004375,13.032626792,76941
-0.135.0,2024-09-24-16,excel_metadata,11.952817139333334,0.04348827542480086,11.948436167,11.183247,0.7588929999999999,11.911685167,11.998330084000001,83661
-0.135.0,2024-09-24-16,excel_metadata_short,0.522740764,0.008032774392137298,0.5240271670000001,0.16315733333333335,0.3567106666666666,0.5141424170000001,0.530052708,1912046
-0.135.0,2024-09-24-16,excel_trim,12.618090083333334,0.025927595122572866,12.606782792,13.621176666666665,1.0246179999999998,12.599736458,12.647751,79252
-0.135.0,2024-09-24-16,excel_trim_j1,14.112316291333334,0.00887533405014761,14.113719125,13.218260999999998,0.8820646666666666,14.102823083,14.120406666,70862
-0.135.0,2024-09-24-16,exclude,0.5736019166666667,0.0025727979095399906,0.57331475,0.5309276666666666,0.039996333333333335,0.57118475,0.57630625,1742160
-0.135.0,2024-09-24-16,exclude_casei,0.5782353196666667,0.0007637199804642468,0.5786370000000001,0.5363053333333333,0.039253666666666666,0.5773545840000001,0.578714375,1730104
-0.135.0,2024-09-24-16,exclude_casei_index,0.5852502780000001,0.006363961176733965,0.585642375,0.5430256666666665,0.03989499999999999,0.5786993340000001,0.5914091250000001,1709402
-0.135.0,2024-09-24-16,exclude_index,0.5787455973333334,0.005896403261463427,0.576707167,0.5367526666666667,0.03968566666666667,0.574138875,0.5853907500000001,1727116
-0.135.0,2024-09-24-16,exclude_multi,0.9076274863333333,0.0038674071804712406,0.9086384590000001,0.8633686666666667,0.041767,0.903355,0.9108890000000001,1101322
-0.135.0,2024-09-24-16,exclude_multi_casei,0.9310793473333333,0.02900865121910744,0.916849208,0.888016,0.040321666666666665,0.9119336250000001,0.964455209,1074114
-0.135.0,2024-09-24-16,exclude_multi_casei_index,0.918678528,0.0037736147407016448,0.920563459,0.8755213333333333,0.04095466666666667,0.9143337920000001,0.921138333,1088139
-0.135.0,2024-09-24-16,exclude_multi_index,0.9204265420000001,0.009361009899892699,0.9205869170000001,0.8766863333333333,0.041166666666666664,0.910986375,0.929706334,1086957
-0.135.0,2024-09-24-16,explode,1.6107419026666667,0.004866132637237246,1.6128365420000002,1.563614333333333,0.044317999999999996,1.605179208,1.614209958,620732
-0.135.0,2024-09-24-16,extdedup,1.067265653,0.012404302795964581,1.068366,0.9814016666666667,0.081241,1.054347834,1.079083125,937207
-0.135.0,2024-09-24-16,extsort,0.8386422776666667,0.035784224237229316,0.823837708,1.3196759999999998,0.29566299999999995,0.8126360420000001,0.879453083,1191895
-0.135.0,2024-09-24-16,fill,2.141778291666667,0.008741486049120752,2.144456583,2.0914179999999996,0.04634733333333333,2.132011,2.148867292,466853
-0.135.0,2024-09-24-16,fixlengths,1.4535256113333332,0.005173087035179922,1.45482025,1.3682683333333332,0.08247633333333333,1.447828167,1.457928417,687758
-0.135.0,2024-09-24-16,flatten,5.631412597000001,0.0072111346127681575,5.633534958,5.576536333333333,0.051366666666666665,5.623378458,5.637324375,177588
-0.135.0,2024-09-24-16,flatten_condensed,6.138042236333334,0.059734858038596836,6.118565834,6.082980666666667,0.051888,6.090476375,6.2050845,162920
-0.135.0,2024-09-24-16,fmt,1.0300456943333334,0.0036681274449213083,1.029574667,0.9828433333333333,0.044510333333333325,1.026635833,1.033926583,970874
-0.135.0,2024-09-24-16,fmt_no_crlf,1.032838611,0.007629201759700244,1.031791583,0.9860773333333333,0.04427066666666666,1.025787,1.04093725,968054
-0.135.0,2024-09-24-16,fmt_no_final_newline,1.0341688056666667,0.0025591625386629535,1.033542042,0.9875346666666666,0.04334,1.03198125,1.036983125,967118
-0.135.0,2024-09-24-16,foreach,0.006671138666666667,0.00006106024931437279,0.006689208,0.004203666666666667,0.0014823333333333331,0.006603083,0.0067211250000000005,142857143
-0.135.0,2024-09-24-16,frequency,3.1963116389999997,0.06532450376844255,3.219018666,4.1295416666666656,0.151076,3.122663792,3.247252459,312891
-0.135.0,2024-09-24-16,frequency_ignorecase,3.8656460136666664,0.0811792896967743,3.888340791,4.806199333333333,0.1503173333333333,3.7755345,3.93306275,258665
-0.135.0,2024-09-24-16,frequency_ignorecase_index,1.151306375,0.03892438847664332,1.173626625,5.847245999999999,0.298613,1.106360708,1.173931792,868810
-0.135.0,2024-09-24-16,frequency_index,1.0664998609999998,0.04197956631418569,1.059359167,4.922676,0.2937193333333334,1.028548625,1.111591791,938086
-0.135.0,2024-09-24-16,frequency_index_stats_mode_auto,1.0824912083333333,0.04314030729787649,1.096318625,4.949983333333333,0.30059966666666665,1.0341325,1.1170225,924214
-0.135.0,2024-09-24-16,frequency_index_stats_mode_force,1.0689637633333333,0.03210656709556349,1.072836666,4.910664999999999,0.2876026666666666,1.035096416,1.098958208,935454
-0.135.0,2024-09-24-16,frequency_index_stats_mode_none,1.204983806,0.043028164990857536,1.224189917,5.400438333333334,0.30676699999999996,1.155697417,1.235064084,829876
-0.135.0,2024-09-24-16,frequency_j1,3.8380692913333334,0.06275029208618856,3.804467708,3.744283333333333,0.08838299999999999,3.7992751250000003,3.910465041,260552
-0.135.0,2024-09-24-16,frequency_j1_ignorecase,4.422148597666666,0.12451558138431715,4.462734792,4.328220666666666,0.08834666666666664,4.282403834,4.521307167,226142
-0.135.0,2024-09-24-16,frequency_limit20,3.133674013666667,0.03161891719242739,3.127625458,4.078483666666667,0.15589699999999998,3.105516291,3.167880292,319081
-0.135.0,2024-09-24-16,frequency_limit20_index,1.0761722363333333,0.0695473478197952,1.080959458,4.951464666666666,0.284047,1.004354959,1.143202292,929368
-0.135.0,2024-09-24-16,frequency_no_limit,5.060725708333334,0.01524724816893902,5.064347375,5.984163,0.17553699999999997,5.043993708,5.073836042,197589
-0.135.0,2024-09-24-16,frequency_no_limit_index,2.736244889,0.09661334239009267,2.708049958,6.638563333333333,0.322608,2.6568655,2.8438192090000003,365497
-0.135.0,2024-09-24-16,frequency_notrim,2.655396902666667,0.046896941701464384,2.634113,3.581782666666667,0.14866266666666667,2.622916125,2.709161583,376648
-0.135.0,2024-09-24-16,frequency_notrim_index,1.012327097,0.013312405203440444,1.015763583,4.405483333333333,0.30316533333333334,0.997633375,1.023584333,988142
-0.135.0,2024-09-24-16,frequency_other_sorted,3.2561983753333337,0.15079996725149042,3.21875275,4.225429666666667,0.15031599999999998,3.127649334,3.422193042,307125
-0.135.0,2024-09-24-16,frequency_other_sorted_index,1.0926134583333333,0.03106780889609415,1.109147292,5.041124666666666,0.296475,1.056775125,1.111917958,914913
-0.135.0,2024-09-24-16,frequency_selregex,0.8351828470000001,0.008723118527202067,0.838418791,0.9158883333333333,0.057894,0.8253041670000001,0.8418255830000001,1197605
-0.135.0,2024-09-24-16,frequency_selregex_ignorecase,1.0209325276666668,0.015728629606828744,1.019474958,1.0941743333333331,0.059975999999999995,1.005983417,1.037339208,979432
-0.135.0,2024-09-24-16,frequency_sorted,2.9222854586666664,0.06648564345737881,2.903838625,3.7744139999999997,0.15414333333333333,2.8669710840000002,2.996046667,342231
-0.135.0,2024-09-24-16,frequency_sorted_index,3.009924208333333,0.10678435574180659,2.99290325,3.8734683333333333,0.1593083333333333,2.912672625,3.12419675,332226
-0.135.0,2024-09-24-16,geocode_reverse,3.6880939306666662,0.00863975145930737,3.684070041,2.9772176666666663,10.374819,3.682200084,3.6980116670000003,271150
-0.135.0,2024-09-24-16,geocode_reverse_batchall,3.897372819333333,0.027767561244194317,3.909226625,3.3624283333333334,10.494807333333334,3.865645666,3.917246167,256608
-0.135.0,2024-09-24-16,geocode_suggest,4.592817819666666,0.004441685384265679,4.592079792,21.658865000000002,2.560424,4.588791375,4.597582292,217723
-0.135.0,2024-09-24-16,geocode_suggest_batchall,4.572229444333334,0.028855180910389664,4.586816,22.194153333333333,1.4211766666666668,4.538993041,4.590879292,218723
-0.135.0,2024-09-24-16,index,0.4797199863333333,0.0025052446830691674,0.480966,0.4356623333333333,0.04165833333333333,0.476836042,0.481357917,2083333
-0.135.0,2024-09-24-16,input,1.6647838053333333,0.0028998328398934865,1.665573958,1.6172893333333331,0.04491233333333333,1.661570791,1.667206667,600601
-0.135.0,2024-09-24-16,join,2.0172392776666666,0.015012515482451774,2.016704666,1.3798323333333335,0.6335263333333333,2.002501209,2.032511958,495786
-0.135.0,2024-09-24-16,join_casei,2.033957111,0.030735016833308194,2.024246667,1.4049996666666666,0.6254603333333333,2.009250166,2.0683745,491642
-0.135.0,2024-09-24-16,joinp,0.04221793033333334,0.0004218237739819001,0.042042208000000005,0.12950899999999999,0.020065333333333334,0.041912375,0.042699208,23809524
-0.135.0,2024-09-24-16,joinp_streaming,0.02875315266666667,0.00034883999598144314,0.028889625000000002,0.04144833333333333,0.009215666666666665,0.028356708,0.029013125,34482759
-0.135.0,2024-09-24-16,json,22.288082791333334,0.6040361235228544,22.144090916,17.532103,3.8630259999999996,21.769054708,22.95110275,44867
-0.135.0,2024-09-24-16,jsonl,1.4996724026666666,0.02129130394532689,1.51019975,7.031866,0.20919166666666666,1.4751681250000002,1.513649333,666667
-0.135.0,2024-09-24-16,jsonl_batchall,0.0065708196666666675,0.00003340283739943842,0.006589917000000001,0.0042313333333333335,0.0014026666666666666,0.006532250000000001,0.006590292,142857143
-0.135.0,2024-09-24-16,jsonl_j1,5.92287075,0.020504258228094523,5.913642625,5.791743666666666,0.12608533333333333,5.908602125,5.9463675,168833
-0.135.0,2024-09-24-16,luau_filter,7.528790555333334,0.06770994502347814,7.505211792,6.999822333333333,0.5246979999999999,7.476022458,7.605137416,132820
-0.135.0,2024-09-24-16,luau_filter_colidx,9.125884777666668,0.020188361167090923,9.119456125,8.59906,0.522716,9.109693583,9.148504625,109577
-0.135.0,2024-09-24-16,luau_filter_no_globals,4.8728402363333325,0.003538084860333533,4.874713417,4.357304666666666,0.5123763333333332,4.868759375,4.875047917,205212
-0.135.0,2024-09-24-16,luau_filter_no_globals_colidx,6.480947819333333,0.08335385896378719,6.43424475,5.955324333333333,0.5217593333333332,6.4314160000000005,6.5771827080000005,154297
-0.135.0,2024-09-24-16,luau_filter_no_globals_colidx,6.416223027666667,0.04007971906774632,6.434327875,5.896752666666667,0.515821,6.370285041,6.444056167,155860
-0.135.0,2024-09-24-16,luau_filter_no_globals_no_colidx,4.882403042,0.008304400477421212,4.878792625,4.366066999999999,0.5129766666666667,4.876514959,4.891901542,204834
-0.135.0,2024-09-24-16,luau_multi,23.563149166666665,0.12084128658263342,23.618674792,22.948927999999995,0.6057076666666666,23.42452475,23.646247958,42439
-0.135.0,2024-09-24-16,luau_multi_colidx,25.307053138666664,0.14190246076738108,25.229437541,24.68983366666667,0.6084596666666666,25.22088825,25.470833625,39515
-0.135.0,2024-09-24-16,luau_multi_no_globals,20.789784833,0.09330818084710885,20.771233208,20.18826333333333,0.5941096666666666,20.707146041,20.89097525,48100
-0.135.0,2024-09-24-16,luau_multi_no_globals_colidx,22.468777777666663,0.06336147206336232,22.434319,21.860624666666666,0.5994426666666667,22.430113333,22.541901,44506
-0.135.0,2024-09-24-16,luau_script,34.37493123633333,0.18424511590436754,34.450772584,33.71988733333333,0.6386066666666667,34.164870125,34.509151,29091
-0.135.0,2024-09-24-16,luau_script_colidx,35.95311194433334,0.09459903982334486,35.9000125,35.315021333333334,0.6261333333333333,35.89699175,36.062331583,27814
-0.135.0,2024-09-24-16,luau_script_no_globals,31.48654755533333,0.06536227423210579,31.483836875,30.858859666666664,0.6170133333333333,31.422582791,31.553223,31759
-0.135.0,2024-09-24-16,luau_script_no_globals_colidx,32.908628347333334,0.11577043469572552,32.853631709,32.300245,0.5985086666666667,32.830607375,33.041645958,30387
-0.135.0,2024-09-24-16,partition,2.6910777216666664,0.08134254580448368,2.683710458,1.0471736666666664,1.5704663333333333,2.613669416,2.775853291,371609
-0.135.0,2024-09-24-16,pseudo,1.749868542,0.014225692245463405,1.742604959,1.6951476666666665,0.051841,1.740741,1.766259667,571429
-0.135.0,2024-09-24-16,pseudo_formatstr,1.9699362636666669,0.01933357860842604,1.974440125,1.9101553333333332,0.056452,1.948748291,1.9866203750000002,507614
-0.135.0,2024-09-24-16,rename,1.0223717223333335,0.00132853788634319,1.022689459,0.9770796666666666,0.043116999999999996,1.020913125,1.023512583,978474
-0.135.0,2024-09-24-16,replace,2.2208249166666665,0.01846993240089755,2.227925875,2.173591,0.044233999999999996,2.199858333,2.234690542,450248
-0.135.0,2024-09-24-16,reverse,1.0730346803333333,0.0092353364340152,1.076827291,0.9547929999999999,0.11276966666666666,1.062506833,1.079769917,931966
-0.135.0,2024-09-24-16,reverse_index,6.212611430666667,0.020249710145143034,6.221831625,1.3274023333333334,4.874867333333333,6.189392417,6.22661025,160953
-0.135.0,2024-09-24-16,safenames,1.0288320416666668,0.007301467464161432,1.027015625,0.9827119999999999,0.04351766666666667,1.02261025,1.03687025,971817
-0.135.0,2024-09-24-16,sample_10,0.5373245556666667,0.006146533517872017,0.539554208,0.49454533333333334,0.039980666666666664,0.5303743750000001,0.5420450840000001,1862197
-0.135.0,2024-09-24-16,sample_1000,0.5382474306666668,0.007019726693921357,0.540284666,0.4948526666666666,0.04031033333333333,0.530434417,0.544023209,1858736
-0.135.0,2024-09-24-16,sample_100000,0.6926311803333333,0.017393950129422162,0.6905185420000001,0.6419503333333333,0.047856,0.676390041,0.7109849580000001,1443001
-0.135.0,2024-09-24-16,sample_100000_index,1.183129625,0.027482343506770583,1.170633,0.18858733333333333,0.9905156666666667,1.164116208,1.214639667,845309
-0.135.0,2024-09-24-16,sample_100000_seeded,0.6976854580000001,0.007627286306528944,0.6934967080000001,0.647064,0.04746999999999999,0.6930704160000001,0.7064892500000001,1432665
-0.135.0,2024-09-24-16,sample_100000_seeded_faster,0.7007501946666667,0.009656839819833469,0.703876542,0.6490819999999999,0.048329000000000004,0.6899175000000001,0.7084565420000001,1426534
-0.135.0,2024-09-24-16,sample_100000_seeded_index,1.1815479446666668,0.021342830279886673,1.187367542,0.18883399999999997,0.9894916666666665,1.157898917,1.199377375,846024
-0.135.0,2024-09-24-16,sample_100000_seeded_index_faster,1.1718582366666668,0.026610947115020527,1.159705834,0.18258200000000002,0.9856303333333333,1.153493042,1.202375834,853242
-0.135.0,2024-09-24-16,sample_100000_seeded_index_secure,1.1762253753333334,0.034821122653850185,1.162576167,0.18486533333333333,0.9872706666666665,1.150296584,1.2158033750000001,850340
-0.135.0,2024-09-24-16,sample_100000_seeded_secure,0.7022781386666668,0.002806519520520091,0.7018941660000001,0.6512106666666667,0.04800533333333334,0.699683375,0.705256875,1424501
-0.135.0,2024-09-24-16,sample_1000_index,0.03284229166666667,0.0009022042103234371,0.032380417,0.017162666666666663,0.013244,0.032264541,0.033881917000000004,30303030
-0.135.0,2024-09-24-16,sample_10_index,0.020079805333333332,0.0026556984030789974,0.018650541,0.015397333333333332,0.0025099999999999996,0.018444834,0.023144041,50000000
-0.135.0,2024-09-24-16,sample_25pct_index,2.9750148053333336,0.039682715233512765,2.9886605410000002,0.4587766666666666,2.5108603333333335,2.9303097080000002,3.006074167,336134
-0.135.0,2024-09-24-16,sample_25pct_seeded_index,2.929300958666667,0.016667684856128653,2.926092292,0.45078733333333326,2.474131666666666,2.914470875,2.947339709,341413
-0.135.0,2024-09-24-16,schema,8.195313541666666,0.0446462203828494,8.219507125,13.751384333333332,0.3872166666666666,8.143792292,8.222641208,122026
-0.135.0,2024-09-24-16,schema_index,0.12013554166666668,0.008694214500357247,0.12133300000000001,1.0265826666666664,0.06283733333333333,0.11090466700000001,0.128168958,8333333
-0.135.0,2024-09-24-16,search,0.6265067916666668,0.007650147927947007,0.6269241670000001,0.5816423333333334,0.04228166666666666,0.6186565,0.633939708,1594896
-0.135.0,2024-09-24-16,search_file,1.1424745836666668,0.004410180972715056,1.140925209,1.0975366666666666,0.04236499999999999,1.139048167,1.147450375,875657
-0.135.0,2024-09-24-16,search_file_case_sensitive,1.0551354586666666,0.013380968172748135,1.061939292,1.0095669999999999,0.042846666666666665,1.03971975,1.063747334,947867
-0.135.0,2024-09-24-16,search_file_case_sensitive_unicode,1.0535573473333333,0.0025878591646038974,1.054604084,1.008513,0.042692666666666663,1.050610083,1.055457875,948767
-0.135.0,2024-09-24-16,search_file_flag,1.352446694666667,0.006866526999651949,1.350410292,1.3065786666666666,0.043194333333333335,1.346828708,1.360101084,739645
-0.135.0,2024-09-24-16,search_file_flag_matchonly,0.865085611,0.001606240711946087,0.865100708,0.8207903333333334,0.04177466666666666,0.863471875,0.86668425,1156069
-0.135.0,2024-09-24-16,search_file_literal,0.971270611,0.007475221393073435,0.9687631250000001,0.9271039999999999,0.041806333333333334,0.9653715,0.979677208,1029866
-0.135.0,2024-09-24-16,search_file_unicode,1.1639032083333334,0.0028271832971763643,1.164281625,1.1180846666666664,0.043166333333333334,1.160905875,1.166522125,859107
-0.135.0,2024-09-24-16,search_unicode,0.6254133476666667,0.006438321057042762,0.6266624590000001,0.5813256666666666,0.041565,0.618442,0.631135584,1600000
-0.135.0,2024-09-24-16,searchset,1.2975941806666667,0.005470147761068308,1.299083,1.6017850000000002,0.09631633333333334,1.2915337500000001,1.302165792,770416
-0.135.0,2024-09-24-16,searchset_ignorecase,1.556388874666667,0.009854970109784755,1.553036041,1.8519333333333332,0.09590833333333333,1.548647791,1.567482792,642674
-0.135.0,2024-09-24-16,searchset_unicode,1.296759014,0.007013633688767448,1.298942917,1.600164666666667,0.09496533333333333,1.28891325,1.3024208750000001,771010
-0.135.0,2024-09-24-16,select,0.5093054026666667,0.00404490462352935,0.5078590000000001,0.46620966666666663,0.040752666666666666,0.506182542,0.513874666,1964637
-0.135.0,2024-09-24-16,select_regex,0.548204375,0.003994134017865046,0.546756208,0.504966,0.04085166666666667,0.5451363330000001,0.552720584,1824818
-0.135.0,2024-09-24-16,slice_last_1k,0.010606583000000001,0.000169965785201022,0.010644333,0.006411666666666666,0.0022793333333333333,0.010420916,0.0107545,90909091
-0.135.0,2024-09-24-16,slice_last_1k_index,0.007609944666666667,0.000055747023008707014,0.007592958,0.005165,0.0015609999999999999,0.007564667000000001,0.007672209,125000000
-0.135.0,2024-09-24-16,slice_last_1k_json,0.012858736333333334,0.00032299375177444715,0.012906875,0.008939,0.002187,0.012514375000000001,0.013154959,76923077
-0.135.0,2024-09-24-16,slice_last_1k_json_index,0.010644638666666666,0.00015579397958308104,0.010569208,0.008019,0.0017686666666666667,0.010540917,0.010823791000000001,90909091
-0.135.0,2024-09-24-16,slice_one_middle,0.26543452800000006,0.003765382528736338,0.26451687500000004,0.24240466666666668,0.020758333333333333,0.26221279200000003,0.269573917,3773585
-0.135.0,2024-09-24-16,slice_one_middle_index,0.008055680333333334,0.0003542027264848952,0.008111083,0.004650333333333334,0.0020806666666666664,0.007677041000000001,0.008378917000000001,125000000
-0.135.0,2024-09-24-16,snappy_compress,0.1642554856666667,0.011889780817104937,0.16231683300000002,1.184044,0.111804,0.153454166,0.17699545800000002,6097561
-0.135.0,2024-09-24-16,snappy_decompress,0.5102681533333334,0.005500153104407293,0.5076378340000001,0.48904499999999995,0.018954333333333333,0.506577042,0.516589584,1960784
-0.135.0,2024-09-24-16,snappy_validate,0.4934080836666667,0.0025609641932206524,0.49444341700000005,0.47320233333333334,0.017969333333333334,0.49049154200000006,0.49528929200000005,2028398
-0.135.0,2024-09-24-16,sort,1.362722180666667,0.015224198255254588,1.367705125,2.2367333333333335,0.13478166666666666,1.345630917,1.3748305,733676
-0.135.0,2024-09-24-16,sort_random_seeded,1.277235667,0.0220482709217895,1.274202042,1.152621,0.11864433333333334,1.256861292,1.3006436670000001,783085
-0.135.0,2024-09-24-16,sort_random_seeded_faster,1.2766626113333333,0.013032407405937125,1.275930084,1.1576186666666666,0.11349999999999999,1.264011917,1.290045833,783085
-0.135.0,2024-09-24-16,sort_random_seeded_secure,1.2543891943333332,0.026713117134247937,1.244067208,1.1390199999999997,0.110062,1.234377125,1.28472325,797448
-0.135.0,2024-09-24-16,sortcheck_sorted,0.5153332220000001,0.006185081540862334,0.514269416,0.4728136666666667,0.04011833333333333,0.509749042,0.521981208,1941748
-0.135.0,2024-09-24-16,sortcheck_unsorted,0.008389638666666666,0.0005737244630886276,0.008307833,0.004738333333333333,0.0019296666666666666,0.007861208,0.008999875000000001,125000000
-0.135.0,2024-09-24-16,sortcheck_unsorted_all,0.5501707916666668,0.005541494101793171,0.550404,0.5066083333333333,0.04098733333333333,0.544516375,0.5555920000000001,1818182
-0.135.0,2024-09-24-16,split,1.0493704996666666,0.007910423553617426,1.049418791,0.9026493333333333,0.115753,1.041436041,1.057256667,953289
-0.135.0,2024-09-24-16,split_chunks,1.120234292,0.030111930644881258,1.104892959,1.3082676666666666,0.16497799999999999,1.100882542,1.154927375,892857
-0.135.0,2024-09-24-16,split_chunks_index,0.18697277766666667,0.042858622505422356,0.17491662500000002,1.0691399999999998,0.20385699999999995,0.15143345800000002,0.23456825,5347594
-0.135.0,2024-09-24-16,split_chunks_index_j1,0.007465305666666667,0.0000796514095690299,0.00742775,0.004699333333333332,0.003094333333333333,0.007411375,0.0075567920000000005,142857143
-0.135.0,2024-09-24-16,split_index,0.23768683333333337,0.0725559356751515,0.27324037500000004,1.091119,0.199955,0.154211333,0.285608792,4201681
-0.135.0,2024-09-24-16,split_index_j1,1.2592708053333332,0.16255380151945975,1.183772458,0.9546813333333333,0.142186,1.148195458,1.4458445,794281
-0.135.0,2024-09-24-16,split_kbsize,2.2766981803333333,0.012927974824239937,2.269877791,2.1327936666666667,0.12341999999999999,2.268608625,2.2916081249999998,439174
-0.135.0,2024-09-24-16,sqlp,0.40779734700000003,0.007914565962686339,0.4053975,1.695825,0.174725,0.40136045800000003,0.41663408300000004,2450980
-0.135.0,2024-09-24-16,sqlp_aggregations,0.29816933333333334,0.009115512732610808,0.298473416,0.6971173333333333,0.07068100000000001,0.288905584,0.30712900000000004,3355705
-0.135.0,2024-09-24-16,sqlp_aggregations_expensive,0.16935347200000003,0.003527373938776974,0.16779433300000002,0.7539283333333332,0.08640199999999999,0.166874333,0.17339175,5917160
-0.135.0,2024-09-24-16,sqlp_aggregations_expensive_streaming,0.16805984733333335,0.004125716956913097,0.168813292,0.7404026666666667,0.08692166666666667,0.16360933300000002,0.171756917,5952381
-0.135.0,2024-09-24-16,sqlp_aggregations_expensive_vs_duckdb,0.220192611,0.006895560778436802,0.221206791,0.9563296666666665,0.11642399999999999,0.21284612500000002,0.22652491700000002,4545455
-0.135.0,2024-09-24-16,sqlp_aggregations_vs_duckdb,0.196525528,0.0035376552200915585,0.195820333,0.5983583333333332,0.10455166666666667,0.193393584,0.20036266700000002,5076142
-0.135.0,2024-09-24-16,sqlp_format_arrow,0.42199330533333335,0.004556207572483976,0.424045875,1.7110273333333332,0.17549099999999998,0.416771875,0.425162166,2369668
-0.135.0,2024-09-24-16,sqlp_format_avro,0.4102144026666667,0.005061229174795013,0.411516125,1.6861026666666665,0.166091,0.40462945800000005,0.41449762500000004,2439024
-0.135.0,2024-09-24-16,sqlp_format_json,0.4133611386666667,0.0030919226421735322,0.41396975,1.6944289999999997,0.166755,0.410010166,0.4161035,2421308
-0.135.0,2024-09-24-16,sqlp_format_jsonl,0.4222604446666667,0.0051319637476978965,0.42457575000000003,1.6993219999999998,0.17043533333333336,0.41637875,0.42582683400000004,2369668
-0.135.0,2024-09-24-16,sqlp_format_parquet,0.4298057916666667,0.006353062689149565,0.42835225000000005,1.7149919999999998,0.18642499999999998,0.42430545900000005,0.43675966600000005,2325581
-0.135.0,2024-09-24-16,sqlp_format_parquet_statistics,0.43114048600000004,0.007458680589017788,0.428229917,1.7372453333333333,0.18690700000000002,0.42557591600000005,0.439615625,2320186
-0.135.0,2024-09-24-16,sqlp_lowmemory,0.417616889,0.014694293519993164,0.418098417,1.7124036666666667,0.18015599999999998,0.40268775,0.4320645,2392344
-0.135.0,2024-09-24-16,sqlp_nooptimizations,0.6870286663333335,0.025997633800272996,0.677023083,1.9372059999999998,0.24553666666666665,0.667520375,0.716542541,1455604
-0.135.0,2024-09-24-16,sqlp_tryparsedates,11.698556333333334,0.06224271897816058,11.698906792,12.959810666666664,0.19394,11.636139125,11.760623083,85477
-0.135.0,2024-09-24-16,sqlp_tryparsedates_inferlen,1.3534028196666668,0.012706432993371718,1.3581646250000001,2.6290549999999997,0.19035133333333332,1.3390032920000001,1.363040542,739098
-0.135.0,2024-09-24-16,stats,1.9629378336666667,0.010769082619319158,1.967885834,2.2633656666666666,0.09611233333333331,1.950584,1.970343667,509424
-0.135.0,2024-09-24-16,stats_create_cache,1.9676440283333336,0.014059063612788077,1.968494667,2.2679753333333337,0.09736033333333334,1.9531789590000002,1.9812584590000002,508130
-0.135.0,2024-09-24-16,stats_everything,3.4835596803333337,0.022140485521481172,3.489869833,10.353195999999999,0.418762,3.458949125,3.501860083,287026
-0.135.0,2024-09-24-16,stats_everything_create_cache,3.483698680333333,0.02350966111101831,3.483431333,10.355561333333332,0.40347399999999994,3.460323833,3.507340875,287026
-0.135.0,2024-09-24-16,stats_everything_index,1.3361272086666667,0.010267401393492725,1.336258584,10.954704333333332,0.599267,1.32579475,1.346328292,748503
-0.135.0,2024-09-24-16,stats_everything_index_j1,6.854695902666666,0.2124807669045681,6.785950959,6.773230666666667,0.22746233333333332,6.685098583,7.093038166,145879
-0.135.0,2024-09-24-16,stats_everything_index_j1_with_cache,0.006949500333333334,0.0001236906413207295,0.006941584000000001,0.004315333333333333,0.0016300000000000002,0.0068299580000000006,0.007076959000000001,142857143
-0.135.0,2024-09-24-16,stats_everything_index_with_cache,0.006755764,0.000029931225183744385,0.0067475,0.0042829999999999995,0.0015563333333333332,0.006730833,0.006788959000000001,142857143
-0.135.0,2024-09-24-16,stats_everything_infer_dates,7.544474764,0.06610571676363132,7.539719792,14.65186433333333,0.43718199999999996,7.480874917,7.612829583,132556
-0.135.0,2024-09-24-16,stats_everything_infer_dates_index,1.9712553890000002,0.01578180308960967,1.974954,17.493133666666665,0.6190006666666666,1.95395275,1.984859417,507357
-0.135.0,2024-09-24-16,stats_everything_infer_dates_index_with_cache,0.009453278,0.0003059174776242768,0.009464208,0.005007333333333333,0.0025029999999999996,0.009142042000000001,0.009753584000000001,111111111
-0.135.0,2024-09-24-16,stats_everything_j1,6.932226486333334,0.2191861854228798,6.9921535,7.092407666666666,0.301378,6.689309584,7.115216375,144259
-0.135.0,2024-09-24-16,stats_everything_sorted,3.4060757083333333,0.019469531742491518,3.399919291,9.889667333333334,0.41274000000000005,3.390428625,3.427879209,293600
-0.135.0,2024-09-24-16,stats_everything_sorted_index,3.360670514,0.012779792428819386,3.366128125,9.836019333333335,0.39137433333333327,3.346068042,3.369815375,297530
-0.135.0,2024-09-24-16,stats_index,0.22936890266666668,0.0032174864896102368,0.227900125,2.309188,0.062957,0.227147917,0.23305866600000003,4366812
-0.135.0,2024-09-24-16,stats_index_j1,1.9043955553333334,0.002462638986340865,1.905520583,1.861112333333333,0.040918666666666666,1.9015713330000001,1.90609475,525210
-0.135.0,2024-09-24-16,stats_index_j1_with_cache,0.008856083333333334,0.00018000264550648503,0.00888825,0.0048,0.0022749999999999997,0.008662166,0.009017834,111111111
-0.135.0,2024-09-24-16,stats_index_with_cache,0.006949653,0.000141000668306927,0.006932875000000001,0.004216333333333333,0.0017366666666666665,0.0068177920000000005,0.007098292000000001,142857143
-0.135.0,2024-09-24-16,table,7.138138583333333,0.09404506235263703,7.18907575,5.9659043333333335,1.157986,7.029612625,7.195727375,140095
-0.135.0,2024-09-24-16,to_datapackage,0.7272858193333335,0.008316194758123806,0.7270111250000001,2.0777063333333334,0.2936213333333333,0.7191103750000001,0.735735958,1375516
-0.135.0,2024-09-24-16,to_sqlite,0.7271016666666666,0.01313184003378861,0.723635584,2.0855226666666664,0.2876823333333333,0.7160505410000001,0.741618875,1375516
-0.135.0,2024-09-24-16,to_xlsx,33.010126431,0.4606242418609583,32.940378042,30.806671333333338,3.463896333333333,32.588354084,33.501647167,30294
-0.135.0,2024-09-24-16,tojsonl,5.775423750000001,0.18043726685672368,5.7205741670000005,10.299069000000001,0.3912633333333333,5.628776,5.976921083,173160
-0.135.0,2024-09-24-16,tojsonl_batchall,5.769866222333334,0.04195440338697841,5.788551958,10.241785666666667,0.7365626666666666,5.721815417,5.799231292,173310
-0.135.0,2024-09-24-16,tojsonl_index,2.7748353886666663,0.1548881581347862,2.750104541,11.273431666666667,0.4748323333333333,2.633800583,2.940601042,360360
-0.135.0,2024-09-24-16,tojsonl_index_j1,8.915929097333333,0.04805372391867694,8.901217,8.700922666666665,0.20682966666666666,8.876951292,8.969619,112158
-0.135.0,2024-09-24-16,tojsonl_j1,8.904643583,0.21566559037967215,8.905772333,9.051070666666666,0.24466033333333334,8.688415833,9.119742583,112296
-0.135.0,2024-09-24-16,tojsonl_trim,5.712293930666667,0.17084569721042805,5.783862167,11.277515,0.3860696666666667,5.517303208,5.835716417,175070
-0.135.0,2024-09-24-16,tojsonl_trim_j1,9.752734736333334,0.0990284076154165,9.7563365,9.877368333333333,0.2611596666666667,9.651954584,9.849913125,102533
-0.135.0,2024-09-24-16,transpose,2.7220254166666664,0.004692695556098049,2.723108375,2.498336333333333,0.218445,2.716885917,2.726081958,367377
-0.135.0,2024-09-24-16,transpose_multipass,22.24792134733333,0.07624247920462365,22.22850475,20.51791133333333,1.7154086666666666,22.183264584,22.331994708,44948
-0.135.0,2024-09-24-16,validate,1.30840425,0.018368396880890668,1.297992333,5.896503,0.12280266666666667,1.297607334,1.329613083,764526
-0.135.0,2024-09-24-16,validate_batchall,1.4328333333333336,0.013285487941556798,1.4311021670000001,6.364915,0.2067393333333333,1.420498292,1.446899541,697837
-0.135.0,2024-09-24-16,validate_batchall_index,1.3639913746666668,0.008800722736897913,1.3681779170000001,5.896708666666666,0.14448799999999998,1.353878916,1.3699172910000001,733138
-0.135.0,2024-09-24-16,validate_dynenum,1.3199649583333333,0.01111617185067419,1.318487958,5.849461666666667,0.12200733333333331,1.309661125,1.331745792,757576
-0.135.0,2024-09-24-16,validate_dynenum_batchall,1.434016153,0.023234078165057275,1.4231925840000001,6.246928333333333,0.20278133333333334,1.418168583,1.460687292,697350
-0.135.0,2024-09-24-16,validate_dynenum_batchall_index,1.4026368336666668,0.030722734813760044,1.416122083,5.8318303333333334,0.15353833333333333,1.367477709,1.424310709,712758
-0.135.0,2024-09-24-16,validate_dynenum_index,1.321816389,0.010077301850209695,1.322062834,5.814260999999999,0.12134333333333332,1.311618125,1.331768208,756430
-0.135.0,2024-09-24-16,validate_dynenum_no_schema,1.3120186526666666,0.01575150808263098,1.320337958,5.820349,0.12308599999999999,1.293851792,1.321866208,762195
-0.135.0,2024-09-24-16,validate_dynenum_no_schema_index,1.3247700556666666,0.0077531056202698664,1.321226083,5.848779333333333,0.12089299999999999,1.319422292,1.333661792,754717
-0.135.0,2024-09-24-16,validate_dynenum_valid_output,2.259092778,0.008015024867107645,2.26258425,6.730052999999999,0.16668166666666664,2.24992425,2.264769834,442674
-0.135.0,2024-09-24-16,validate_dynenum_valid_output_index,2.2693469443333334,0.006661843234879,2.267653208,6.716018666666666,0.16425366666666666,2.263695459,2.276692166,440723
-0.135.0,2024-09-24-16,validate_index,1.3136580136666665,0.019416467389326893,1.304472958,5.853186333333333,0.11544333333333333,1.30053825,1.335962833,761035
-0.135.0,2024-09-24-16,validate_no_schema,0.5053290003333334,0.005870027604212966,0.503334042,0.4628716666666666,0.040303,0.5007164590000001,0.5119365,1980198
-0.135.0,2024-09-24-16,validate_no_schema_index,0.506884445,0.003765036220305587,0.5082592920000001,0.4649016666666666,0.039390666666666664,0.5026252090000001,0.5097688340000001,1972387
-0.135.0,2024-09-24-16,validate_valid_output,2.300180403,0.041454423239157906,2.281425958,6.857328,0.16683633333333334,2.2714174590000002,2.347697792,434783
-0.135.0,2024-09-24-16,validate_valid_output_index,2.2879162083333333,0.0226879417720758,2.297488083,6.789280333333333,0.16257466666666665,2.262010917,2.304249625,437063
+0.136.0,2024-10-09-22,apply_calcconv,1.7050352779999998,0.019588303727766737,1.706148542,3.551023666666667,0.20906266666666665,1.684914083,1.724043209,586510
+0.136.0,2024-10-09-22,apply_dynfmt,1.9835509580000001,0.01520292475588627,1.991420625,6.893937666666666,0.23447933333333335,1.966026416,1.9932058330000002,504032
+0.136.0,2024-10-09-22,apply_emptyreplace,1.5998238196666668,0.015927380642159632,1.592549459,2.684836333333333,0.22189199999999998,1.588832459,1.618089541,625000
+0.136.0,2024-10-09-22,apply_op_eudex,1.5777951106666668,0.007463856328587575,1.578263333,2.1339263333333336,0.25768166666666664,1.570108166,1.585013833,633714
+0.136.0,2024-10-09-22,apply_op_sentiment,3.9648692776666663,0.38017112229641026,3.760939625,24.910353999999998,0.294889,3.730174625,4.403493583,252207
+0.136.0,2024-10-09-22,apply_op_similarity,1.6037357640000003,0.011346707375146987,1.600556,2.227638333333333,0.2090173333333333,1.594318167,1.6163331250000001,623441
+0.136.0,2024-10-09-22,apply_op_similarity_batchall,1.4988207913333333,0.018303877114343062,1.492236125,1.7975236666666665,0.173787,1.4847202080000002,1.519506041,667111
+0.136.0,2024-10-09-22,apply_op_string,1.5737780416666667,0.016098774120262248,1.568187583,2.680716,0.19417966666666664,1.56121975,1.5919267920000002,635324
+0.136.0,2024-10-09-22,behead,0.8816215836666667,0.0029518552016063676,0.880686084,0.8362063333333333,0.04412866666666667,0.879250834,0.8849278330000001,1133787
+0.136.0,2024-10-09-22,behead_flexible,0.8807327083333334,0.0007861678845566681,0.8803495,0.8331896666666667,0.04612466666666667,0.880211625,0.881637,1135074
+0.136.0,2024-10-09-22,cat_columns,2.844363097,0.004815946161097188,2.846609875,2.747449,0.09545666666666665,2.8388343330000003,2.847645083,351617
+0.136.0,2024-10-09-22,cat_rows,1.733864903,0.01796410766456159,1.739907917,1.6407429999999998,0.09199366666666668,1.7136585000000002,1.748028292,576701
+0.136.0,2024-10-09-22,cat_rows_flexible,1.7142814723333337,0.005350188438718356,1.7144205000000001,1.6214606666666667,0.09174066666666665,1.7088631250000001,1.719560792,583431
+0.136.0,2024-10-09-22,cat_rowskey,3.1547543889999994,0.025507955662027824,3.144587958,3.05395,0.09971533333333334,3.135897292,3.183777917,316957
+0.136.0,2024-10-09-22,count,0.07404358300000001,0.0033655614659618086,0.074128917,0.4266313333333333,0.052357999999999995,0.070636166,0.077365666,13513514
+0.136.0,2024-10-09-22,count_flexible,0.462141944,0.0017590328841335147,0.462686458,0.417162,0.04387433333333333,0.460175041,0.46356433300000005,2164502
+0.136.0,2024-10-09-22,count_index,0.007620777666666666,0.000044225044650439403,0.007597292,0.0047279999999999996,0.0022673333333333334,0.00759325,0.007671791000000001,125000000
+0.136.0,2024-10-09-22,count_no_polars,0.46205180533333334,0.003785031735211785,0.460538875,0.4169433333333334,0.044038,0.45925725,0.466359291,2164502
+0.136.0,2024-10-09-22,count_polars_lowmem,0.057583291666666675,0.004786411221385849,0.056398750000000004,0.42018833333333333,0.053239,0.053500375,0.06285075000000001,17241379
+0.136.0,2024-10-09-22,count_width,0.4694743473333334,0.0008699056995136294,0.46932366700000006,0.4387203333333333,0.051019333333333326,0.46868962500000005,0.47040975,2132196
+0.136.0,2024-10-09-22,count_width_index,0.47969713900000005,0.0014514370775266074,0.479283334,0.4478786666666667,0.052171666666666665,0.478497541,0.481310542,2083333
+0.136.0,2024-10-09-22,datefmt,1.774153125,0.0035590442597932476,1.774050667,4.817035999999999,0.18269099999999996,1.770646416,1.777762292,563698
+0.136.0,2024-10-09-22,datefmt_formatstr_newcol,1.696654791666667,0.0033475541032160095,1.6982641250000001,4.038033333333334,0.18209666666666666,1.6928065,1.69889375,589275
+0.136.0,2024-10-09-22,datefmt_multi,2.127302097333333,0.004210234557934205,2.129608458,8.931267,0.183364,2.122442625,2.129855209,470146
+0.136.0,2024-10-09-22,datefmt_multi_batchall,2.076182375,0.00452843165628292,2.0749605,8.506684666666667,0.16247333333333333,2.07239025,2.081196375,481696
+0.136.0,2024-10-09-22,datefmt_multi_select,2.3498884996666667,0.010352363040544177,2.349666833,11.608551999999998,0.19084,2.33964875,2.360349916,425532
+0.136.0,2024-10-09-22,dedup,1.2833504163333334,0.006031065668196462,1.285843375,2.0846046666666664,0.13363299999999997,1.276472541,1.287735333,779423
+0.136.0,2024-10-09-22,dedup_sorted,0.988590222,0.0025965061259993253,0.9875626660000001,0.9281836666666666,0.106696,0.9866647500000001,0.9915432500000001,1011122
+0.136.0,2024-10-09-22,diff,2.644915194333333,0.02362920456233022,2.636728375,4.132400666666666,0.1896433333333333,2.626468167,2.671549041,378072
+0.136.0,2024-10-09-22,enum,0.8937754166666667,0.004067882760879962,0.891814875,0.845328,0.047180666666666655,0.891059084,0.898452291,1118568
+0.136.0,2024-10-09-22,enum_constant,0.8840505833333334,0.008684506612208931,0.8846767080000001,0.8348966666666665,0.048019,0.8750699590000001,0.8924050830000001,1131222
+0.136.0,2024-10-09-22,enum_copy,0.893037556,0.01224491038664033,0.890319084,0.8450743333333334,0.04683933333333334,0.882380334,0.9064132500000001,1119821
+0.136.0,2024-10-09-22,enum_hash,1.5074435973333333,0.0061144736970913036,1.5084482920000002,1.4567166666666667,0.04959233333333333,1.500889,1.5129934999999999,663570
+0.136.0,2024-10-09-22,enum_uuid,1.6966366806666666,0.0021752266734352942,1.697039709,0.9602846666666666,0.7351523333333333,1.694288125,1.698582208,589275
+0.136.0,2024-10-09-22,enum_uuid7,1.7300057640000002,0.002183014410172075,1.730594666,0.9914836666666665,0.7373496666666667,1.727588709,1.731833917,578035
+0.136.0,2024-10-09-22,excel,12.393773708333333,0.025221651975008946,12.379599833,12.269890333333331,0.921428,12.378827542,12.42289375,80684
+0.136.0,2024-10-09-22,excel_error_format_formula,21.884125819666668,0.00715533626895283,21.885303042,21.684978333333333,1.0060536666666666,21.876454875,21.890619542,45695
+0.136.0,2024-10-09-22,excel_j1,12.915160528000001,0.04663747179989207,12.901054709,12.124392666666667,0.7840539999999999,12.877204292,12.967222583,77429
+0.136.0,2024-10-09-22,excel_metadata,12.197152514,0.05778919332351246,12.222285042,11.175934333333332,1.0180623333333332,12.131052542,12.238119958,81987
+0.136.0,2024-10-09-22,excel_metadata_short,0.949276556,0.005821559078994813,0.9460756250000001,0.31018933333333326,0.6379016666666666,0.945757834,0.955996209,1053741
+0.136.0,2024-10-09-22,excel_trim,12.549495555666667,0.03768325174515143,12.528584125,13.758439333333333,0.8868153333333333,12.526904917,12.592997625,79688
+0.136.0,2024-10-09-22,excel_trim_j1,14.098593306,0.030775290509148033,14.111557792,13.282066333333333,0.8124296666666666,14.063456917,14.120765209,70927
+0.136.0,2024-10-09-22,exclude,0.5592902643333334,0.000774786047916678,0.559157667,0.5167163333333332,0.041481333333333335,0.558590334,0.560122792,1788909
+0.136.0,2024-10-09-22,exclude_casei,0.5643613056666666,0.0031860825198504364,0.565165125,0.5201456666666666,0.04312633333333333,0.560850292,0.5670685000000001,1773050
+0.136.0,2024-10-09-22,exclude_casei_index,0.5783586943333333,0.003891602650041549,0.577528708,0.533566,0.043393666666666664,0.5749490420000001,0.5825983330000001,1730104
+0.136.0,2024-10-09-22,exclude_index,0.5735247776666667,0.000401239904309557,0.573679083,0.529978,0.04223166666666667,0.573069292,0.573825958,1742160
+0.136.0,2024-10-09-22,exclude_multi,0.8818913613333333,0.010612203719753337,0.877010917,0.8407443333333333,0.04008899999999999,0.874597375,0.894065792,1133787
+0.136.0,2024-10-09-22,exclude_multi_casei,0.889859625,0.007512512836473645,0.8877661250000001,0.849367,0.039474666666666665,0.883615916,0.898196834,1123596
+0.136.0,2024-10-09-22,exclude_multi_casei_index,0.9129257776666667,0.0040803320905515895,0.912865667,0.867269,0.04425866666666667,0.9088758330000001,0.917035833,1095290
+0.136.0,2024-10-09-22,exclude_multi_index,0.9042534306666669,0.0024943746574162032,0.9048569580000001,0.858998,0.043971333333333334,0.9015126670000001,0.906390667,1106195
+0.136.0,2024-10-09-22,explode,1.5868397643333332,0.012723681110287766,1.593969042,1.54249,0.043229333333333335,1.5721498340000002,1.5944004170000001,630120
+0.136.0,2024-10-09-22,extdedup,1.055031389,0.01862670088469005,1.04563,0.9730626666666665,0.07952733333333334,1.042979042,1.076485125,947867
+0.136.0,2024-10-09-22,extsort,0.7629452496666668,0.01000641117909401,0.757770833,1.2839026666666664,0.2641253333333333,0.7565855410000001,0.7744793750000001,1310616
+0.136.0,2024-10-09-22,fill,2.0876410416666666,0.017161149403491567,2.096520375,2.0344270000000004,0.05202266666666666,2.0678595,2.09854325,478927
+0.136.0,2024-10-09-22,fixlengths,1.3367088053333334,0.0037192935909075913,1.336161416,1.2477593333333334,0.08782333333333332,1.333293541,1.340671459,747943
+0.136.0,2024-10-09-22,flatten,5.603500527666665,0.021892915561610844,5.603754292,5.533522333333333,0.06872466666666666,5.581481833,5.625265458,178444
+0.136.0,2024-10-09-22,flatten_condensed,5.987705097,0.014473185810507367,5.995395666,5.915737333333333,0.07072133333333332,5.971010125,5.9967095,167001
+0.136.0,2024-10-09-22,fmt,1.002943764,0.015636441586786093,1.011603417,0.9553783333333333,0.046455666666666666,0.9848932920000001,1.012334583,997009
+0.136.0,2024-10-09-22,fmt_no_crlf,0.9969341666666667,0.010619823384458773,0.9984205420000001,0.9479203333333333,0.047823,0.985649458,1.0067325,1003009
+0.136.0,2024-10-09-22,fmt_no_final_newline,1.0060015279999999,0.002756928572519994,1.007205584,0.9571203333333332,0.04771533333333333,1.002847375,1.007951625,994036
+0.136.0,2024-10-09-22,foreach,0.007608791333333334,0.00019723007370158691,0.0076508750000000006,0.0046619999999999995,0.002355,0.007393916,0.007781583000000001,125000000
+0.136.0,2024-10-09-22,frequency,2.8425398056666666,0.015544831875395617,2.847457958,3.763486333333333,0.15672966666666666,2.825130792,2.8550306670000003,351741
+0.136.0,2024-10-09-22,frequency_ignorecase,3.5406878470000005,0.01270137750083542,3.54438075,4.4127849999999995,0.15055033333333334,3.52654925,3.551133541,282406
+0.136.0,2024-10-09-22,frequency_ignorecase_index,1.1237090693333334,0.05675912448248234,1.151073708,5.658496333333333,0.26584800000000003,1.05845175,1.16160175,889680
+0.136.0,2024-10-09-22,frequency_index,1.0480152363333333,0.05581236833496712,1.06061575,4.836763333333333,0.27762166666666666,0.9869797920000001,1.096450167,954198
+0.136.0,2024-10-09-22,frequency_index_stats_mode_auto,1.0070706113333332,0.008835466506475256,1.010171625,4.776612666666666,0.28615066666666666,0.997102667,1.013937542,993049
+0.136.0,2024-10-09-22,frequency_index_stats_mode_force,1.001722,0.017089296086828448,1.000352042,4.752778999999999,0.2881666666666666,0.985358916,1.019455042,998004
+0.136.0,2024-10-09-22,frequency_index_stats_mode_none,1.1178535139999999,0.008691833816215843,1.11994925,5.200261,0.2872523333333333,1.108305417,1.125305875,894454
+0.136.0,2024-10-09-22,frequency_j1,3.3876877083333334,0.029824394521667963,3.371393833,3.2935416666666666,0.09082966666666666,3.369559625,3.422109667,295159
+0.136.0,2024-10-09-22,frequency_j1_ignorecase,4.097180166666667,0.04444788013603125,4.074708084,3.998699333333333,0.09522966666666666,4.068455375,4.148377041,244081
+0.136.0,2024-10-09-22,frequency_limit20,2.8631531113333337,0.01734257567212987,2.860227167,3.7674983333333336,0.156258,2.847459625,2.881772542,349284
+0.136.0,2024-10-09-22,frequency_limit20_index,1.0633833053333335,0.05690465310295847,1.081311333,4.816441333333334,0.2702363333333333,0.9996737080000001,1.109164875,940734
+0.136.0,2024-10-09-22,frequency_no_limit,4.727112305666668,0.061715317730259046,4.698074208,5.593491,0.180478,4.685272042,4.7979906670000005,211551
+0.136.0,2024-10-09-22,frequency_no_limit_index,2.6022785136666666,0.08396557520664231,2.557269,6.371206666666666,0.30891966666666665,2.55041375,2.699152791,384320
+0.136.0,2024-10-09-22,frequency_notrim,2.4027974446666667,0.008777820223043718,2.398003917,3.2956936666666667,0.15378166666666665,2.397460083,2.412928334,416146
+0.136.0,2024-10-09-22,frequency_notrim_index,0.9821368890000001,0.04746079884980989,0.959449583,4.254895333333334,0.2751093333333333,0.950277625,1.036683459,1018330
+0.136.0,2024-10-09-22,frequency_other_sorted,2.8385583476666665,0.009154976898636062,2.842162375,3.706337,0.15396933333333332,2.828149834,2.845362834,352237
+0.136.0,2024-10-09-22,frequency_other_sorted_index,1.0439775693333333,0.04408596032803923,1.0570245,4.785868333333333,0.278931,0.9948406660000001,1.080067542,957854
+0.136.0,2024-10-09-22,frequency_selregex,0.8031119166666666,0.005922772057214628,0.8064003750000001,0.8800663333333333,0.05293966666666666,0.796274542,0.806660833,1245330
+0.136.0,2024-10-09-22,frequency_selregex_ignorecase,1.0019362636666667,0.003958131683469569,1.000608625,1.0783873333333334,0.05544966666666667,0.998812625,1.006387541,998004
+0.136.0,2024-10-09-22,frequency_sorted,2.670419513666667,0.020978018705839457,2.672767083,3.504291,0.16317866666666667,2.648366458,2.690125,374532
+0.136.0,2024-10-09-22,frequency_sorted_index,2.759115,0.006533081122469273,2.758656042,3.5680853333333338,0.14549066666666666,2.7528235,2.765865458,362450
+0.136.0,2024-10-09-22,geocode_reverse,3.635352513666667,0.02168954742554722,3.638010625,2.964048333333333,10.649058666666667,3.612456416,3.6555905,275103
+0.136.0,2024-10-09-22,geocode_reverse_batchall,3.705906264,0.0007124361086981811,3.706016417,3.307206666666666,10.218860333333334,3.705145167,3.706557208,269833
+0.136.0,2024-10-09-22,geocode_suggest,4.424326458333333,0.01332076052122252,4.41954975,21.383587000000002,2.6517473333333332,4.414052666,4.439376959,226040
+0.136.0,2024-10-09-22,geocode_suggest_batchall,4.436151958,0.011998674399309246,4.440844291,22.09025433333333,1.42405,4.422516208,4.445095375,225428
+0.136.0,2024-10-09-22,index,0.47402747233333337,0.00010761350663523526,0.474064792,0.4296609999999999,0.04324733333333333,0.47390616700000004,0.47411145800000004,2109705
+0.136.0,2024-10-09-22,input,1.6518609443333334,0.005086299425495461,1.6505388330000001,1.5999656666666666,0.05077399999999999,1.6475662500000001,1.65747775,605327
+0.136.0,2024-10-09-22,join,1.8915908750000001,0.001276399396811533,1.8912137910000002,1.351193,0.5393533333333332,1.8905455,1.893013334,528541
+0.136.0,2024-10-09-22,join_casei,1.8990923469999998,0.005914988734221181,1.899654833,1.35911,0.5389416666666667,1.892916208,1.904706,526593
+0.136.0,2024-10-09-22,joinp,0.791479514,0.001933987035821872,0.790972792,1.4077596666666665,0.08986899999999999,0.789849333,0.7936164170000001,1264223
+0.136.0,2024-10-09-22,joinp_streaming,0.025671264000000003,0.00013254458292589571,0.025618625000000003,0.034173,0.010442333333333333,0.025573125000000002,0.025822042,38461538
+0.136.0,2024-10-09-22,json,18.515705639,0.053356714059158934,18.505266583,16.98018433333333,1.5260143333333331,18.468339917,18.573510417,54007
+0.136.0,2024-10-09-22,jsonl,1.4464047779999998,0.0027990031779148127,1.445855125,7.01248,0.19835666666666665,1.443921375,1.449437834,691563
+0.136.0,2024-10-09-22,jsonl_batchall,0.007816459,0.0001457840333335582,0.007748334000000001,0.004854,0.0023936666666666663,0.007717209,0.007983834,125000000
+0.136.0,2024-10-09-22,jsonl_j1,5.819719833333333,0.011475245824118704,5.819589125,5.685633,0.13232933333333333,5.8083105,5.831259875,171821
+0.136.0,2024-10-09-22,luau_filter,7.428935666666667,0.009451951106225287,7.424287958,6.889022999999999,0.5387573333333333,7.422707417,7.439811625,134608
+0.136.0,2024-10-09-22,luau_filter_colidx,9.097977945,0.0250814889252206,9.091565834,8.539466666666666,0.5573443333333333,9.076724959,9.125643042,109914
+0.136.0,2024-10-09-22,luau_filter_no_globals,4.837267319666666,0.006909354815523144,4.840564667,4.306157333333333,0.5299393333333332,4.829327,4.841910292,206740
+0.136.0,2024-10-09-22,luau_filter_no_globals_colidx,6.395455472666666,0.018600087946171094,6.404931084,5.861872000000001,0.5323926666666666,6.374025667,6.407409667,156372
+0.136.0,2024-10-09-22,luau_filter_no_globals_colidx,6.387959667,0.010597093263644972,6.393553959,5.850938333333333,0.535815,6.37573775,6.394587292,156544
+0.136.0,2024-10-09-22,luau_filter_no_globals_no_colidx,4.827248333333333,0.010409160348532303,4.8219105,4.298935666666666,0.5270643333333334,4.820590875,4.839243625,207168
+0.136.0,2024-10-09-22,luau_multi,23.364569847333332,0.06760305298498792,23.363684875,22.726609666666665,0.6363066666666666,23.297413625,23.432611042,42799
+0.136.0,2024-10-09-22,luau_multi_colidx,24.95775619433333,0.026643842878957484,24.947410541,24.30202733333333,0.6541143333333334,24.937836792,24.98802125,40067
+0.136.0,2024-10-09-22,luau_multi_no_globals,20.82279369433333,0.2973751150338541,20.659224458,20.181841666666667,0.6393093333333333,20.643109791,21.166046834,48024
+0.136.0,2024-10-09-22,luau_multi_no_globals_colidx,22.24774802766667,0.07362856474543945,22.240344875,21.590948666666666,0.655243,22.178100708,22.3247985,44948
+0.136.0,2024-10-09-22,luau_script,33.837904138999995,0.050418620727490406,33.840241834,33.180931333333334,0.6551846666666666,33.786357333,33.88711325,29553
+0.136.0,2024-10-09-22,luau_script_colidx,35.36256690233333,0.042258863655929034,35.379295666,34.698109666666674,0.6626286666666666,35.314504625,35.393900416,28278
+0.136.0,2024-10-09-22,luau_script_no_globals,31.057191791666668,0.03675492282724094,31.065451625,30.40201233333333,0.6533836666666666,31.01700975,31.089114,32199
+0.136.0,2024-10-09-22,luau_script_no_globals_colidx,32.38958259733334,0.1005595308660732,32.3332995,31.733821666666667,0.6539403333333333,32.329767458,32.505680834,30874
+0.136.0,2024-10-09-22,partition,2.3267367083333332,0.01474690479917634,2.3239864580000003,0.9367673333333334,1.3608143333333331,2.313558542,2.342665125,429738
+0.136.0,2024-10-09-22,pseudo,1.7149044583333335,0.0013415217707730286,1.7146115000000002,1.6574523333333333,0.055862333333333326,1.7137336250000001,1.71636825,583090
+0.136.0,2024-10-09-22,pseudo_formatstr,1.9270131106666668,0.010054385149304729,1.9285091250000002,1.8668756666666664,0.058633333333333336,1.916294541,1.936235666,518941
+0.136.0,2024-10-09-22,rename,0.9871046526666668,0.0006993774664674101,0.986705166,0.9393923333333333,0.0466,0.9866965830000001,0.9879122090000001,1013171
+0.136.0,2024-10-09-22,replace,2.0904712636666667,0.005182647935350693,2.0914495,2.038176333333333,0.051205333333333325,2.084869208,2.095095083,478469
+0.136.0,2024-10-09-22,reverse,0.9752164030000001,0.003911500340501181,0.974709959,0.8659096666666667,0.10359199999999998,0.9715827920000001,0.979356458,1025641
+0.136.0,2024-10-09-22,reverse_index,6.117939041333334,0.029647164872719674,6.102424291,1.2457633333333333,4.859567999999999,6.099268708,6.152124125,163452
+0.136.0,2024-10-09-22,safenames,0.9873110416666667,0.0017477939056016701,0.9865907500000001,0.9395263333333334,0.04666033333333333,0.9860385,0.989303875,1013171
+0.136.0,2024-10-09-22,sample_10,0.5176511113333334,0.0026381009682744073,0.5161513750000001,0.4723566666666666,0.044233999999999996,0.51610475,0.520697209,1930502
+0.136.0,2024-10-09-22,sample_1000,0.5139957086666668,0.0013784006206823084,0.513462834,0.47076999999999997,0.042213,0.512963292,0.515561,1945525
+0.136.0,2024-10-09-22,sample_100000,0.6506862360000002,0.004323453892143529,0.6495751670000001,0.6026693333333334,0.046593666666666665,0.6470267500000001,0.6554567910000001,1536098
+0.136.0,2024-10-09-22,sample_100000_index,1.1417670003333333,0.002279856408883079,1.143076959,0.18067633333333333,0.9598353333333334,1.139134459,1.143089583,875657
+0.136.0,2024-10-09-22,sample_100000_seeded,0.6475213336666666,0.0007607925677195599,0.6478826670000001,0.5994356666666666,0.046645,0.6466472090000001,0.648034125,1543210
+0.136.0,2024-10-09-22,sample_100000_seeded_faster,0.6370564166666667,0.00255118044164526,0.63679675,0.5895136666666666,0.04610966666666666,0.634645,0.6397275,1569859
+0.136.0,2024-10-09-22,sample_100000_seeded_index,1.1341891393333334,0.008487503092167076,1.132666459,0.178262,0.9546233333333333,1.126566042,1.143334917,881834
+0.136.0,2024-10-09-22,sample_100000_seeded_index_faster,1.11916925,0.004465985590402288,1.117995834,0.17152766666666666,0.946349,1.115407125,1.124104791,893655
+0.136.0,2024-10-09-22,sample_100000_seeded_index_secure,1.129794125,0.013567921456163637,1.125208125,0.17367066666666664,0.9544003333333334,1.1191135,1.14506075,884956
+0.136.0,2024-10-09-22,sample_100000_seeded_secure,0.6438970140000001,0.005995088218259433,0.64145975,0.596007,0.04657666666666666,0.639504417,0.650726875,1552795
+0.136.0,2024-10-09-22,sample_1000_index,0.03282537466666667,0.00026952162709573834,0.03287625,0.017051,0.014543333333333333,0.032534041,0.033065833,30303030
+0.136.0,2024-10-09-22,sample_10_index,0.019179167,0.00016445632517176142,0.019233167000000002,0.015091666666666665,0.003276,0.0189945,0.019309834,52631579
+0.136.0,2024-10-09-22,sample_25pct_index,2.784334319333334,0.010606911422785317,2.781489958,0.41741633333333333,2.3654466666666667,2.775439583,2.796073417,359195
+0.136.0,2024-10-09-22,sample_25pct_seeded_index,2.78099625,0.00379345691057489,2.78093475,0.41989866666666664,2.3597406666666667,2.777233917,2.784820083,359583
+0.136.0,2024-10-09-22,schema,7.8167974026666664,0.040637817784430603,7.831071542,13.272739999999999,0.393381,7.770948333,7.848372333,127926
+0.136.0,2024-10-09-22,schema_index,0.11072668033333334,0.000484563093606325,0.11074679100000001,1.0238993333333333,0.062112666666666656,0.11023237500000001,0.111200875,9009009
+0.136.0,2024-10-09-22,search,0.5870271663333334,0.0010020523424938018,0.5864650410000001,0.5419103333333334,0.043955333333333325,0.586432375,0.588184083,1703578
+0.136.0,2024-10-09-22,search_file,1.0692094583333331,0.0021090949990984855,1.06957,1.021632,0.046468333333333334,1.066943333,1.071115042,935454
+0.136.0,2024-10-09-22,search_file_case_sensitive,0.9843420133333334,0.0007680726995515422,0.984066541,0.9367206666666666,0.046418999999999995,0.983749666,0.9852098330000001,1016260
+0.136.0,2024-10-09-22,search_file_case_sensitive_unicode,0.9835609446666668,0.0015630574535778763,0.9834135,0.9346326666666668,0.047799,0.982076834,0.9851925,1016260
+0.136.0,2024-10-09-22,search_file_flag,1.2531727916666668,0.0008596545780139056,1.253225583,1.203385,0.04862666666666667,1.2522879580000001,1.254004834,798085
+0.136.0,2024-10-09-22,search_file_flag_matchonly,0.8408497920000001,0.0026936119251155933,0.840080292,0.7939083333333333,0.04576266666666667,0.838624667,0.843844417,1189061
+0.136.0,2024-10-09-22,search_file_literal,0.9418367220000001,0.004136733581775356,0.9425460000000001,0.8937806666666667,0.046918999999999995,0.9373912080000001,0.9455729580000001,1061571
+0.136.0,2024-10-09-22,search_file_unicode,1.0884298053333334,0.0018019277360431514,1.0882925,1.0402263333333333,0.047083999999999994,1.086700458,1.090296458,919118
+0.136.0,2024-10-09-22,search_unicode,0.5862996943333334,0.0010450075642292427,0.585999,0.5415249999999999,0.04366233333333333,0.585438,0.587462083,1706485
+0.136.0,2024-10-09-22,searchset,1.2479794026666666,0.0033260528682583397,1.24748775,1.5688736666666667,0.10403333333333332,1.244926542,1.251523916,801282
+0.136.0,2024-10-09-22,searchset_ignorecase,1.4406021803333333,0.001061116164262995,1.4411695,1.7601093333333333,0.10427633333333335,1.439378,1.441259041,693963
+0.136.0,2024-10-09-22,searchset_unicode,1.2449286526666665,0.0048582164261754095,1.243868708,1.5592396666666666,0.10194599999999998,1.240687917,1.250229333,803213
+0.136.0,2024-10-09-22,select,0.4911789306666667,0.000493972853482189,0.491139166,0.4470453333333333,0.04304333333333333,0.490706042,0.491691584,2036660
+0.136.0,2024-10-09-22,select_regex,0.526533139,0.0018390845593602076,0.526113458,0.4818723333333333,0.04352033333333333,0.524940167,0.5285457920000001,1897533
+0.136.0,2024-10-09-22,slice_last_1k,0.008980902666666667,0.00016669415587336408,0.009022959,0.006043666666666666,0.0023713333333333334,0.008797208,0.009122541000000001,111111111
+0.136.0,2024-10-09-22,slice_last_1k_index,0.008859264,0.00013893256714320095,0.008839125,0.005673333333333333,0.0024966666666666666,0.0087315,0.009007167,111111111
+0.136.0,2024-10-09-22,slice_last_1k_json,0.011867916333333334,0.00021738081900741208,0.01192925,0.008818666666666667,0.002439,0.011626458000000001,0.012048041,83333333
+0.136.0,2024-10-09-22,slice_last_1k_json_index,0.012107569,0.000030551562365941323,0.012092708,0.008600666666666666,0.0027273333333333333,0.012087291,0.012142708,83333333
+0.136.0,2024-10-09-22,slice_one_middle,0.2571123886666667,0.0011219957566971101,0.256721875,0.23244233333333333,0.023569666666666666,0.256237833,0.258377458,3891051
+0.136.0,2024-10-09-22,slice_one_middle_index,0.007865847,0.00005689357381110821,0.007883708,0.004748666666666666,0.002436,0.007802166,0.007911667,125000000
+0.136.0,2024-10-09-22,snappy_compress,0.17543269433333333,0.006437975025409485,0.178878375,1.162416,0.10746833333333333,0.16800520800000002,0.1794145,5714286
+0.136.0,2024-10-09-22,snappy_decompress,0.4950796386666667,0.0023225127598840655,0.49471354100000003,0.47328966666666666,0.020706000000000002,0.492961917,0.497563458,2020202
+0.136.0,2024-10-09-22,snappy_validate,0.4778566806666667,0.0004231111302557911,0.47797025000000004,0.45737266666666665,0.019444,0.47738837500000003,0.478211417,2092050
+0.136.0,2024-10-09-22,sort,1.2448715416666667,0.004062296792098928,1.243819625,2.116125,0.12835066666666664,1.241438667,1.249356333,803213
+0.136.0,2024-10-09-22,sort_random_seeded,1.1755278606666666,0.01747898854165516,1.172330541,1.0638263333333333,0.106891,1.15986825,1.194384791,850340
+0.136.0,2024-10-09-22,sort_random_seeded_faster,1.1654890973333334,0.01166500440181754,1.1681225,1.0480146666666668,0.113234,1.1527325,1.175612292,858369
+0.136.0,2024-10-09-22,sort_random_seeded_secure,1.1753826666666667,0.010507493503398389,1.169346375,1.0649463333333333,0.10569433333333333,1.169286,1.187515625,851064
+0.136.0,2024-10-09-22,sortcheck_sorted,0.4984155003333333,0.0002929748303563367,0.49856108400000004,0.4543566666666667,0.04294599999999999,0.49807825000000006,0.498607167,2008032
+0.136.0,2024-10-09-22,sortcheck_unsorted,0.007578639000000001,0.00018884501208133643,0.007486417,0.004672,0.0023496666666666666,0.007453625,0.007795875000000001,125000000
+0.136.0,2024-10-09-22,sortcheck_unsorted_all,0.5326300416666666,0.002544201329297766,0.532960416,0.48673799999999995,0.044769,0.529936792,0.5349929170000001,1876173
+0.136.0,2024-10-09-22,split,0.9717815833333333,0.04966093558043338,0.9652262500000001,0.816767,0.10735266666666665,0.9257238750000001,1.024394625,1028807
+0.136.0,2024-10-09-22,split_chunks,1.0157952636666667,0.02866098694382442,1.024791417,1.2385943333333334,0.156238,0.983715416,1.038878958,984252
+0.136.0,2024-10-09-22,split_chunks_index,0.237130722,0.11520503998050603,0.203406208,1.0650579999999998,0.205462,0.142551541,0.365434417,4219409
+0.136.0,2024-10-09-22,split_chunks_index_j1,0.009002514000000001,0.00007689415139657865,0.009030916,0.005336666666666667,0.004367666666666666,0.008915459,0.009061167,111111111
+0.136.0,2024-10-09-22,split_index,0.20669505566666668,0.05728089425847374,0.23947558300000002,1.0443603333333333,0.19973866666666665,0.14055362500000002,0.240055959,4830918
+0.136.0,2024-10-09-22,split_index_j1,1.0268533613333333,0.03843516155693625,1.010459542,0.8795676666666666,0.11235266666666666,0.9993334170000001,1.070767125,973710
+0.136.0,2024-10-09-22,split_kbsize,2.036766389,0.04346158710737812,2.018941292,1.8980946666666665,0.11043033333333334,2.00505125,2.086306625,490918
+0.136.0,2024-10-09-22,sqlp,1.0465692636666668,0.013914078754769328,1.045776375,2.0121113333333334,0.27294066666666666,1.033068583,1.060862833,955110
+0.136.0,2024-10-09-22,sqlp_aggregations,0.9915284443333334,0.011169118131619549,0.9854105420000001,1.3752786666666665,0.05673066666666667,0.9847549160000001,1.004419875,1008065
+0.136.0,2024-10-09-22,sqlp_aggregations_expensive,0.8579473750000001,0.01071784359307729,0.854041916,1.4292443333333333,0.096925,0.849729917,0.8700702920000001,1165501
+0.136.0,2024-10-09-22,sqlp_aggregations_expensive_streaming,0.8589640693333335,0.007709582229175652,0.856374708,1.4293953333333331,0.09164933333333332,0.8528825000000001,0.867635,1164144
+0.136.0,2024-10-09-22,sqlp_aggregations_expensive_vs_duckdb,0.22032431933333338,0.004612126504017463,0.21811233300000002,0.8804273333333333,0.12304033333333332,0.21723483300000002,0.22562579200000002,4545455
+0.136.0,2024-10-09-22,sqlp_aggregations_vs_duckdb,0.19413722266666666,0.004535591784381205,0.195525792,0.6153073333333333,0.10211199999999998,0.18906966700000002,0.19781620900000002,5154639
+0.136.0,2024-10-09-22,sqlp_format_arrow,1.7363877083333332,0.0031499168238577568,1.735523583,2.212789666666666,0.7271723333333333,1.7337600420000001,1.7398795,576037
+0.136.0,2024-10-09-22,sqlp_format_avro,1.0304819856666667,0.005013535079717769,1.029383666,1.9862596666666665,0.3737723333333333,1.026108666,1.035953625,970874
+0.136.0,2024-10-09-22,sqlp_format_json,1.0228909720000001,0.0014389669238213615,1.023682666,1.964939,0.2585943333333333,1.02123,1.02376025,977517
+0.136.0,2024-10-09-22,sqlp_format_jsonl,1.023724417,0.001900603307837816,1.022800209,1.9640849999999999,0.25551566666666664,1.022462667,1.025910375,976562
+0.136.0,2024-10-09-22,sqlp_format_parquet,1.025136014,0.0019723300715826465,1.024200291,1.9758483333333334,0.270604,1.023805709,1.027402042,975610
+0.136.0,2024-10-09-22,sqlp_format_parquet_statistics,1.025225514,0.0020774838027392698,1.025213792,1.9743553333333332,0.2804173333333333,1.023153916,1.027308834,975610
+0.136.0,2024-10-09-22,sqlp_lowmemory,1.0151198193333333,0.001987065600690942,1.015369,1.963368,0.2535543333333333,1.013019916,1.016970542,985222
+0.136.0,2024-10-09-22,sqlp_nooptimizations,1.0478791386666666,0.0008166565087663174,1.047478,2.0146046666666666,0.18714033333333335,1.047340625,1.048818791,954198
+0.136.0,2024-10-09-22,sqlp_tryparsedates,11.918393847333334,0.013805430703016874,11.914084625000001,12.856793333333334,0.2654393333333333,11.907257,11.933839917,83907
+0.136.0,2024-10-09-22,sqlp_tryparsedates_inferlen,1.9179708060000003,0.006179784729398966,1.9200773340000001,2.8641963333333336,0.25034033333333333,1.9110131670000001,1.922821917,521376
+0.136.0,2024-10-09-22,stats,1.909606736,0.0049196025849774,1.910509792,2.219391333333333,0.09494199999999998,1.904298166,1.91401225,523560
+0.136.0,2024-10-09-22,stats_create_cache,1.9097833056666669,0.004521451395342963,1.9118497090000002,2.2203649999999997,0.09286466666666666,1.904597875,1.912902333,523560
+0.136.0,2024-10-09-22,stats_everything,3.3554944723333335,0.04029503222196921,3.343843042,10.192412666666668,0.3932616666666666,3.322309,3.400331375,298063
+0.136.0,2024-10-09-22,stats_everything_create_cache,3.3900974583333334,0.018655247417147178,3.382474708,10.237715333333332,0.392744,3.376460667,3.411357,294985
+0.136.0,2024-10-09-22,stats_everything_index,1.3312123473333333,0.009204037936792824,1.32928925,10.825936333333331,0.5668519999999999,1.323121792,1.341226,751315
+0.136.0,2024-10-09-22,stats_everything_index_j1,6.614990667000001,0.15419707857364842,6.636688584,6.550748,0.21150966666666668,6.451093875,6.757189542,151172
+0.136.0,2024-10-09-22,stats_everything_index_j1_with_cache,0.007933236333333335,0.00015488744395958354,0.007865750000000001,0.004810333333333333,0.0024836666666666666,0.007823542000000001,0.008110417,125000000
+0.136.0,2024-10-09-22,stats_everything_index_with_cache,0.008150389000000001,0.00004450365283884046,0.008145625,0.004868666666666666,0.002627666666666667,0.008108459,0.008197083,125000000
+0.136.0,2024-10-09-22,stats_everything_infer_dates,7.172214625333333,0.001711103903247197,7.172136042,14.419449,0.4363456666666667,7.170544167,7.173963667,139431
+0.136.0,2024-10-09-22,stats_everything_infer_dates_index,1.892725361,0.026426721653890588,1.9041573330000001,17.084736,0.5867853333333334,1.8625072500000002,1.9115115,528262
+0.136.0,2024-10-09-22,stats_everything_infer_dates_index_with_cache,0.008059833333333334,0.00016426584580287267,0.007988208,0.004905333333333334,0.0025053333333333334,0.007943542000000001,0.00824775,125000000
+0.136.0,2024-10-09-22,stats_everything_j1,6.374932889,0.03861090214131202,6.378022792,6.5876529999999995,0.26058733333333334,6.334869875,6.411906,156863
+0.136.0,2024-10-09-22,stats_everything_sorted,3.3091379170000006,0.01562012204732685,3.309453625,9.845339666666666,0.40390433333333325,3.2933623340000002,3.324597792,302206
+0.136.0,2024-10-09-22,stats_everything_sorted_index,3.3277645556666666,0.006919087020449097,3.326532125,9.828958333333333,0.4096936666666666,3.3215445,3.335217042,300481
+0.136.0,2024-10-09-22,stats_index,0.2264774586666667,0.004532509862893005,0.224717459,2.293756,0.06589166666666667,0.22308891700000003,0.23162600000000003,4424779
+0.136.0,2024-10-09-22,stats_index_j1,1.8859975693333333,0.0014554704378813388,1.8864251250000001,1.8443606666666668,0.04049133333333333,1.884376208,1.887191375,530223
+0.136.0,2024-10-09-22,stats_index_j1_with_cache,0.007778472333333334,0.00011276332092632511,0.007799292,0.004687666666666666,0.002419333333333333,0.00765675,0.007879375000000001,125000000
+0.136.0,2024-10-09-22,stats_index_with_cache,0.007986986,0.000047691702244729985,0.007972625,0.004798,0.0025496666666666667,0.007948125,0.008040208,125000000
+0.136.0,2024-10-09-22,table,6.831468819666667,0.023255516463334465,6.827525417,5.733177333333333,1.0903183333333333,6.810437125,6.856443917,146391
+0.136.0,2024-10-09-22,to_datapackage,0.695291889,0.0036729801911510383,0.6936888750000001,2.0978336666666664,0.30246833333333334,0.6926928750000001,0.6994939170000001,1438849
+0.136.0,2024-10-09-22,to_sqlite,0.6869207916666668,0.006021595270961332,0.688884916,2.080145,0.29434066666666664,0.6801623750000001,0.691715084,1455604
+0.136.0,2024-10-09-22,to_xlsx,30.79641108333333,0.03361517688094782,30.809203667,29.30711633333333,3.063931,30.758277708,30.821751875,32472
+0.136.0,2024-10-09-22,tojsonl,5.255716042,0.02947630512929443,5.257766042,10.161964666666664,0.4150133333333333,5.22526825,5.284113834,190259
+0.136.0,2024-10-09-22,tojsonl_batchall,5.2791820136666665,0.018680752373076034,5.275491625,10.091462666666665,0.37808400000000003,5.262621875,5.299432541,189430
+0.136.0,2024-10-09-22,tojsonl_index,2.8958170693333334,0.07985544815714167,2.86844975,11.432261333333335,0.4399403333333334,2.8332435,2.985757958,345304
+0.136.0,2024-10-09-22,tojsonl_index_j1,8.995612166666666,0.019833368532575935,9.003292875,8.607582666666666,0.3818063333333333,8.973087125,9.0104565,111161
+0.136.0,2024-10-09-22,tojsonl_j1,9.050394528,0.04188608359892298,9.033382667,9.022415666666666,0.430021,9.019690875,9.098110042,110497
+0.136.0,2024-10-09-22,tojsonl_trim,5.348996528000001,0.006708534294621601,5.348959584,10.950814333333334,0.3859336666666667,5.342306542,5.355723458,186951
+0.136.0,2024-10-09-22,tojsonl_trim_j1,9.571418291666667,0.01507952192561961,9.56800225,9.526006333333333,0.4491516666666666,9.558339833,9.587912792000001,104482
+0.136.0,2024-10-09-22,transpose,2.6229285693333333,0.025532015383013567,2.611978792,2.4179046666666664,0.19915433333333332,2.60469775,2.652109166,381243
+0.136.0,2024-10-09-22,transpose_multipass,21.422549930333332,0.02144520581620947,21.414166625,19.688017333333335,1.7326546666666667,21.406562708,21.446920458,46679
+0.136.0,2024-10-09-22,validate,1.3454596946666666,0.011306645865111651,1.344570917,6.256567999999999,0.15226666666666666,1.334623667,1.3571845,743494
+0.136.0,2024-10-09-22,validate_batchall,1.2823367776666668,0.0075023406401299505,1.283977083,5.824079,0.11468199999999999,1.2741500000000001,1.28888325,780031
+0.136.0,2024-10-09-22,validate_batchall_index,1.2857204443333334,0.004130539026058984,1.286295208,5.745959666666667,0.12479633333333333,1.2813326250000001,1.2895335,777605
+0.136.0,2024-10-09-22,validate_dynenum,1.3203521386666666,0.004890651370770679,1.318326208,6.183933333333333,0.14744133333333334,1.3168,1.325930208,757576
+0.136.0,2024-10-09-22,validate_dynenum_batchall,1.272792861,0.0026021360365074747,1.273357416,5.749370666666667,0.11033633333333333,1.269954792,1.275066375,785546
+0.136.0,2024-10-09-22,validate_dynenum_batchall_index,1.271873194,0.006069566186101182,1.273125708,5.687784333333333,0.12177833333333332,1.2652750830000001,1.2772187910000001,786164
+0.136.0,2024-10-09-22,validate_dynenum_index,1.26976775,0.0012953332136516952,1.26936025,5.678887333333333,0.10425066666666666,1.268725167,1.2712178330000001,787402
+0.136.0,2024-10-09-22,validate_dynenum_no_schema,1.3317769723333333,0.00857000757395079,1.335231583,6.148984666666666,0.14937566666666666,1.322018834,1.3380805,750751
+0.136.0,2024-10-09-22,validate_dynenum_no_schema_index,1.267980167,0.004467809592701886,1.269947584,5.694462333333333,0.102148,1.262866292,1.271126625,788644
+0.136.0,2024-10-09-22,validate_dynenum_valid_output,2.2017550413333336,0.0028643772618533727,2.202526583,7.002077333333333,0.19268933333333335,2.198583916,2.204154625,454133
+0.136.0,2024-10-09-22,validate_dynenum_valid_output_index,2.1348443749999997,0.0037203540786369966,2.136084209,6.538800666666667,0.1434173333333333,2.130662416,2.1377865,468384
+0.136.0,2024-10-09-22,validate_index,1.2818570833333334,0.0032141490070814053,1.2826240420000001,5.739469666666666,0.10224566666666667,1.278328833,1.284618375,780031
+0.136.0,2024-10-09-22,validate_no_schema,0.4880847496666667,0.0036591216167233724,0.489340916,0.4425666666666666,0.04411433333333333,0.48396300000000003,0.490950333,2049180
+0.136.0,2024-10-09-22,validate_no_schema_index,0.49482838866666673,0.0009017353931089343,0.49446141600000004,0.45398833333333327,0.039464,0.49416800000000005,0.49585575000000004,2020202
+0.136.0,2024-10-09-22,validate_valid_output,2.2125143473333337,0.004183940417602296,2.21488575,7.101555,0.1944523333333333,2.207683417,2.214973875,451875
+0.136.0,2024-10-09-22,validate_valid_output_index,2.143425805666667,0.008207043638664849,2.138873375,6.604312666666666,0.13987033333333332,2.138503959,2.152900083,466636
diff --git a/scripts/results/latest_run_info.tsv b/scripts/results/latest_run_info.tsv
index 8e37c2cac..311f99e46 100644
--- a/scripts/results/latest_run_info.tsv
+++ b/scripts/results/latest_run_info.tsv
@@ -1,2 +1,2 @@
version tstamp logtime bm_version platform cores mem binary kind argument total_count wo_index_count with_index_count warmup_runs benchmark_runs elapsed_secs total_mean qsv_env version_info
-0.135.0 2024-09-24-16 2024-09-24-16-09-43 5.0.0 aarch64-apple-darwin 12 34359738368 qsv prebuilt 233 179 54 2 3 4041 800.027 No qsv-relevant environment variables set. qsv 0.135.0-mimalloc-apply;fetch;foreach;geocode;Luau 0.640;to;polars-0.43.1-py-1.8.1;self_update-12-12;25.60 GiB-0 B-18.97 GiB-32.00 GiB (aarch64-apple-darwin compiled with Rust 1.81) prebuilt
+0.136.0 2024-10-09-22 2024-10-09-22-56-27 5.1.0 aarch64-apple-darwin 12 34359738368 qsv prebuilt 234 180 54 2 3 3990 788.815 No qsv-relevant environment variables set. qsv 0.136.0-mimalloc-apply;fetch;foreach;geocode;Luau 0.640;to;polars-0.43.1-ee9bafb;self_update-12-12;25.60 GiB-0 B-19.70 GiB-32.00 GiB (aarch64-apple-darwin compiled with Rust 1.81) prebuilt
diff --git a/scripts/results/run_info_history.tsv b/scripts/results/run_info_history.tsv
index 150f4ada9..618fc861a 100644
--- a/scripts/results/run_info_history.tsv
+++ b/scripts/results/run_info_history.tsv
@@ -1,4 +1,5 @@
version tstamp logtime bm_version platform cores mem binary kind argument total_count wo_index_count with_index_count warmup_runs benchmark_runs elapsed_secs total_mean qsv_env version_info
+0.136.0 2024-10-09-22 2024-10-09-22-56-27 5.1.0 aarch64-apple-darwin 12 34359738368 qsv prebuilt 234 180 54 2 3 3990 788.815 No qsv-relevant environment variables set. qsv 0.136.0-mimalloc-apply;fetch;foreach;geocode;Luau 0.640;to;polars-0.43.1-ee9bafb;self_update-12-12;25.60 GiB-0 B-19.70 GiB-32.00 GiB (aarch64-apple-darwin compiled with Rust 1.81) prebuilt
0.135.0 2024-09-27-15 2024-09-27-15-52-37 5.1.0 aarch64-apple-darwin 12 34359738368 qsv prebuilt apply_op_sentiment 1 1 0 2 3 18 3.595 No qsv-relevant environment variables set. qsv 0.135.0-mimalloc-apply;fetch;foreach;geocode;Luau 0.640;to;polars-0.43.1-py-1.8.1;self_update-12-12;25.60 GiB-0 B-18.13 GiB-32.00 GiB (aarch64-apple-darwin compiled with Rust 1.81) prebuilt
0.135.0 2024-09-24-16 2024-09-24-16-09-43 5.0.0 aarch64-apple-darwin 12 34359738368 qsv prebuilt 233 179 54 2 3 4041 800.027 No qsv-relevant environment variables set. qsv 0.135.0-mimalloc-apply;fetch;foreach;geocode;Luau 0.640;to;polars-0.43.1-py-1.8.1;self_update-12-12;25.60 GiB-0 B-18.97 GiB-32.00 GiB (aarch64-apple-darwin compiled with Rust 1.81) prebuilt
0.134.0 2024-09-11-04 2024-09-11-04-55-36 4.12.0 aarch64-apple-darwin 12 34359738368 qsv prebuilt 225 175 50 2 3 7272 824.618 No qsv-relevant environment variables set. qsv 0.134.0-mimalloc-apply;fetch;foreach;geocode;Luau 0.640;to;polars-0.42.0-fe04390;self_update-12-12;25.60 GiB-931.62 MiB-18.35 GiB-32.00 GiB (aarch64-apple-darwin compiled with Rust 1.81) prebuilt
diff --git a/src/cmd/apply.rs b/src/cmd/apply.rs
index 91c3fb1bb..54d13421b 100644
--- a/src/cmd/apply.rs
+++ b/src/cmd/apply.rs
@@ -321,6 +321,7 @@ use rayon::{
};
use regex::Regex;
use serde::Deserialize;
+use smallvec::SmallVec;
use strsim::{
damerau_levenshtein, hamming, jaro_winkler, normalized_damerau_levenshtein, osa_distance,
sorensen_dice,
@@ -417,6 +418,7 @@ static SENTIMENT_ANALYZER: OnceLock = OnceLock::new(
static THOUSANDS_POLICY: OnceLock = OnceLock::new();
static ROUND_PLACES: OnceLock = OnceLock::new();
static WHATLANG_CONFIDENCE_THRESHOLD: OnceLock = OnceLock::new();
+static GENDER_GUESSER: OnceLock = OnceLock::new();
// default confidence threshold for whatlang language detection - 90% confidence
const DEFAULT_THRESHOLD: f64 = 0.9;
@@ -508,7 +510,7 @@ pub fn run(argv: &[&str]) -> CliResult<()> {
String::new()
};
- let mut ops_vec: Vec = Vec::new();
+ let mut ops_vec = SmallVec::<[Operations; 4]>::new();
let apply_cmd = if args.cmd_operations {
match validate_operations(
@@ -598,6 +600,7 @@ pub fn run(argv: &[&str]) -> CliResult<()> {
// do actual apply command via Rayon parallel iterator
batch
.par_iter()
+ .with_min_len(1024)
.map(|record_item| {
let mut record = record_item.clone();
match apply_cmd {
@@ -726,7 +729,7 @@ fn validate_operations(
flag_replacement: &str,
flag_new_column: Option<&String>,
flag_formatstr: &str,
-) -> Result, CliError> {
+) -> Result, CliError> {
let mut censor_invokes = 0_u8;
let mut copy_invokes = 0_u8;
let mut eudex_invokes = 0_u8;
@@ -737,7 +740,7 @@ fn validate_operations(
let mut strip_invokes = 0_u8;
let mut whatlang_invokes = 0_u8;
- let mut ops_vec: Vec = Vec::with_capacity(operations.len());
+ let mut ops_vec = SmallVec::with_capacity(operations.len());
for op in operations {
let Ok(operation) = Operations::from_str(op) else {
@@ -829,6 +832,14 @@ fn validate_operations(
"--new_column (-c) is required for sentiment operation."
);
}
+ if sentiment_invokes == 0
+ && SENTIMENT_ANALYZER
+ .set(SentimentIntensityAnalyzer::new())
+ .is_err()
+ {
+ return fail!("Cannot initialize Sentiment Analyzer.");
+ }
+
sentiment_invokes = sentiment_invokes.saturating_add(1);
},
Operations::Simdl
@@ -930,6 +941,9 @@ fn validate_operations(
"--new_column (-c) is required for Gender_Guess"
);
}
+ if GENDER_GUESSER.set(gender_guesser::Detector::new()).is_err() {
+ return fail!("Cannot initialize Gender Detector.");
+ }
},
_ => {},
}
@@ -959,7 +973,7 @@ fn validate_operations(
#[inline]
fn apply_operations(
- ops_vec: &Vec,
+ ops_vec: &SmallVec<[Operations; 4]>,
cell: &mut String,
comparand: &str,
replacement: &str,
@@ -968,7 +982,7 @@ fn apply_operations(
for op in ops_vec {
match op {
Operations::Len => {
- *cell = cell.len().to_string();
+ itoa::Buffer::new().format(cell.len()).clone_into(cell);
},
Operations::Lower => {
*cell = cell.to_lowercase();
@@ -978,11 +992,11 @@ fn apply_operations(
},
Operations::Squeeze => {
let squeezer: &'static Regex = regex_oncelock!(r"\s+");
- *cell = squeezer.replace_all(cell, " ").to_string();
+ *cell = squeezer.replace_all(cell, " ").into_owned();
},
Operations::Squeeze0 => {
let squeezer: &'static Regex = regex_oncelock!(r"\s+");
- *cell = squeezer.replace_all(cell, "").to_string();
+ *cell = squeezer.replace_all(cell, "").into_owned();
},
Operations::Trim => {
*cell = String::from(cell.trim());
@@ -1036,18 +1050,21 @@ fn apply_operations(
// including selection of the best algorithm repeatedly at runtime
let mut crc32_hasher = CRC32.get().unwrap().clone();
crc32_hasher.update(cell.as_bytes());
- *cell = crc32_hasher.finalize().to_string();
+ itoa::Buffer::new()
+ .format(crc32_hasher.finalize())
+ .clone_into(cell);
},
Operations::Gender_Guess => {
- let gender_detector = gender_guesser::Detector::new();
+ // safety: we set GENDER_GUESSER in validate_operations()
+ let gender_detector = GENDER_GUESSER.get().unwrap();
*cell = match gender_detector.get_gender(cell) {
- Gender::Male => "Male".to_string(),
- Gender::Female => "Female".to_string(),
- Gender::MayBeMale => "MayBeMale".to_string(),
- Gender::MayBeFemale => "MayBeFemale".to_string(),
- Gender::BothMaleFemale => "BothMaleFemale".to_string(),
- Gender::NotSure => "NotSure".to_string(),
- Gender::NotFound => "NotFound".to_string(),
+ Gender::Male => "Male".to_owned(),
+ Gender::Female => "Female".to_owned(),
+ Gender::MayBeMale => "MayBeMale".to_owned(),
+ Gender::MayBeFemale => "MayBeFemale".to_owned(),
+ Gender::BothMaleFemale => "BothMaleFemale".to_owned(),
+ Gender::NotSure => "NotSure".to_owned(),
+ Gender::NotFound => "NotFound".to_owned(),
};
},
Operations::Escape => {
@@ -1072,7 +1089,7 @@ fn apply_operations(
Operations::Regex_Replace => {
// safety: we set REGEX_REPLACE in validate_operations()
let regexreplace = REGEX_REPLACE.get().unwrap();
- *cell = regexreplace.replace_all(cell, replacement).to_string();
+ *cell = regexreplace.replace_all(cell, replacement).into_owned();
},
Operations::Censor => {
// safety: we set CENSOR in validate_operations()
@@ -1082,12 +1099,14 @@ fn apply_operations(
Operations::Censor_Check => {
// safety: we set CENSOR in validate_operations()
let censor = CENSOR.get().unwrap();
- *cell = censor.check(cell).to_string();
+ if censor.check(cell) { "true" } else { "false" }.clone_into(cell);
},
Operations::Censor_Count => {
// safety: we set CENSOR in validate_operations()
let censor = CENSOR.get().unwrap();
- *cell = censor.count(cell).to_string();
+ itoa::Buffer::new()
+ .format(censor.count(cell))
+ .clone_into(cell);
},
Operations::Thousands => {
if let Ok(num) = cell.parse::() {
@@ -1168,25 +1187,37 @@ fn apply_operations(
}
},
Operations::Simdl => {
- *cell = damerau_levenshtein(cell, comparand).to_string();
+ itoa::Buffer::new()
+ .format(damerau_levenshtein(cell, comparand))
+ .clone_into(cell);
},
Operations::Simdln => {
- *cell = normalized_damerau_levenshtein(cell, comparand).to_string();
+ ryu::Buffer::new()
+ .format_finite(normalized_damerau_levenshtein(cell, comparand))
+ .clone_into(cell);
},
Operations::Simjw => {
- *cell = jaro_winkler(cell, comparand).to_string();
+ ryu::Buffer::new()
+ .format_finite(jaro_winkler(cell, comparand))
+ .clone_into(cell);
},
Operations::Simsd => {
- *cell = sorensen_dice(cell, comparand).to_string();
+ ryu::Buffer::new()
+ .format_finite(sorensen_dice(cell, comparand))
+ .clone_into(cell);
},
Operations::Simhm => {
let ham_val = hamming(cell, comparand);
match ham_val {
- Ok(val) => *cell = val.to_string(),
+ Ok(val) => itoa::Buffer::new().format(val).clone_into(cell),
Err(_) => *cell = String::from("ERROR: Different lengths"),
}
},
- Operations::Simod => *cell = osa_distance(cell, comparand).to_string(),
+ Operations::Simod => {
+ itoa::Buffer::new()
+ .format(osa_distance(cell, comparand))
+ .clone_into(cell);
+ },
Operations::Eudex => {
// safety: we set EUDEX_COMPARAND_HASH in validate_operations()
let eudex_comparand_hash = EUDEX_COMPARAND_HASH.get().unwrap();
@@ -1195,10 +1226,11 @@ fn apply_operations(
},
Operations::Sentiment => {
// safety: we set SENTIMENT_ANALYZER in validate_operations()
- let sentiment_analyzer =
- SENTIMENT_ANALYZER.get_or_init(SentimentIntensityAnalyzer::new);
+ let sentiment_analyzer = SENTIMENT_ANALYZER.get().unwrap();
let sentiment_scores = sentiment_analyzer.polarity_scores(cell);
- *cell = sentiment_scores.get("compound").unwrap_or(&0.0).to_string();
+ ryu::Buffer::new()
+ .format_finite(*sentiment_scores.get("compound").unwrap_or(&0.0))
+ .clone_into(cell);
},
Operations::Whatlang => {
let lang_info = detect(cell);
diff --git a/src/cmd/applydp.rs b/src/cmd/applydp.rs
index 164520d65..7922846c8 100644
--- a/src/cmd/applydp.rs
+++ b/src/cmd/applydp.rs
@@ -193,6 +193,7 @@ use rayon::{
};
use regex::Regex;
use serde::Deserialize;
+use smallvec::SmallVec;
use strum_macros::EnumString;
use crate::{
@@ -331,7 +332,7 @@ pub fn run(argv: &[&str]) -> CliResult<()> {
EmptyReplace,
}
- let mut ops_vec: Vec = Vec::new();
+ let mut ops_vec = SmallVec::<[Operations; 4]>::new();
let applydp_cmd = if args.cmd_operations {
match validate_operations(
@@ -417,6 +418,7 @@ pub fn run(argv: &[&str]) -> CliResult<()> {
// do actual applydp command via Rayon parallel iterator
batch
.par_iter()
+ .with_min_len(1024)
.map(|record_item| {
let mut record = record_item.clone();
match applydp_cmd {
@@ -495,13 +497,13 @@ fn validate_operations(
flag_replacement: &str,
flag_new_column: &Option,
flag_formatstr: &str,
-) -> Result, CliError> {
+) -> Result, CliError> {
let mut copy_invokes = 0_u8;
let mut regex_replace_invokes = 0_u8;
let mut replace_invokes = 0_u8;
let mut strip_invokes = 0_u8;
- let mut ops_vec: Vec = Vec::with_capacity(operations.len());
+ let mut ops_vec = SmallVec::with_capacity(operations.len());
for op in operations {
let Ok(operation) = Operations::from_str(op) else {
@@ -586,7 +588,7 @@ fn validate_operations(
#[inline]
fn applydp_operations(
- ops_vec: &Vec,
+ ops_vec: &SmallVec<[Operations; 4]>,
cell: &mut String,
comparand: &str,
replacement: &str,
@@ -594,7 +596,7 @@ fn applydp_operations(
for op in ops_vec {
match op {
Operations::Len => {
- *cell = cell.len().to_string();
+ *cell = itoa::Buffer::new().format(cell.len()).to_owned();
},
Operations::Lower => {
*cell = cell.to_lowercase();
@@ -604,11 +606,11 @@ fn applydp_operations(
},
Operations::Squeeze => {
let squeezer: &'static Regex = regex_oncelock!(r"\s+");
- *cell = squeezer.replace_all(cell, " ").to_string();
+ *cell = squeezer.replace_all(cell, " ").into_owned();
},
Operations::Squeeze0 => {
let squeezer: &'static Regex = regex_oncelock!(r"\s+");
- *cell = squeezer.replace_all(cell, "").to_string();
+ *cell = squeezer.replace_all(cell, "").into_owned();
},
Operations::Trim => {
*cell = String::from(cell.trim());
@@ -648,7 +650,7 @@ fn applydp_operations(
Operations::Regex_Replace => {
// safety: we set REGEX_REPLACE in validate_operations()
let regexreplace = REGEX_REPLACE.get().unwrap();
- *cell = regexreplace.replace_all(cell, replacement).to_string();
+ *cell = regexreplace.replace_all(cell, replacement).into_owned();
},
Operations::Round => {
if let Ok(num) = cell.parse::() {
diff --git a/src/cmd/datefmt.rs b/src/cmd/datefmt.rs
index e2b8a5410..d31280764 100644
--- a/src/cmd/datefmt.rs
+++ b/src/cmd/datefmt.rs
@@ -265,7 +265,7 @@ pub fn run(argv: &[&str]) -> CliResult<()> {
// set timezone variables
let default_tz = match args.flag_default_tz.as_deref() {
Some(tz) => {
- if tz.to_ascii_lowercase() == "local" {
+ if tz.eq_ignore_ascii_case("local") {
if let Some(tz) = localzone::get_local_zone() {
log::info!("default-tz local timezone: {tz}");
tz.parse::()?
@@ -282,7 +282,7 @@ pub fn run(argv: &[&str]) -> CliResult<()> {
let mut input_tz = if let Ok(tz) = args.flag_input_tz.parse::() {
tz
- } else if args.flag_input_tz.to_ascii_lowercase() == "local" {
+ } else if args.flag_input_tz.eq_ignore_ascii_case("local") {
if let Some(tz) = localzone::get_local_zone() {
log::info!("input-tz local timezone: {tz}");
tz.parse::()?
@@ -295,7 +295,7 @@ pub fn run(argv: &[&str]) -> CliResult<()> {
#[allow(clippy::useless_let_if_seq)] // more readable this way
let mut output_tz = if let Ok(tz) = args.flag_output_tz.parse::() {
tz
- } else if args.flag_output_tz.to_ascii_lowercase() == "local" {
+ } else if args.flag_output_tz.eq_ignore_ascii_case("local") {
if let Some(tz) = localzone::get_local_zone() {
log::info!("output-tz local timezone: {tz}");
tz.parse::()?
diff --git a/src/cmd/extdedup.rs b/src/cmd/extdedup.rs
index 2e9ae300f..3eedd04c8 100644
--- a/src/cmd/extdedup.rs
+++ b/src/cmd/extdedup.rs
@@ -7,8 +7,14 @@ to sort the CSV first before deduping it.
This allows it to run in constant memory and the output will retain the input sort order.
-Also, this command is not specific to CSV data, it deduplicates any text file on a
-line-by-line basis.
+This command has TWO modes of operation.
+
+ * CSV MODE
+ when --select is set, it dedupes based on the given column/s. See `qsv select --help`
+ for select syntax details.
+ * LINE MODE
+ when --select is NOT set, it deduplicates any input text file (not just CSVs) on a
+ line-by-line basis.
A duplicate count will be sent to .
@@ -17,6 +23,10 @@ Usage:
qsv extdedup --help
extdedup options:
+ -s, --select Select a subset of columns to dedup.
+ Note that the outputs will remain at the full width of the CSV.
+ If --select is NOT set, extdedup will work in LINE MODE, deduping
+ the input as a text file on a line-by-line basis.
--no-output Do not write deduplicated output to