v0.3.3 / 2024-01-8

What's Changed

• Updates nodeSelector for deployments by @nkinkade in #118
• Update cloudbuild.yaml by @robertodauria in #119

New Contributors

• @nkinkade made their first contribution in #118

Full Changelog: v0.3.2...v0.3.3

v0.3.2

What's Changed

• Use batch/v1 API by @stephen-soltesz in #100
• Upgrade repo to Go 1.18 by @SaiedKazemi in #106
• Rename data-pipeline configurations (us-central1 migration) by @stephen-soltesz in #114
• Update m-lab/go to v0.1.66 by @robertodauria in #115

New Contributors

• @SaiedKazemi made their first contribution in #106

Full Changelog: v0.3.1...v0.3.2

Deploy hopannotation1 export

Add hopannotation1 formatter (#91)
Add k8s configuration for hopannotation1-export (#92)
Decrease workers for hopannotation1 export (#96)
Use cron job for hopannotation1 export (#93)

Diff v0.3.0...v0.3.1

Deploy annotation-export & Canary pipeline

Add output support option for GCSWriter or LocalWriter (#65)
Add unit tests and coverage for stats-pipeline (#66)
Make partitioning configurable during the query phase (#68)
Replace year with start/end and add canary validation query (#69)
update two subqueries that had the wrong table name (#70)
Add exporter type flag and base for annotation export (#72)
Add stats query formatter (#74)
Update exporter to use Formatter interface (#75)
Add "annotation" formatter (#76)
Add annotation export config for local development (#77)
Change canary query to use simpler client filter (#78)
Change Formatter.Where to .Partition w/ exporter query updates (#79)
Prepare for a k8s configuration and deployment (#81)
Add k8s configuration for annotation-export (#82)
Request less CPU for pusher (#84)
Add separate CronJob for annotation-export (#87)
Fix races in export_test.go (#88)
Test context cancelation and increase coverage (#89)

Diff v0.2.5...v0.3.0

Weekly release

• Include fields that are already in the output path in the output JSON files.
• Improve test coverage of the export package
• Update FCC data from 2019 to 2020 in the maptiles generation

Update k8s config.json

The previous release introduced a new query in config.json, but didn't add it to the version deployed to the k8s cluster. This tiny bugfix release fixes that.

Add states and states_asn queries

Merge pull request #58 from m-lab/support-us-territories

Support us territories

Weekly release

• Fixed counties export query
• Several updates to the queries to account for older geographical annotations

Add CronJob to run stats-pipeline periodically

Create CronJob to run stats-pipeline on GKE (#52)

* Add CronJob to run the maptiles-runner

* Fix cloudbuild.yaml

* Rename runner.yaml

* Update cloudbuild.yaml

* Move concurrencyPolicy

* Fix env variables

* update deployment

* Move concurrencyPolicy to the right place.

* Set schedule from ENV variable.

* Add restartPolicy: Never

* Rename maptiles to stats-pipeline-runner

* Rename -runner to -cronjob

* Fix yaml name

* Update run-pipeline

* Remove extra \

* Rename _TAG to _DOCKER_TAG

* Rename PIPELINE_SCHEDULE to PIPELINE_CRON_SCHEDULE

* Rename to .template

* Add comments

* Added comment

v0.2.0

Changes:

• Added maptiles generation
• Created Google Cloud Build deployment configuration
• Automated upload to gcr.io and deployment of k8s resources
• Several fixes to the histogram queries
• Fixed bug in the exporter package preventing the creation of multiple files per partition
• Added several Prometheus metrics
• Allowed specifying the step to run (histograms or exports or all) when calling the /pipeline endpoint
• Fixed memory leak on the exporter
• Added -exporter.query-workers and -exporter.upload-workers command-line flags to fine-tune the number of goroutines