2.0.0

Major

Dropped CKAN 2.9.x and Python2.

Feat:

• Adds Strip White Space fields to the Data Dictionary (defualts to True for each field). This will strip surrounding white space from data values prior to inserting them into the database.
• Adds support for ckanext-validation. Config ckanext.xloader.validation.requires_successful_report controls whether a resource requires a successful validation report to be XLoadered. By default, a resource would also require a Validation Schema, which can be turned off with ckanext.xloader.validation.enforce_schema.
• Frontend Status Badges by @JVickery-TBS in #224

Fix:

• Properly handle REDIS queue timeouts to close/delete any temporary files.
• Fix automated PyPI publishing by @ThrawnCA in #231

What's Changed

• Update README, migrate it to Markdown by @amercader in #235
• chore: switch to pyproject.toml by @duttonw in #236
• Validation Extension Support (Squashed) by @JVickery-TBS in #237
• Strip White Space from Cell Values (Squashed) by @JVickery-TBS in #238
• RQ Job Timeout Handling (Squashed) by @JVickery-TBS in #239
• SQLAlchemy v2 support by @smotornyuk in #225

Full Changelog: 1.2.0...2.0.0

1.2.0

What's Changed

• Fix PyPI publishing by @ThrawnCA in #233
• Enhancement/Bugfix: Downstream qld-gov-au fix's by @duttonw in #232
  • feat: @JVickery-TBS work on validation integration (await successful validation prior to doing datastore work via 'IPipeValidation'
  • fix: handle gracefully if tabulator load fails by trying 'direct load'
  • fix: Excel blank header row bug
  • fix: Datastore truncate, restart identity so numbering restarts from 0 again (when imported data has same columns and types
  • fix: parital fix on DB deadlock by adding timeouts on DDL events
  • test: test_simple_large_file, test_with_blanks, test_with_empty_lines, test_with_extra_blank_cells
  • test: test_require_validation, test_enforce_validation_schema
  • chore: min version requirements for cve's,
    • requests>=2.32.0
    • urllib3>=2.2.2
    • zipp>=3.19.1

Full Changelog: 1.1.2...1.2.0

1.1.1

What's Changed

• feat: Add pypi cicd publish via github action via environment controls by @duttonw in #228

Full Changelog: 1.1.0...1.1.1

What's Changed

• feat: Add pypi cicd publish via github action via environment controls by @duttonw in #228

Full Changelog: 1.1.0...1.1.1

1.1.0

What's Changed

• add README note about running on separate server, #191 by @ThrawnCA in #192
• Use IDomainObjectModification Implementation by @JVickery-TBS in #198
• Hide excessive numbers of resource_data log entries, #187 by @ThrawnCA in #188
• #182 Type guessing fixes by @ThrawnCA in #186
• Document the ckan.download_proxy setting, #176 by @ThrawnCA in #204
• Conditional DataStore Tab in Resource Edit by @JVickery-TBS in #190
• Make locking behaviour more robust by @ThrawnCA in #205
• Delete Datastore Table Button by @JVickery-TBS in #197
• Quality of life improvements by @duttonw in #195
• Clean Datastore Tables Job by @JVickery-TBS in #196
• strip extra space for column name by @mutantsan in #210
• Skip empty lines instead of erroring by @ThrawnCA in #208
• add more options for maintainers to expedite XLoader runs, GitHub #202 by @ThrawnCA in #212
• Add Mixed Integers Type Guessing to NUMERIC Tests by @JVickery-TBS in #217
• PY2 & PY3 String/Binary Fixes by @JVickery-TBS in #203
• In plugin.py, there is an fix of resource format key error by @Nisha1293 in #209
• CKAN 2.11 support by @amercader in #220

New Contributors

• @JVickery-TBS made their first contribution in #198
• @duttonw made their first contribution in #195
• @mutantsan made their first contribution in #210
• @Nisha1293 made their first contribution in #209

Full Changelog: 1.0.1...1.1.0

1.0.1

Bugfix

• Include config_declaration.yaml into MANIFEST by @pdelboca in #183

Full Changelog: 1.0.0...1.0.1

1.0.0

What's Changed

• Fixed date parsing while fetching entries for task_status by @muhammed-ajmal in #179
• Drop support for old CKAN versions and add CSRF support by @pdelboca in #180
• Refactor test_jobs.py by @pdelboca in #181

New Contributors

• @muhammed-ajmal made their first contribution in #179

Full Changelog: 0.12.2...1.0.0

0.12.2

• Fix python-dateutil requirement for Python 2.7 support

See 0.12.0 for more relevant changes

0.12.0

What's Changed

• Cleanup from QGOV fork by @ThrawnCA in #166
• Limit duplicate builds by @ThrawnCA in #168
• wrap "Upload to DataStore" button in a block by @RabiaSajjad in #170
• Updated command in readme file by @shashigharti in #178
• Make datastore more robust, #171 by @ThrawnCA in #172
• Use tabulator instead of messytables by @bellisk in #175

New Contributors

• @shashigharti made their first contribution in #178
• @bellisk made their first contribution in #175

Full Changelog: 0.11.0...0.12.0

0.11.0

What's changed

• Minor bug fixes and maintainance
• Add BS5 support (aiming CKAN 2,10 release)
• Add support for future CKAN 2.10 release
• Possibility to use API Tokens for xloader authorization. Optional in 2.8 and 2.9, mandatory for 2.10

Full Change log: 0.10.0...0.11.0

0.10.0

What's Changed

• Fix error with session objects by @pdelboca in #142
• Enable file downloads to go through a proxy if needed by @ThrawnCA in #127

Full Changelog: 0.9.0...0.10.0