v24.12.1

What's Changed

Features

• [SCHEMATIC-193] Support exporting telemetry data from GH integration test runs by @BryanFauble in #1550
• [SCHEMATIC-30, SCHEMATIC-200] Add version to click cli / use pathlib.Path module for checking cache size by @thomasyu888 in #1542
• [SCHEMATIC-212] Prevent traces from being combined by @BryanFauble in #1552

Bugs

• [SCHEMATIC-163] Catch error when manifest is generated and existing one doesn't have entityId by @BWMac in #1551
• [SCHEMATIC-183] Use paths from file view for manifest generation by @GiaJordan in #1529
• [SCHEMATIC-214] Wrap pandas functions to support not including None with the NA values argument by @BryanFauble in #1553

Full Changelog: v24.11.2-rc...v24.12.1

v24.12.1-rc

What's Changed

Features

• [SCHEMATIC-193] Support exporting telemetry data from GH integration test runs by @BryanFauble in #1550
• [SCHEMATIC-30, SCHEMATIC-200] Add version to click cli / use pathlib.Path module for checking cache size by @thomasyu888 in #1542
• [SCHEMATIC-212] Prevent traces from being combined by @BryanFauble in #1552

Bugs

• [SCHEMATIC-163] Catch error when manifest is generated and existing one doesn't have entityId by @BWMac in #1551
• [SCHEMATIC-183] Use paths from file view for manifest generation by @GiaJordan in #1529
• [SCHEMATIC-214] Wrap pandas functions to support not including None with the NA values argument by @BryanFauble in #1553

Full Changelog: v24.11.2-rc...v24.12.1-rc

v24.11.2

What's Changed

• [SCHEMATIC-136] Include schematic_api to resolve dependency issue by @thomasyu888 in #1547

Full Changelog: v24.11.1...v24.11.2

v24.11.2-rc

What's Changed

• [SCHEMATIC-136] Include schematic_api to resolve dependency issue by @thomasyu888 in #1547

Full Changelog: v24.11.1-rc...v24.11.2-rc

See https://github.com/Sage-Bionetworks/schematic/releases/tag/v24.11.1 for more changes in the v24.11 release series

v24.11.1

NOTE: there is a bug with this release in the CLI

 schematic --help
Traceback (most recent call last):
  File "/Users/tyu/anaconda3/envs/schematic-testing/bin/schematic", line 5, in <module>
    from schematic.__main__ import main
  File "/Users/tyu/anaconda3/envs/schematic-testing/lib/python3.9/site-packages/schematic/__init__.py", line 23, in <module>
    from schematic_api.api.security_controller import info_from_bearer_auth
ModuleNotFoundError: No module named 'schematic_api'

What's Changed

FEATURES

• [FDS-2386] Synapse entity tracking and code concurrency updates by @BryanFauble in #1505
• Attach additional telemetry data to OTEL traces by @BryanFauble in #1519
• feat: added tracing for cross manifest validation and file name validation by @linglp in #1509
• [SCHEMATIC-126] Update file annotation store process to require filename be present i… by @BryanFauble in #1535

BUG FIXES

• [FDS-2506] Fix type Validation by @andrewelamb in #1526
• [SCHEMATIC-1] BugFix: manifest submission when data previously annotated without manifest upload by @GiaJordan in #1538

TECH DEBT

• Update CODEOWNERS by @andrewelamb in #1525
• Update CODEOWNERS and pin down trivy version by @thomasyu888 in #1531
• Fds 2333 validate attribute unit tests by @andrewelamb in #1517
• [FDS-2347] Add unit tests to DataModelValidator class by @andrewelamb in #1523
• [FDS-2466] Update references to schema location in config.yml by @jaymedina in #1522
• Updating contribution doc to expect squash and merge by @BryanFauble in #1534
• [FDS-2491] Integration tests for Schematic API Test plan by @BryanFauble in #1512
• [FDS-2500] Add Integration Tests for: Manifest Validation by @jaymedina in #1516
• [FDS-2449] Lock sphinx version and update poetry.lock by @jaymedina in #1530
• Update for integration test failures by @BryanFauble in #1537
• [FDS-2525] Authenticated export of telemetry data by @BryanFauble in #1527
• [FDS-2238, FDS-2236] Automate CLI test plan by @andrewelamb in #1528
• [SCHEMATIC-157] Make some dependencies required to avoid schematic CLI commands from potentially erroring when doing a pip install by @thomasyu888 in #1540

Full Changelog: v24.10.2...v24.11.1

v24.11.1-rc

What's Changed

FEATURES

• [FDS-2386] Synapse entity tracking and code concurrency updates by @BryanFauble in #1505
• Attach additional telemetry data to OTEL traces by @BryanFauble in #1519
• feat: added tracing for cross manifest validation and file name validation by @linglp in #1509
• [SCHEMATIC-126] Update file annotation store process to require filename be present i… by @BryanFauble in #1535

BUG FIXES

• [FDS-2506] Fix type Validation by @andrewelamb in #1526
• [SCHEMATIC-1] BugFix: manifest submission when data previously annotated without manifest upload by @GiaJordan in #1538

TECH DEBT

• Update CODEOWNERS by @andrewelamb in #1525
• Update CODEOWNERS and pin down trivy version by @thomasyu888 in #1531
• Fds 2333 validate attribute unit tests by @andrewelamb in #1517
• [FDS-2347] Add unit tests to DataModelValidator class by @andrewelamb in #1523
• [FDS-2466] Update references to schema location in config.yml by @jaymedina in #1522
• Updating contribution doc to expect squash and merge by @BryanFauble in #1534
• [FDS-2491] Integration tests for Schematic API Test plan by @BryanFauble in #1512
• [FDS-2500] Add Integration Tests for: Manifest Validation by @jaymedina in #1516
• [FDS-2449] Lock sphinx version and update poetry.lock by @jaymedina in #1530
• Update for integration test failures by @BryanFauble in #1537
• [FDS-2525] Authenticated export of telemetry data by @BryanFauble in #1527
• [FDS-2238, FDS-2236] Automate CLI test plan by @andrewelamb in #1528
• [SCHEMATIC-157] Make some dependencies required to avoid schematic CLI commands from potentially erroring when doing a pip install by @thomasyu888 in #1540

Full Changelog: v24.10.2...v24.11.1-rc

v24.10.2

What's Changed

FEATURES

• feat: set annotations in an async way when submitting a manifest -- new changes added by @linglp in #1452
• Feature: filenameExists Validation Rule by @GiaJordan in #1456
• feat: added mermaid diagrams for some functions in ManifestGenerator by @linglp in #1463

BUG FIXES

• fix: updated schematic installation instructions by @linglp in #1462
• fix: check existing great expectation suite before adding a new one by @linglp in #1458
• [FDS-2294] Prevent including project name twice in walked path by @BryanFauble in #1474
• Bugfix: async tests skipped during regular testing runs by @GiaJordan in #1479
• fix: updated test after updating to synapse python client 4.4.0 and updated test after test resources get updated on synapse by @linglp in #1471
• fix: added unit test for get_node_validation_rules function by @linglp in #1483
• fix: update artifact to v4 by @linglp in #1500
• [FDS-2415] Fixes pytest CI Python Versions by @BWMac in #1502
• [FDS-2415] Fixes pdoc Workflow by @BWMac in #1503
• fix: call get_node_validation_rules with appropriate parameters when storing annotations by @GiaJordan in #1478
• Fixes failing pdoc deployment by @BWMac in #1504
• update how annotations are accessed by @GiaJordan in #1485
• Fix: remove caching poetry dependencies in CI workfows by @linglp in #1507

TECH DEBT

• feat/technical debt: added trivy code scan to schematic repo by @linglp in #1448
• Enable google credentials tests by @GiaJordan in #1459
• update synapse login functionality by @GiaJordan in #1465
• update python client to 4.4.0 by @andrewelamb in #1468
• [FDS-2127] Update URL validation to use requests.options to verify connectivity by @BryanFauble in #1472
• [FDS-2294] Run schematic_api tests by @BryanFauble in #1476
• add csv data model to unit tests by @lakikowolfe in #1464
• Revert "add csv data model to unit tests" by @andrewelamb in #1488
• Added unit tests for validate attribute class by @andrewelamb in #1486
• Update existing file paths in manifests at generation to conform to new convention by @GiaJordan in #1467
• [FDS-2373] Update jwt verification by @BryanFauble in #1493
• [FDS-2373] Remove the need to do version checking on Synapse creation by @BryanFauble in #1495
• Change how dataset to validate against is specified for filenameExists rule by @GiaJordan in #1491
• [FDS-305] Prevent shared snypase resources during integration tests by @BryanFauble in #1482
• [FDS-2383] Update to run integration tests on default runner with python 3.10 by @BryanFauble in #1498
• FDS-2403 Add Codeowners file by @andrewelamb in #1501
• [FDS-1725] Missing entityId handling testing by @BWMac in #1496
• [FDS-2502] Walk back up directory tree to get location in project by @BryanFauble in #1518
• [FDS-2497] Wrap google API execute calls with a 5 attempt retry by @BryanFauble in #1513
• [FDS-2218] Update the README by @jaymedina in #1510

---

• Schematic v24.10.1 by @lakikowolfe in #1514
• v24.10.2 by @lakikowolfe in #1520

New Contributors

• @jaymedina made their first contribution in #1510

Full Changelog: v24.7.2...v24.10.2

v24.7.2

What's Changed

Bug Fixes:

• fix: used environment variable to control tracing which allows tracing to be off during pytest run and normal API run by @linglp in #1455
• fix: install patch version of synapse python client by @linglp in #1457
• v24.7.2 release by @lakikowolfe in #1461

Full Changelog: v24.7.1...v24.7.2

v24.7.1

Features

• Automatically save the JSON Validation schema by @mialy-defelice in #1415
• feat: surfaced schematic exceptions in flask APIs by @linglp in #1438
• feat: added tracing to schematic code base for manifest generate and manifest submission by @linglp in #1430

Bug Fixes

• Bugfix: FDS-1686 test manifest being changed by @andrewelamb in #1412
• BugFix: Manifest version increment by @GiaJordan in #1435
• BugFix: Files no longer added to records based manifests by @GiaJordan in #1447

Technical Debt

• Develop FDS 243 mypy schema module by @andrewelamb in #1416
• added pydantic to toml file by @andrewelamb in #1419
• update pandas and numpy by @andrewelamb in #1421
• FDS-511 removed typing extensions lock by @andrewelamb in #1432
• technical debt: Remove service_acct_creds_synapse_id from schematic config by @linglp in #1436
• Add maintainers and version info to AWS Docker image by @GiaJordan in #1437
• technical debt: run black for schematic api and test and modify pre-commit by @linglp in #1442
• technical debt: added unit test for changeFileMetaData function by @linglp in #1444
• fix: added black compatibility to isort by @linglp in #1453
• technical debt: added isort to pre-commit hook in schematic repo by @linglp in #1441

Full Changelog: v24.5.1...v24.7.1

v24.5.1

Bug Fix

• BugFix: JSON Schema Validation Issues by @mialy-defelice in #1420
• technical debt: remove release.md from repo by @linglp in #1426
• Bug Fix: Fix failing test to conform to data model updates by @mialy-defelice in #1428

Full Changelog: v24.4.1...v24.5.1