Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HJ-87 and HJ-88: model changes #5600

Merged
merged 51 commits into from
Jan 22, 2025
Merged

Conversation

thingscouldbeworse
Copy link
Contributor

Prereq migration and model change for HJ-87 & HJ-88

Description Of Changes

Write some things here about the changes and any potential caveats

Code Changes

  • list your code changes here

Steps to Confirm

  1. list any manual steps for reviewers to confirm the changes

Pre-Merge Checklist

  • Issue requirements met
  • All CI pipelines succeeded
  • CHANGELOG.md updated
  • Followup issues:
    • Followup issues created (include link)
    • No followup issues
  • Database migrations:
    • Ensure that your downrev is up to date with the latest revision on main
    • Ensure that your downgrade() migration is correct and works
      • If a downgrade migration is not possible for this change, please call this out in the PR description!
    • No migrations
  • Documentation:
    • Documentation complete, PR opened in fidesdocs
    • Documentation issue created in fidesdocs
    • If there are any new client scopes created as part of the pull request, remember to update public-facing documentation that references our scope registry
    • No documentation updates required

Copy link

vercel bot commented Dec 12, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
fides-plus-nightly ⬜️ Ignored (Inspect) Visit Preview Jan 22, 2025 6:22pm

Copy link

cypress bot commented Dec 12, 2024

fides    Run #11911

Run Properties:  status check failed Failed #11911  •  git commit 224c6b00d5 ℹ️: Merge 8ef15820d06872df8e9c0df44043ff1b39aa6cf0 into bbba31d7fe61655665653fea2b88...
Project fides
Branch Review refs/pull/5600/merge
Run status status check failed Failed #11911
Run duration 01m 05s
Commit git commit 224c6b00d5 ℹ️: Merge 8ef15820d06872df8e9c0df44043ff1b39aa6cf0 into bbba31d7fe61655665653fea2b88...
Committer Kirk Hardy
View all properties for this run ↗︎

Test results
Tests that failed  Failures 1
Tests that were flaky  Flaky 0
Tests that did not run due to a developer annotating a test with .skip  Pending 0
Tests that did not run due to a failure in a mocha hook  Skipped 0
Tests that passed  Passing 3
⚠️ You've recorded test results over your free plan limit.
Upgrade your plan to view test results.
View all changes introduced in this branch ↗︎

Tests for review

Copy link

codecov bot commented Dec 13, 2024

Codecov Report

Attention: Patch coverage is 95.23810% with 1 line in your changes missing coverage. Please review.

Project coverage is 87.14%. Comparing base (bbba31d) to head (8ef1582).
Report is 1 commits behind head on main.

Files with missing lines Patch % Lines
src/fides/api/models/detection_discovery.py 91.66% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@           Coverage Diff           @@
##             main    #5600   +/-   ##
=======================================
  Coverage   87.14%   87.14%           
=======================================
  Files         388      388           
  Lines       24034    24050   +16     
  Branches     2594     2595    +1     
=======================================
+ Hits        20944    20959   +15     
  Misses       2529     2529           
- Partials      561      562    +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

@adamsachs adamsachs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

generally looks solid but there are a few points that need cleanup i think

Copy link
Contributor

@adamsachs adamsachs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok thanks for making the requested updates! this is looking good, just a few minor nits that'd be nice to get addressed if you can.

separately, there seems to be a test failure? it seems unlikely to me that it'd b caused by your changes, but i don't see it on main in the past few commits. maybe it'll go away with merging main in?

and last note is just to keep an eye on the downrev in your migration. i know there's at least one other in-flight PR that updates our migrations, so if it gets merged before yours, you'll just have to remember to bump your downrev to the new head

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: i'd probably update the filename here just to be consistent with the new functionality - it can be hard to track down migrations sometimes and relying on the filename can help with looking it up, so this could add a bit of confusion moving forward!

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

changed in 61f38a4#diff-6ea847dd5dab7785c69f11369a07c894290e837501325a3b8eb5f003059c33ea and made sure column isn't pluralized in the comment

CHANGELOG.md Outdated
@@ -21,6 +21,7 @@ The types of changes are:
- New page in the Cookie House sample app to demonstrate the use of embedding the FidesJS SDK on the page [#5564](https://github.com/ethyca/fides/pull/5564)
- Added event based communication example to the Cookie House sample app [#5597](https://github.com/ethyca/fides/pull/5597)
- Added new erasure tests for BigQuery Enterprise [#5554](https://github.com/ethyca/fides/pull/5554)
- Migration to add the `hidden` and `data_use` columns to `stagedresource` table, prereqs for Data Catalog work in Fidesplus [#5600](https://github.com/ethyca/fides/pull/5600/)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit

Suggested change
- Migration to add the `hidden` and `data_use` columns to `stagedresource` table, prereqs for Data Catalog work in Fidesplus [#5600](https://github.com/ethyca/fides/pull/5600/)
- Migration to add the and `data_use` column to `stagedresource` table, prereq for Data Catalog work in Fidesplus [#5600](https://github.com/ethyca/fides/pull/5600/)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@@ -273,6 +274,26 @@ def test_patch_connection_secrets_removes_access_token_for_client_config(
assert resp.status_code == HTTP_200_OK
assert resp.json()["items"][0]["authorized"] is False

def test_system_patch_hidden(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it'd be nice for this test to assert that the updates are actually reflected in the db! there have been many times where an endpoint gives a 200 and the correct response body but it doesn't actually make the intended change to the db :)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@adamsachs adamsachs mentioned this pull request Dec 17, 2024
13 tasks
@jpople jpople mentioned this pull request Jan 13, 2025
13 tasks
@thingscouldbeworse thingscouldbeworse merged commit abbb24e into main Jan 22, 2025
36 of 39 checks passed
@thingscouldbeworse thingscouldbeworse deleted the HJ-88-87_model-changes branch January 22, 2025 19:28
Copy link

cypress bot commented Jan 22, 2025

fides    Run #11913

Run Properties:  status check passed Passed #11913  •  git commit abbb24e8d4: HJ-87 and HJ-88: model changes (#5600)
Project fides
Branch Review main
Run status status check passed Passed #11913
Run duration 00m 55s
Commit git commit abbb24e8d4: HJ-87 and HJ-88: model changes (#5600)
Committer Kirk Hardy
View all properties for this run ↗︎

Test results
Tests that failed  Failures 0
Tests that were flaky  Flaky 0
Tests that did not run due to a developer annotating a test with .skip  Pending 0
Tests that did not run due to a failure in a mocha hook  Skipped 0
Tests that passed  Passing 4
⚠️ You've recorded test results over your free plan limit.
Upgrade your plan to view test results.
View all changes introduced in this branch ↗︎

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants