Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: merge develop into master #167

Merged
merged 58 commits into from
Feb 13, 2025
Merged

chore: merge develop into master #167

merged 58 commits into from
Feb 13, 2025

Conversation

nortaljevgenikr
Copy link
Contributor

Refs: OPMONDEV-190

melbeltagy and others added 30 commits September 20, 2024 14:17
chore: Merge master commits into develop
chore: Update dependencies to latest versions compatible with python 3.8

Refs: OPMONDEV-187
… timeout

Corrector marks documents as orphans if either the client or producer part is missing after the configured amount of time.

But sometimes the second part of the metrics arrives after the document was marked as "done". In that case, the corrector incorrectly adds a second document for the same "xRequestId" value into clean data.

This commit addresses this issue by updating the existing document instead of adding a duplicate.

The value of "correctorTime" however is not updated to avoid the anonymizer from processing the updated document again and inserting a duplicate into opendata.
…py3.9

chore: Ignore dependencies that require python >= 3.9 from dependabot
…ith 3 updates

Bumps the python-minor-patch group with 3 updates in the /anonymizer_module directory: [setuptools](https://github.com/pypa/setuptools), [pymongo](https://github.com/mongodb/mongo-python-driver) and [psycopg2](https://github.com/psycopg/psycopg2).
Bumps the python-minor-patch group with 2 updates in the /collector_module directory: [setuptools](https://github.com/pypa/setuptools) and [pymongo](https://github.com/mongodb/mongo-python-driver).
Bumps the python-minor-patch group with 2 updates in the /corrector_module directory: [setuptools](https://github.com/pypa/setuptools) and [pymongo](https://github.com/mongodb/mongo-python-driver).
Bumps the python-minor-patch group with 3 updates in the /opendata_module directory: [setuptools](https://github.com/pypa/setuptools), [pymongo](https://github.com/mongodb/mongo-python-driver) and [psycopg2](https://github.com/psycopg/psycopg2).
Bumps the python-minor-patch group with 1 update in the /reports_module directory: [pymongo](https://github.com/mongodb/mongo-python-driver).


Updates `setuptools` from 75.1.0 to 75.2.0
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](pypa/setuptools@v75.1.0...v75.2.0)

Updates `pymongo` from 4.9.1 to 4.10.1
- [Release notes](https://github.com/mongodb/mongo-python-driver/releases)
- [Changelog](https://github.com/mongodb/mongo-python-driver/blob/master/doc/changelog.rst)
- [Commits](mongodb/mongo-python-driver@4.9.1...4.10.1)

Updates `psycopg2` from 2.9.9 to 2.9.10
- [Changelog](https://github.com/psycopg/psycopg2/blob/master/NEWS)
- [Commits](https://github.com/psycopg/psycopg2/commits)

Updates `setuptools` from 75.1.0 to 75.2.0
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](pypa/setuptools@v75.1.0...v75.2.0)

Updates `pymongo` from 4.9.1 to 4.10.1
- [Release notes](https://github.com/mongodb/mongo-python-driver/releases)
- [Changelog](https://github.com/mongodb/mongo-python-driver/blob/master/doc/changelog.rst)
- [Commits](mongodb/mongo-python-driver@4.9.1...4.10.1)

Updates `setuptools` from 75.1.0 to 75.2.0
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](pypa/setuptools@v75.1.0...v75.2.0)

Updates `pymongo` from 4.9.1 to 4.10.1
- [Release notes](https://github.com/mongodb/mongo-python-driver/releases)
- [Changelog](https://github.com/mongodb/mongo-python-driver/blob/master/doc/changelog.rst)
- [Commits](mongodb/mongo-python-driver@4.9.1...4.10.1)

Updates `setuptools` from 75.1.0 to 75.2.0
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](pypa/setuptools@v75.1.0...v75.2.0)

Updates `pymongo` from 4.9.1 to 4.10.1
- [Release notes](https://github.com/mongodb/mongo-python-driver/releases)
- [Changelog](https://github.com/mongodb/mongo-python-driver/blob/master/doc/changelog.rst)
- [Commits](mongodb/mongo-python-driver@4.9.1...4.10.1)

Updates `psycopg2` from 2.9.9 to 2.9.10
- [Changelog](https://github.com/psycopg/psycopg2/blob/master/NEWS)
- [Commits](https://github.com/psycopg/psycopg2/commits)

Updates `pymongo` from 4.9.1 to 4.10.1
- [Release notes](https://github.com/mongodb/mongo-python-driver/releases)
- [Changelog](https://github.com/mongodb/mongo-python-driver/blob/master/doc/changelog.rst)
- [Commits](mongodb/mongo-python-driver@4.9.1...4.10.1)

---
updated-dependencies:
- dependency-name: setuptools
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: pymongo
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: psycopg2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: python-minor-patch
- dependency-name: setuptools
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: pymongo
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: setuptools
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: pymongo
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: setuptools
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: pymongo
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
- dependency-name: psycopg2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: python-minor-patch
- dependency-name: pymongo
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: python-minor-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
…py3.9-part2

chore: Ignore dependencies that require python >= 3.9 from dependabot
…py3.9-part3

chore: Ignore dependencies that require python >= 3.9 from dependabot
…143)

* fix: Fix opendata module's create_users tests

* fix: Fix opendata module's create_users pycodestyle
* chore: remove unnecessary test-dependency (pymongo-stubs)
* chore: add typehint to fix mypy errors in anonymizer module

Refs: OPMONDEV-187
… and use the same version of Django declared as dependency in tests (#142)

* chore: Drop legacy support for Django 2.x in tests
* chore: Use Django version declared in requirements in tests too

Refs: OPMONDEV-187
* style: Use ruff for code linter and generate html reports for test results
* chore: Exclude F401 checks from Django related files
* chore: Remove unused imports
* chore: Remove unnecessary string formatting
* fix: Fix PR's review comments
* feat: Switch from pycodestyle to ruff as a linter
* fix: Fix errors after switching to ruff
* feat: Update run_tests.sh command to use ruff and run tests
* fix: Fix collector module failed type checks
* fix: Fix opendata module
…yf-version

fix: Freeze pydyf's version in dependencies to fix reports during runtime
chore: Update "make clean" command to clean test_results.xml and related htmlcov folder
chore: Add "make license" command to automate adding license headers to all source code, and update headers for all files

Refs: OPMONDEV-187
fix: Add missing make license command in anonymizer module
melbeltagy and others added 20 commits November 25, 2024 01:58
* docs: Add Developer's Guide documentation

Refs: OPMONDEV-187
…lds are missing and add them for the anonymizer module

implemented logic that patches DB table structure

refs: OPMONDEV-189
chore: Remove sensitive info from path variables from consumer messages
feat: as a Metrics User I want the database migration to check if fields are missing and add them for the anonymizer module
- Update path excludes.
- Remove Maven-specific scope excludes.
Bumps the python-major group with 1 update in the /opendata_module directory: [django](https://github.com/django/django).


Updates `django` from 3.2.20 to 4.2.18
- [Commits](django/django@3.2.20...4.2.18)

---
updated-dependencies:
- dependency-name: django
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: python-major
...

Signed-off-by: dependabot[bot] <[email protected]>
…_module/python-major-caf2883180

chore(deps): bump django from 3.2.20 to 4.2.18 in /opendata_module in the python-major group across 1 directory
* feat: Prepare opendata_collector_module for release

fix type checking error
bump vcrpy test requirement
enable od-collector tests for github actions
bump lib versions
fix cron example
fail under 60pct of coverage
enable dependabot for opendata_collector_module

refs: OPMONDEV-191
…ow_vcrpy7

chore: ignore dependencies by dependabot; bump some dependency versions
Refs: OPMONDEV-190
chore: dependabot ignore pymongo >= 4.11 because of python >= 3.9
Bumps the python-minor-patch group with 1 update in the /opendata_module directory: [django](https://github.com/django/django).


Updates `django` from 4.2.18 to 4.2.19
- [Commits](django/django@4.2.18...4.2.19)

---
updated-dependencies:
- dependency-name: django
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: python-minor-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Copy link
Contributor

@raits raits left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me, lets include the password PR as well (#170) before merging.

nortaljevgenikr and others added 6 commits February 10, 2025 09:08
…_module/python-minor-patch-05eff48d5f

chore(deps): bump django from 4.2.18 to 4.2.19 in /opendata_module in the python-minor-patch group across 1 directory
…ckslash

fix: exclude backslashes from initially generated passwords
…logs_json

fix: Fix JSON structure returned by 'daily_logs' endpoint
@nortaljevgenikr
Copy link
Contributor Author

#171 included as well

@nortaljevgenikr nortaljevgenikr merged commit 6f8402c into master Feb 13, 2025
12 of 13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants