Fides Module #1073

d-strat · 2024-11-19T20:24:10Z

Fixes Issue

Changes proposed

Adding Fides Module, based on previous work of LukasForst. Updating, rewriting and enriching the base code.

Steps you followed to test the changes purposed in this PR:

Running Slips on test file with Fides Module in place
Tests for Fides Modules part
Tests for whole Fides Module

Check List (Check all the applicable boxes)

My code follows the code style of this project.
My change requires changes to the documentation.
I have updated the documentation accordingly.
All new and existing tests passed.
This PR does not contain plagiarized content.
The title of my pull request is a short description of the requested changes.

Screenshots

Note to reviewers

Last update from stratosphereips (around Nov 15) passed the CI/CD pipelines.

…eep progress and have a fresh start

…wledge of pubsub.

…target.

…ase design.

… to many ServiceHistory.

…ganize code.

…recovery (after losing Redis data)

…eers that are members of organisations specified on input.

modules/fidesModule/persistence/sqlite_db.py

tests/integration_tests/test_fides.py

…ate files in the output dir

…sponse

…tween tests

d-strat · 2025-02-05T08:34:12Z

All of the requests from Slack and above were fulfilled, and all tests are working (some were fixed, and all were kept). From my point of view, the Fides Module is ready.

…ey run in parallel in CI

…nce they run in parallel in CI

AlyaGomaa · 2025-02-05T13:14:19Z

wohoooo thankssss @d-strat for all the hard work! 🚀

d-strat added 30 commits October 3, 2024 11:26

Merge modules/FidesModule from David-enhance-fides-module branch to k…

f440c84

…eep progress and have a fresh start

Let go, PyCharm knows

422e43f

Trust Databases are now running.

550c453

Add all Fides' channels and save progress before implementing new kno…

2ccc87e

…wledge of pubsub.

Fix Hardcoded path and update gitignore.

79e6ceb

Import Changes made during Alya/David meeting.

cd47da7

Fix messaging queues or leave them out wherever possible

8be78bc

Cleanup channels and test prints

05bebf7

Delete outdated codestück

a0878cf

Fix and update fides module logger to fit current slips.

c93f218

Fix typo in original redis wrapper.

e9820c2

Create files and prepare for database implementation.

35eafc0

Implement SlipsThreatIntelligenceDatabase, class to get Fides' TI by …

134ef64

…target.

Update peer to make it possible to use json.dump on it

57d20c6

Implement storing and retrieving connected P2P peers.

dcf4666

Delete obsolete messaging interface code

472a027

Implement storing and retrieving trust data to and from redis database.

8fc2a6a

Implement caching of threat intelligence.

69aecb2

Implement base for SQLite database.

8fb0228

Implement dictionary conversions.

b9d3c45

Fix time

f365ab0

Add dictionary conversions to recommendation_history.py.

f3bf240

Add sqldatabase to trust.py

40d230f

Write table creation to p2p SQL database.

5325a61

Add PeerTrustData table to store corresponding datatype, finish datab…

5bfd291

…ase design.

Fix database design, PeerTrustData 1 to many RecommendationHistory, 1…

2748678

… to many ServiceHistory.

Add missing function to template

e902d80

Improve storage of PeerInfo list with different use cases in mind. Or…

a8d55a8

…ganize code.

Implement connected peers backing up in a SQLite database as well as …

7b1bd94

…recovery (after losing Redis data)

Implement get_peers_with_organisations, functions that gets list of p…

06dc8df

…eers that are members of organisations specified on input.

d-strat and others added 8 commits December 26, 2024 11:05

Updating gitignore and docks (minor)

5d73aa3

Fix fides module (manual integration testing using debugging)

185b396

Fixing fides module second test

3481344

Update Fides documentation, add messaging support to programmers notes

efd594a

update branch with the latest develop

fadab65

evidencehandler.py: remove debugging print

7353359

run test_fides in CI

f81fac4

fides: change how new alerts are handled

3ff105f

AlyaGomaa requested changes Jan 8, 2025

View reviewed changes

d-strat and others added 11 commits January 10, 2025 14:09

FIx database deleting itself

3b4cf40

Write description for the test_trust_recommendation_response test

920dc97

Sort out Redis client duplicity

1d687af

Clear debugging and testing and development code

ab1efdd

test_fides: test test_trust_recommendation_response's abillity to cre…

c91022a

…ate files in the output dir

test_fides: remove debugging prints from test_trust_recommendation_re…

6f8be5f

…sponse

Ensure compatibility with Iris

f8dfd79

Fix channel

dfb83db

Integration test for network recommendation response fixed

f6b64d7

Fixed integration tests for Fides Module, note: close Slips' Redis be…

b830223

…tween tests

Merge from stratosphereips - Slips/develop

e7486da

AlyaGomaa and others added 7 commits February 5, 2025 14:04

add test_fides.py to CI integration tests

3c21455

move technical details from fides_module.md to contributing.md

2f09c7c

test_fides.py: use different ports for the integration tests since th…

12a5d4e

…ey run in parallel in CI

test_fides.py: use different output dirs for the integration tests si…

fcad2a6

…nce they run in parallel in CI

fides_module.md: move technical details to contributing.md

c2f06b3

Update Fides Module documentation regarding logging

5189f66

Merge remote-tracking branch 'origin/develop' into develop

dcb3baa

AlyaGomaa merged commit e8d5810 into stratosphereips:develop Feb 5, 2025
67 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fides Module #1073

Fides Module #1073

d-strat commented Nov 19, 2024 •

edited

Loading

d-strat commented Feb 5, 2025

AlyaGomaa commented Feb 5, 2025

Fides Module #1073

Fides Module #1073

Conversation

d-strat commented Nov 19, 2024 • edited Loading

Fixes Issue

Changes proposed

Steps you followed to test the changes purposed in this PR:

Check List (Check all the applicable boxes)

Screenshots

Note to reviewers

d-strat commented Feb 5, 2025

AlyaGomaa commented Feb 5, 2025

d-strat commented Nov 19, 2024 •

edited

Loading