Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implementing Phoenix-side code to crawl documents using OTA engine #1177

Open
wants to merge 24 commits into
base: master
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
20f5890
starts implementation of engine
madoleary Apr 29, 2024
607a9f7
working implementation of request to node server
madoleary Sep 12, 2024
55d27c0
includes net::http implementation if preferred
madoleary Sep 12, 2024
68c76f8
implementation of node server in app - not working
madoleary Sep 12, 2024
f9ae228
disable Rack Attack
michielbdejong Sep 12, 2024
1f358f3
seed DocumentTypes
michielbdejong Sep 12, 2024
aa07b3d
schema changes in dev DO NOT MERGE
michielbdejong Sep 12, 2024
3c8467a
Document how to see document_types
michielbdejong Sep 12, 2024
90edfb4
Add ota server
michielbdejong Sep 13, 2024
d1345f8
image: pondersource/tosdr-ota:1.0
michielbdejong Sep 16, 2024
b7ed3a3
ota image v1.1
michielbdejong Sep 16, 2024
6eabba5
Use tosdr-ota:1.2
michielbdejong Sep 16, 2024
2f6d059
Ref https://pptr.dev/guides/docker#usage, fix #1175
michielbdejong Sep 16, 2024
b64841a
Use pondersource/tosdr-ota:1.3
michielbdejong Sep 18, 2024
03a8c08
manages ota env variables
madoleary Sep 18, 2024
9a4d482
makes flash errors more robust
madoleary Sep 18, 2024
90556a0
implements ota crawler functionality, error handling for relevant met…
madoleary Sep 18, 2024
667d48f
updates views to account for new ota crawler
madoleary Sep 18, 2024
37c8e09
removes outdated references to old crawlers
madoleary Sep 18, 2024
241bb7f
removes ota engine dependency -- no longer needed!
madoleary Sep 19, 2024
973f274
removes useless code
madoleary Sep 19, 2024
6712c79
removes yarn dependencies for ota engine
madoleary Sep 19, 2024
2d334b5
clarifies standard error
madoleary Sep 19, 2024
c1044f8
set url and selector for documents (#1185)
michielbdejong Sep 26, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Document how to see document_types
michielbdejong committed Sep 12, 2024
commit 3c8467adf6ee1e3d463d5fd30bad1a00fb75b07a
4 changes: 4 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -93,6 +93,10 @@ So,

5. Sign-in

6. To debug the db, try `docker exec -it db psql -U postgres`. Due to a bug in the seeds you will currently need to:
```
insert into document_types values (0, 'terms of service', now(), now(), null, 1, 'approved');
```
To **annotate** a service, navigate to the services page from the top-right menu, choose a service, and click `View Documents`. Begin by highlighting a piece of text from this page. **H and the Hypothesis client must be running.**

For a demonstration of how annotations work, feel free to [inspect the video attached to this PR](https://github.com/tosdr/edit.tosdr.org/pull/1116).