Skip to content

Commit

Permalink
Merge pull request #2233 from Inist-CNRS/refactor-query-openalex
Browse files Browse the repository at this point in the history
enable [oafetch] statement
  • Loading branch information
touv authored Nov 30, 2024
2 parents e402e01 + d127f6e commit e7e37ae
Show file tree
Hide file tree
Showing 4 changed files with 15 additions and 46 deletions.
6 changes: 3 additions & 3 deletions docker-compose.dev.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ services:
- .:/app
working_dir: /app
environment:
DEBUG: ${DEBUG:-ezs:*,-ezs:debug,-ezs:trace}
DEBUG: ${DEBUG:-ezs:*,-ezs:debug}
NODE_ENV: ${NODE_ENV}
NODE_OPTIONS: ${NODE_OPTIONS}
http_proxy: ${http_proxy}
Expand Down Expand Up @@ -45,6 +45,7 @@ services:

mongo:
image: mongo:4.4.24-focal
command: --quiet
ports:
- "27017:27017"

Expand All @@ -59,7 +60,7 @@ services:
- .:/app
working_dir: /app
environment:
DEBUG: ${DEBUG:-ezs:*,-ezs:debug,-ezs:trace}
DEBUG: ${DEBUG:-ezs:*,-ezs:debug}
NODE_ENV: ${NODE_ENV}
NODE_OPTIONS: ${NODE_OPTIONS}
http_proxy: ${http_proxy}
Expand All @@ -72,7 +73,6 @@ services:
EZS_CONTINUE_DELAY: '60'
EZS_NSHARDS: '31'
EZS_CACHE: 'false'
EZS_VERBOSE: 'true'
ports:
- "31976:31976"
command: npm run production:workers
Expand Down
16 changes: 8 additions & 8 deletions package-lock.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 2 additions & 2 deletions package.json
Original file line number Diff line number Diff line change
Expand Up @@ -76,8 +76,8 @@
"@emotion/styled": "11.6.0",
"@ezs/analytics": "2.3.4",
"@ezs/basics": "2.8.1",
"@ezs/conditor": "2.12.4",
"@ezs/core": "3.10.8",
"@ezs/conditor": "2.13.1",
"@ezs/core": "3.10.9",
"@ezs/istex": "1.5.10",
"@ezs/lodex": "file:./packages/ezsLodex",
"@ezs/sparql": "1.2.4",
Expand Down
35 changes: 2 additions & 33 deletions workers/loaders/query-openalex.ini
Original file line number Diff line number Diff line change
Expand Up @@ -48,40 +48,9 @@ value = env('per-page')
path = mailto
value = env('mailto')

path = cursor
value = *

[URLRequest]
[OAFetch]
timeout = 60000
url = env('url')

[loop]
test = has('meta.next_cursor')
; uses the one created by Lodex instead of the local ezs server fuse
fusible = env('fusible')

[loop/replace]
path = filter
value = env('query')

path = cursor
value = get('meta.next_cursor')

path = per-page
value = env('per-page')

[loop/URLRequest]
url = env('url')
timeout = 60000

[loop/drop]
path = meta.next_cursor

[exploding]
value = results

[exchange]
value = get('value')
retries = 1

# Add contextual metadata related to the import
[assign]
Expand Down

0 comments on commit e7e37ae

Please sign in to comment.