Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Prefetch block and txs in historical processing instead of fetching them in events processing #460

Merged
merged 6 commits into from
Nov 9, 2023
Merged

Prefetch block and txs in historical processing instead of fetching them in events processing #460

merged 6 commits into from
Nov 9, 2023

Conversation

nikugogoi
Copy link
Collaborator

@nikugogoi nikugogoi commented Nov 9, 2023 •
edited
Loading

Part of Block processing optimizations

  • Use ethersjs StaticJsonRpcProvider to avoid getNetwork calls
  • Set gzip to true for network requests in ethersjs
  • Prefetch required block and txs in historical processing and cache in memory for events processing
  • TODOs to be fulfilled in follow-on PRs:
    • Use prefetched block data in subgraph block handler (not configured in sushiswap v3 subgraph)

@nikugogoi nikugogoi self-assigned this Nov 9, 2023
@nikugogoi nikugogoi changed the title [WIP] Prefetch block and txs in historical processing instead of fetching them in events processing Prefetch block and txs in historical processing instead of fetching them in events processing Nov 9, 2023
@ashwinphatak ashwinphatak merged commit 6957239 into main Nov 9, 2023
2 checks passed
@ashwinphatak ashwinphatak deleted the ng-perf-improv branch November 9, 2023 13:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@nikugogoi nikugogoi

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@nikugogoi @ashwinphatak