Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

segmentation of ingestion on mirroring #264

Open
willscott opened this issue Aug 18, 2022 · 3 comments
Open

segmentation of ingestion on mirroring #264

willscott opened this issue Aug 18, 2022 · 3 comments

Comments

@willscott
Copy link
Member

mirroring does not currently chunk at 5000-advertisement chunks
@willscott
Copy link
Member Author

would be god to have a sense of the distance between latest known ad and what we've most recently processed

@masih
Copy link
Member

masih commented Aug 18, 2022

Move issue to index-provider since mirroring implementation is in that repo?

@willscott willscott transferred this issue from ipni/storetheindex Aug 18, 2022
@gammazero
Copy link
Collaborator

would be god to have a sense of the distance between latest known ad and what we've most recently processed

This can be accomplished using the ipni-cli, using the provider command with the --distance flag. It calculates the distance from the last seen advertisement to the provider's current head advertisement

ipni provider -i https://cid.contact -pid 12D3KooWKdbrF5ynUDa19nWPtpGNSgWj33py11p1C2w4zvuFptTT --distance

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@masih @willscott @gammazero