Replies: 1 comment 1 reply
-
|
It will be fine as long as the target site doesn't block you. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Great. Will PR soon. |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi, I'm recently working on a transform/sitemap's
sitemapindexprotocol support.For example, CNN's Sitemap Index is the case. This index contains multiple sitemaps. To build RSS of sitemaps' URLs, it needs to crawl the multiple URLs again.
I'm not sure if this is okay or not. Do you have any policy for this kind of pattern?
My current WIP code is here.
Beta Was this translation helpful? Give feedback.
All reactions