filter away urls that don't need harvesting on www.archivers.space/

[yenlow]

On www.archivers.space, we should filter away those urls that do not need harvesting. We’re duplicating a lot of efforts opening the link to find that it doesn’t need harvesting

[suchthis]

Can you expand on this comment? Were you finding URLs under the "HARVEST" tab in the pipeline app that did not need to be harvested?

http://www.archivers.space/urls?phase=harvest