assert in url dedup

[jordane95]

datatrove/src/datatrove/pipeline/dedup/url_dedup.py

Lines 103 to 106 in b9fb72a

	# 0 will stay as is, so we can't use 0 as a priority
	assert all(
	sig[1] >= 1 and sig[1] <= priority_max for sig in signatures
	), f"priority must be between 1 and {priority_max}"

I do not understand why we cannot use 0 as priority. Actually in the function provided by the example script, some doc will have a priority of 0 if len < 4.

[guipenedo]

Didn't have time to look too in depth but I think the numbers in question are unsigned so priority 0 would come first when you flip

[hynky1999]

EDIT: Actually I think you are right, it should be fine if it's zero.