How to use hierbert.py for other datasets?

[monk1337]

Hi, I have a dataset with long documents, How I can use hierbert.py and How to preprocess the dataset for hierbert?

[iliaschalkidis]

Hi @monk1337, I think the easiest workaround is to modify one of either experiments/ecthr.py or experiments/scotus.py. Both rely on hierarchical BERT models, and have similar preprocessing functionalities, i.e., the input is 3D <batch_size, number_of_segments, number_of_tokens>, instead of 2D <batch_size, number_of_tokens>.