find_unused_parameters

[zeydabadi]

Hi,

I wonder if setting find_unused_parameters=False in the DDP constructor is safe to avoid unnecessary computation and improve performance.
Please advise.

Thank you

[935963004]

Since some parameter names are different in the public checkpoint from the code, so find_unused_parameters should be True if you are using the public checkpoint. In our case, unnecessary computation is minor and can be ignored.