finetuning problem with evfsam2

[vvvvvjdy]

Nice work of extending sams ability to text guidied!
We have used your evfsam1 as our baseline to a new area and showd a signifcant performance. However, when we finetuned your evfsam2, it was easy to overfiiting(didnt see in evfsam1).
Did you met the same prob when your fintune sam2 ? or some hyperpramters different from sam1?
Hope to recieve your suggestion!

[CoderZhangYx]

The main differences between sam1 and sam2 lie in:

1. pre-process: sam2 uses resize(1024), while sam1 uses resizelongest(1024) + padding.
2. sam2 uses hierachical image encoder and sam1 uses ViT
3. sam2 applies skip-connection to mask decoder.

Might these differences affect your training?