Learning Curves and Gradient Behavior

[HadiHammoud44]

Hello, thanks you for your work.
I have tried to run JEPA as is, with the same configuration, but using 2K samples from Kinetics dataset as a starting point. Subsequently, I plotted the losses (jepa and regression, although regression coeff was set to 0) along the global encoder and predictor norms. Below are the plots.

Are such plots familiar or normal?

[HadiHammoud44]

@MidoAssran