Avoid the GC for nmod_mat (zzModMat, fpMatrix)

Avoid the GC for nmod_mat (zzModMat, fpMatrix) #2571