8 bit version of the optimizer

[DanFosing]

Is there any chance you will make an 8-bit version of the grokadamw optimizer?

[mtasic85]

This would be great feature. I already use this optimizer almost exclusively. However, sometimes when training on resource constrained environments, bnb-like 8bit implementation would be awesome.