This release marks a huge improvement in dealing with replicated parameters and automatic parameters synchronization. The Sharded
class has been made private and it's functions have been hidden by the modules' interfaces, making it easier to deal with.
Backwards compatibility with older version has been maintained with warnings notifying about changes in interfaces and deprecations.
What's Changed
- ZeRO-3 refactoring (sharding) by @BlackSamorez in #106
Full Changelog: v1.3.2...v2.0.0