Merge pull request #46 from coreweave/eta/serialization-optimization

perf(serialization): Optimize bulk serialization through concurrency
coreweave · Sep 9, 2023 · 1018750 · 1018750
2 parents 36910dc + a339d0c
commit 1018750
Show file tree

Hide file tree

Showing 4 changed files with 666 additions and 299 deletions.
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -7,9 +7,14 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## [Unreleased]
 
+### Changed
+
+- `TensorSerializer.write_module` has been optimized further for a speedup of
+  ~3.6x on CUDA modules and ~3.1x faster on CPU modules
+
 ### Fixed
 
-- `CURLStreamFile.response_headers` no longer has a chance to have incomplete
+- `CURLStreamFile.response_headers` no longer has a chance to contain incomplete
   header information
 
 ## [2.3.0] - 2023-09-06

diff --git a/tensorizer/_version.py b/tensorizer/_version.py
@@ -1 +1 @@
-__version__ = "2.3.1.dev0"
+__version__ = "2.3.1.dev1"
Original file line number	Diff line number	Diff line change
		@@ -1 +1 @@
		__version__ = "2.3.1.dev0"
		__version__ = "2.3.1.dev1"