Added transformers quantization guide

lflyme · Feb 23, 2022 · f62636d · f62636d
1 parent 8595dc6
commit f62636d
Show file tree

Hide file tree

Showing 7 changed files with 6,652 additions and 0 deletions.
diff --git a/tutorials/transformer_tutorials/README.md b/tutorials/transformer_tutorials/README.md
@@ -0,0 +1,10 @@
+# Transformer Tutorials
+
+Jupiter notebooks showing how to quantise and compress toy transformer encoder and encoder-decoder models.
+
+# Tutorials
+
+* ViT_PCQAT.ipynb - Shows PCQAT using TFMOT for transformer encoder models.
+* ViT_2x4-PQAT.ipynb - Shows new 2x4 pruning and QAT with TFMOT for transformer encoder models.
+* translation.ipynb - Shows how to do QAT with TFMOT for encoder-decoder models.
+* translation_PQAT.ipynb -  Shows how to apply pruning & QAT with TFMOT for encoder-decoder models.