Skip to content

Commit

Permalink
Merge pull request ARM-software#46 from ARM-software/transformer-tuto…
Browse files Browse the repository at this point in the history
…rials

Added transformers quantization guide
orly-arm authored Feb 23, 2022
2 parents 8595dc6 + f62636d commit 810d372
Showing 7 changed files with 6,652 additions and 0 deletions.
10 changes: 10 additions & 0 deletions tutorials/transformer_tutorials/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
# Transformer Tutorials

Jupiter notebooks showing how to quantise and compress toy transformer encoder and encoder-decoder models.

# Tutorials

* ViT_PCQAT.ipynb - Shows PCQAT using TFMOT for transformer encoder models.
* ViT_2x4-PQAT.ipynb - Shows new 2x4 pruning and QAT with TFMOT for transformer encoder models.
* translation.ipynb - Shows how to do QAT with TFMOT for encoder-decoder models.
* translation_PQAT.ipynb - Shows how to apply pruning & QAT with TFMOT for encoder-decoder models.
Loading

0 comments on commit 810d372

Please sign in to comment.