Code

HIGGS Quantization Support#34997

Code

Merged

SunMarc merged 45 commits intohuggingface:mainhuggingface/transformers:mainfrom BlackSamorez:mainBlackSamorez/transformers:mainCopy head branch name to clipboardDec 23, 2024

+1,249

Commits

Commits on Nov 27, 2024

• higgs init

  BlackSamorez

  committed
  08b347c

  Copy full SHA for 08b347c

• working with crunches

  BlackSamorez

  committed
  14a0c82

  Copy full SHA for 14a0c82

Commits on Nov 28, 2024

• per-model workspaces

  BlackSamorez

  committed
  1c5b9e7

  Copy full SHA for 1c5b9e7

• style

  BlackSamorez

  committed
  9f2ef77

  Copy full SHA for 9f2ef77

• style 2

  BlackSamorez

  committed
  0ff58c3

  Copy full SHA for 0ff58c3

• Merge branch 'huggingface:main' into main

  BlackSamorez

  authored
  2e9adc6

  Copy full SHA for 2e9adc6

• tests and style

  BlackSamorez

  committed
  b6bad71

  Copy full SHA for b6bad71

• higgs tests passing

  BlackSamorez

  committed
  c2bcf39

  Copy full SHA for c2bcf39

• protecting torch import

  BlackSamorez

  committed
  a1e7b35

  Copy full SHA for a1e7b35

• removed torch.Tensor type annotations

  BlackSamorez

  committed
  8f1a0a6

  Copy full SHA for 8f1a0a6

• torch.nn.Module inheritance fix maybe

  BlackSamorez

  committed
  120f360

  Copy full SHA for 120f360

• hide inputs inside quantizer calls

  BlackSamorez

  committed
  fdb71a5

  Copy full SHA for fdb71a5

• style structure something

  BlackSamorez

  committed
  127c5f0

  Copy full SHA for 127c5f0

• Merge branch 'main' into main

  BlackSamorez

  authored
  947a53d

  Copy full SHA for 947a53d

• Merge branch 'main' into main

  BlackSamorez

  authored
  e6ddc41

  Copy full SHA for e6ddc41

• Update src/transformers/quantizers/quantizer_higgs.py

  Show description for 0de97f1
  

  BlackSamorez

  and

  SunMarc

  authored
  0de97f1

  Copy full SHA for 0de97f1

• reworked num_sms

  BlackSamorez

  committed
  1f08cb0

  Copy full SHA for 1f08cb0

• Merge branch 'main' of github.com:BlackSamorez/transformers

  BlackSamorez

  committed
  ed369be

  Copy full SHA for ed369be

• Update src/transformers/integrations/higgs.py

  Show description for 96023ab
  

  BlackSamorez

  and

  SunMarc

  authored
  96023ab

  Copy full SHA for 96023ab

Commits on Nov 29, 2024

• revamped device checks

  BlackSamorez

  committed
  60ce44b

  Copy full SHA for 60ce44b

• docstring upd

  BlackSamorez

  committed
  8142443

  Copy full SHA for 8142443

• Update src/transformers/quantizers/quantizer_higgs.py

  Show description for 1d636ac
  

  BlackSamorez

  and

  MekkCyber

  authored
  1d636ac

  Copy full SHA for 1d636ac

• edited tests and device map assertions

  BlackSamorez

  committed
  66ece1d

  Copy full SHA for 66ece1d

• Merge branch 'main' of github.com:BlackSamorez/transformers

  BlackSamorez

  committed
  5a68cd6

  Copy full SHA for 5a68cd6

• minor edits

  BlackSamorez

  committed
  1cb9f0c

  Copy full SHA for 1cb9f0c

• updated flute cuda version in docker

  BlackSamorez

  committed
  257c39b

  Copy full SHA for 257c39b

• Added p=1 and 2,3bit HIGGS

  BlackSamorez

  committed
  f82d1a3

  Copy full SHA for f82d1a3

• flute version check update

  BlackSamorez

  committed
  b747980

  Copy full SHA for b747980

• incorporated modules_to_not_convert

  BlackSamorez

  committed
  398d5b1

  Copy full SHA for 398d5b1

• less hardcoding

  BlackSamorez

  committed
  0ede69c

  Copy full SHA for 0ede69c

• Merge branch 'main' into main

  BlackSamorez

  authored
  ebe6766

  Copy full SHA for ebe6766

Commits on Dec 2, 2024

• Fixed comment

  BlackSamorez

  committed
  4e730a9

  Copy full SHA for 4e730a9

• Added docs

  BlackSamorez

  committed
  c3848f3

  Copy full SHA for c3848f3

• Fixed gemma support

  BlackSamorez

  committed
  c91182a

  Copy full SHA for c91182a

• example in docs

  BlackSamorez

  committed
  8e1da3d

  Copy full SHA for 8e1da3d

Commits on Dec 3, 2024

• fixed torch_dtype for HIGGS

  BlackSamorez

  committed
  15f3789

  Copy full SHA for 15f3789

Commits on Dec 5, 2024

• Update docs/source/en/quantization/higgs.md

  Show description for b10375f
  

  BlackSamorez

  and

  SunMarc

  authored
  b10375f

  Copy full SHA for b10375f

Commits on Dec 6, 2024

• Collection link

  BlackSamorez

  committed
  2abdc84

  Copy full SHA for 2abdc84

Commits on Dec 10, 2024

• dequantize interface

  BlackSamorez

  committed
  5074b60

  Copy full SHA for 5074b60

Commits on Dec 12, 2024

• newer flute version, torch.compile support

  BlackSamorez

  committed
  2fab798

  Copy full SHA for 2fab798

• unittest message fix

  BlackSamorez

  committed
  db27c59

  Copy full SHA for db27c59

Commits on Dec 23, 2024

• docs update compile

  BlackSamorez

  committed
  6917ece

  Copy full SHA for 6917ece

• Merge branch 'main' into main

  BlackSamorez

  authored
  7c003c2

  Copy full SHA for 7c003c2

• isort

  BlackSamorez

  committed
  e317fc5

  Copy full SHA for e317fc5

• ValueError instead of assert

  BlackSamorez

  committed
  53e6827

  Copy full SHA for 53e6827