Code

half and mixed precision inference#442

Code

Merged

ArneBinder merged 9 commits intomainArneBinder/pytorch-ie:mainfrom pipeline/half_and_mixed_precisionArneBinder/pytorch-ie:pipeline/half_and_mixed_precisionCopy head branch name to clipboardJan 16, 2025

+50-17

Commits

Commits on Jan 13, 2025

• implement half and mixed precision inference in Pipeline

  ArneBinder

  committed
  6dd3a02

  Copy full SHA for 6dd3a02

• cast probabiliteis to float before converting to numpy

  ArneBinder

  committed
  4b78a86

  Copy full SHA for 4b78a86

• add test cases for parameters half_precision_model and half_precision_ops to test_re_text_classification

  ArneBinder

  committed
  7e11234

  Copy full SHA for 7e11234

• add docs for new params

  ArneBinder

  committed
  149090d

  Copy full SHA for 149090d

• fix spellings in docs

  ArneBinder

  committed
  aa6d36b

  Copy full SHA for aa6d36b

• fix documentation

  ArneBinder

  committed
  3ee0fc4

  Copy full SHA for 3ee0fc4

• fix documentation

  ArneBinder

  committed
  4ca830a

  Copy full SHA for 4ca830a

• add todo

  ArneBinder

  committed
  de2dda7

  Copy full SHA for de2dda7

Commits on Jan 14, 2025

• move get_autocast_dtype out of Pipeline class

  ArneBinder

  committed
  ca3112d

  Copy full SHA for ca3112d