Skip to content

Commit

Permalink
updated readme
Browse files Browse the repository at this point in the history
Signed-off-by: David Mosallanezhad <[email protected]>
  • Loading branch information
Davood-M committed Jun 21, 2023
1 parent 5cbe81d commit 46836c7
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -5826,4 +5826,5 @@ Fixes for the following issues will be released shortly:
* The fine-tuning SQuAD results for T5 are lower than expected.
* There has been a slight regression in T5 performance and this will be addressed in an upcoming release.
* Evaluation for GPT has been tested for PP <=2 and may have issues for PP >2. It is recommended to convert to TP only for Evaluation.
* Transformer Engine (TE)-based GPT models are currently not supported for any Parameter Efficient Fine Tuning (PEFT) techniques - this will be added soon.
* TE-based GPT Eval will take more memory than non-TE-based GPT Eval.

0 comments on commit 46836c7

Please sign in to comment.