update readme

intel-analytics · Jun 26, 2024 · 1b6f3b7 · 1b6f3b7
1 parent 1e81576
commit 1b6f3b7
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/python/llm/example/GPU/Pipeline-Parallel-Inference/README.md b/python/llm/example/GPU/Pipeline-Parallel-Inference/README.md
@@ -52,6 +52,8 @@ pip install oneccl_bind_pt==2.1.100 --extra-index-url https://pytorch-extension.
 
 For optimal performance, it is recommended to set several environment variables. We provide example usages as following:
 
+> Note: INT4 optimization is applied to the model by default. You could specify other low bit optimizations (such as 'fp8' and 'fp6') through `--low-bit`.
+
 </details>
 
 <details>