Inference llm tgi (#58)

inference LLM open source --------- Co-authored-by: Christophe Bismuth <[email protected]>
etf1 · Jul 1, 2024 · d2c86fa · d2c86fa
1 parent db07617
commit d2c86fa
Show file tree

Hide file tree

Showing 9 changed files with 246 additions and 0 deletions.
diff --git a/content/post/2024/ia/inference-llm-tgi/images/aws-bedrock.png b/content/post/2024/ia/inference-llm-tgi/images/aws-bedrock.png
diff --git a/content/post/2024/ia/inference-llm-tgi/images/hero.jpg b/content/post/2024/ia/inference-llm-tgi/images/hero.jpg
diff --git a/content/post/2024/ia/inference-llm-tgi/images/huggingface.png b/content/post/2024/ia/inference-llm-tgi/images/huggingface.png
diff --git a/content/post/2024/ia/inference-llm-tgi/images/mistral-files.png b/content/post/2024/ia/inference-llm-tgi/images/mistral-files.png
diff --git a/content/post/2024/ia/inference-llm-tgi/images/neuron-top.png b/content/post/2024/ia/inference-llm-tgi/images/neuron-top.png
diff --git a/content/post/2024/ia/inference-llm-tgi/images/nvidia-smi.png b/content/post/2024/ia/inference-llm-tgi/images/nvidia-smi.png
diff --git a/content/post/2024/ia/inference-llm-tgi/images/size-mistral.png b/content/post/2024/ia/inference-llm-tgi/images/size-mistral.png
diff --git a/content/post/2024/ia/inference-llm-tgi/images/tgi-sharding.png b/content/post/2024/ia/inference-llm-tgi/images/tgi-sharding.png
diff --git a/content/post/2024/ia/inference-llm-tgi/index.md b/content/post/2024/ia/inference-llm-tgi/index.md