Skip to content

Commit

Permalink
add replicas
Browse files Browse the repository at this point in the history
  • Loading branch information
strangiato committed Jan 7, 2025
1 parent bef0128 commit 93f94ba
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions content/modules/ROOT/pages/02-vllm.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,7 @@ When you first create a Model Server in a Project you must select a `single-mode
----
Model deployment name: vllm
Serving runtime: vLLM ServingRuntime for KServe
Number of model server replicas to deploy: 1
Model server size: Custom
CPUs requested: 2 Cores
CPUs limit: 4 Cores
Expand Down

0 comments on commit 93f94ba

Please sign in to comment.