Skip to content

Commit

Permalink
chore: increase allowed memory for Triton (#1498)
Browse files Browse the repository at this point in the history
  • Loading branch information
raphael0202 authored Dec 12, 2024
1 parent 7fe5324 commit 0c52a59
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion docker/ml-gpu.yml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ services:
# https://github.com/triton-inference-server/server/blob/main/docs/user_guide/model_management.md
# for more information
entrypoint: "/opt/nvidia/nvidia_entrypoint.sh tritonserver --model-repository=/models --model-control-mode=explicit --load-model=*"
mem_limit: 15g
mem_limit: 20g
runtime: nvidia
deploy:
resources:
Expand Down
2 changes: 1 addition & 1 deletion docker/ml.yml
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ services:
# https://github.com/triton-inference-server/server/blob/main/docs/user_guide/model_management.md
# for more information
entrypoint: "tritonserver --model-repository=/models --model-control-mode=explicit --load-model=*"
mem_limit: 15g
mem_limit: 20g

fasttext:
restart: $RESTART_POLICY
Expand Down

0 comments on commit 0c52a59

Please sign in to comment.