Skip to content

Commit ff18ec7

Browse files
vertex-mg-botcopybara-github
authored andcommitted
Add --total-gpus to multi-model model-cohost deployment config.
PiperOrigin-RevId: 863070590
1 parent 008eb40 commit ff18ec7

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

notebooks/community/model_garden/model_garden_model_cohost.ipynb

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6273,6 +6273,7 @@
62736273
" f\"--model-replicas={model_replicas}\",\n",
62746274
" \"--data-parallel-size=1\",\n",
62756275
" \"--swap-space=16\",\n",
6276+
" f\"--total-gpus={accelerator_count}\",\n",
62766277
" ]\n",
62776278
"\n",
62786279
" if multihost_gpu_node_count > 1:\n",

0 commit comments

Comments
 (0)