Management of Model Deployment

Status of Model Deployment Version

• In preparation Starting
• Running Already started. You can view the logs of its operation
• Closing In the closed cleaning state
• Closed This service version has been successfully closed
• Execution error Due to some special reasons, it was closed abnormally. You can try to check the specific reasons through the logs

Among them, there are Execution error and Closed The deployed version of the model in the state has become inactive. Allow this version to be restarted or permanently deleted.

Expansion of model deployment

When creating a model deployment, you can choose the number of replicas. The more copies there are, the more. The higher the load capacity of the service.

Deploying a version of a running model "set up" The number of copies that a page can update.

be careful

The more copies there are, the more. The stronger the service load capacity. It also means that at the same time, it is "computing resource " The greater the consumption.

Update of model deployment

Multiple versions can be included in model deployment. After creating or launching another model deployment version. The deployed version of the running model will be closed. Only one running model deployment version is allowed under the same model deployment.

Delete unnecessary model deployment versions

For inactive model deployment versions, alignment can be used for deletion:

be careful

The model deployment version is still active (Not located "Closed" perhaps "Execution error" state)Cannot be deleted.

Delete the entire model deployment

If the entire model deployment is no longer needed. Can be deployed in this model "set up" Delete the entire model deployment from the page.

be careful

If there are active model versions available for model deployment (Not located "Closed" perhaps "Execution error" state), The model deployment cannot be deleted.