sagemaker-python-sdk: Model deploy instance_type modification failed

Reference:

• 0409412934
• MLFW-1638

System Information

• Framework / Algorithm: PCA
• Framework Version: SageMaker Aug 12, 2019 09:03 UTC
• Python Version: 3
• CPU or GPU: CPU
• Python SDK Version:
• Are you using a custom image: No

Describe the problem

Running SageMaker example: PCA for MNIST If a user try to deploy a model with an instance_type that is not available, the user won’t be able to simply replace the instance_type and deploy again.

Minimal repro / logs

While running PCA for MNIST in the example project, and executing the following script:

pca_predictor = pca.deploy(initial_instance_count=1, instance_type='ml.m4.xlarge') 

When a user doesn’t have any extra resource to launch new instance with the assigned instance_type. The user will get a ResourceLimitExceeded error. If the user desides to change the instance_type and execute the script again.

pca_predictor = pca.deploy(initial_instance_count=1, instance_type='ml.t2.medium') 

The the user will get this error:

--------------------------------------------------------------------------- 
ResourceLimitExceeded Traceback (most recent call last) 
<ipython-input-18-b2bb257b120c> in <module>() 
1 pca_predictor = pca.deploy(initial_instance_count=1, 
----> 2 instance_type='ml.t2.medium') 
...... 
ResourceLimitExceeded: An error occurred (ResourceLimitExceeded) when calling the CreateEndpoint operation: The account-level service limit 'ml.m4.xlarge for endpoint usage' is 0 Instances, with current utilization of 0 Instances and a request delta of 1 Instances... 
--------------------------------------------------------------------------- 

From this error message, we can see that although we are trying to set a new instance_type, the instance_type is not really reset.