azure-cli: az vmss deployment failing with "Parameter 'virtualMachineProfile' is not allowed"

Describe the bug

az vmss deployment failing with “Parameter ‘virtualMachineProfile’ is not allowed”. We use the Azure CLI 2.54.0 nightly build: https://aka.ms/InstallAzureCliWindowsEdge The environment is Azure Stack Hub with 2020-09-01-hybrid API profile. Either VMSS or Resource Deployment is the root cause.

Hi @yanzhudd @Jing-song, was there any change from VM side that could have caused this in the nightly build? Hi @anthony-c-martin @jeskew, were there any changes from Resource Deployment side that could have caused this in the nightly build?

Related command

az vmss create -g $vmssRgName -n $vmssName --admin-username $vmssAdminUserName --admin-password $vmssAdminPassword --image $imageName --authentication-type password --upgrade-policy-mode $upgradeMode

Errors

Traceback (most recent call last):
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 697, in _run_job
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 333, in __call__
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/command_operation.py", line 121, in handler
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/vm/custom.py", line 3513, in create_vmss
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 1030, in __call__
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 1013, in __call__
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 1000, in __call__
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/_poller.py", line 255, in result
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/tracing/decorator.py", line 78, in wrapper_use_tracer
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/_poller.py", line 275, in wait
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/_poller.py", line 192, in _start
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/base_polling.py", line 535, in run
azure.core.exceptions.HttpResponseError: (DeploymentFailed) At least one resource deployment operation failed. Please list deployment operations for details. Please see 
https://aka.ms/DeployOperations for usage details.
Code: DeploymentFailed
Message: At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/DeployOperations for usage details.
Exception Details:	(BadRequest) {
	  "error": {
	    "code": "InvalidParameter",
	    "message": "Parameter 'virtualMachineProfile' is not allowed.",
	    "target": "virtualMachineProfile"
	  }
	}
	Code: BadRequest
	Message: {
	  "error": {
	    "code": "InvalidParameter",
	    "message": "Parameter 'virtualMachineProfile' is not allowed.",
	    "target": "virtualMachineProfile"
	  }
	}

Issue script & Debug output

Command az vmss create -g $vmssRgName -n $vmssName --admin-username $vmssAdminUserName --admin-password $vmssAdminPassword --image $imageName --authentication-type password --upgrade-policy-mode $upgradeMode --debug

Debug I had to truncate to the last part of the debug because I cannot fit the entire message length of characters in this issue post.

...
DEBUG: cli.azure.cli.core.sdk.policies: Request URL: 'https://management.redmond.ext-rm0704.masd.stbtest.microsoft.com/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/
resourcegroups/clivmssrg/providers/Microsoft.Resources/deployments/vmss_deploy_NcKALQtZ1KJQueSjqtB3yyQa1IVfjdGP?api-version=2019-10-01'
DEBUG: cli.azure.cli.core.sdk.policies: Request method: 'PUT'
DEBUG: cli.azure.cli.core.sdk.policies: Request headers:
DEBUG: cli.azure.cli.core.sdk.policies:     'Content-Type': 'application/json'
DEBUG: cli.azure.cli.core.sdk.policies:     'Content-Length': '4912'
DEBUG: cli.azure.cli.core.sdk.policies:     'Accept': 'application/json'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-client-request-id': '8e1a46b7-7e8a-11ee-906c-00155d02feed'
DEBUG: cli.azure.cli.core.sdk.policies:     'CommandName': 'vmss create'
DEBUG: cli.azure.cli.core.sdk.policies:     'ParameterSetName': '-g -n --admin-username --admin-password --image --authentication-type --upgrade-policy-mode --debug'
DEBUG: cli.azure.cli.core.sdk.policies:     'User-Agent': 'AZURECLI/2.54.0 (MSI) azsdk-python-azure-mgmt-resource/23.1.0b2 Python/3.11.5 (Windows-10-10.0.17763-SP0)'
DEBUG: cli.azure.cli.core.sdk.policies:     'Authorization': '*****'
DEBUG: cli.azure.cli.core.sdk.policies: Request body:
DEBUG: cli.azure.cli.core.sdk.policies: {"properties": {"template": {"$schema": "https://schema.management.azure.com/schemas/2015-01-01/deploymentTemplate.json#", 
"contentVersion": "1.0.0.0", "parameters": {"adminPassword": {"type": "securestring", "metadata": {"description": "Secure adminPassword"}}}, "variables": {}, 
"resources": [{"name": "testvmssVNET", "type": "Microsoft.Network/virtualNetworks", "location": "redmond", "apiVersion": "2015-06-15", "dependsOn": [], "tags": {}, 
"properties": {"addressSpace": {"addressPrefixes": ["10.0.0.0/16"]}, "subnets": [{"name": "testvmssSubnet", "properties": {"addressPrefix": "10.0.0.0/24"}}]}}, 
{"apiVersion": "2018-11-01", "type": "Microsoft.Network/publicIPAddresses", "name": "testvmssLBPublicIP", "location": "redmond", "tags": {}, "dependsOn": [], 
"properties": {"publicIPAllocationMethod": "Static"}, "sku": {"name": "Standard"}}, {"type": "Microsoft.Network/loadBalancers", "name": "testvmssLB", "location": 
"redmond", "tags": {}, "apiVersion": "2018-11-01", "dependsOn": ["Microsoft.Network/virtualNetworks/testvmssVNET", 
"Microsoft.Network/publicIpAddresses/testvmssLBPublicIP"], "properties": {"backendAddressPools": [{"name": "testvmssLBBEPool"}], "frontendIPConfigurations": [{"name": 
"loadBalancerFrontEnd", "properties": {"publicIPAddress": {"id": 
"/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Network/publicIPAddresses/testvmssLBPublicIP"}}}], 
"loadBalancingRules": [{"name": "LBRule", "properties": {"frontendIPConfiguration": {"id": "[concat(resourceId('Microsoft.Network/loadBalancers', 'testvmssLB'), 
'/frontendIPConfigurations/', 'loadBalancerFrontEnd')]"}, "backendAddressPool": {"id": "[concat(resourceId('Microsoft.Network/loadBalancers', 'testvmssLB'), 
'/backendAddressPools/', 'testvmssLBBEPool')]"}, "protocol": "tcp", "frontendPort": 80, "backendPort": 80, "enableFloatingIP": false, "idleTimeoutInMinutes": 5}}]}, 
"sku": {"name": "Standard"}}, {"type": "Microsoft.Network/networkSecurityGroups", "name": "testvmssNSG", "apiVersion": "2015-06-15", "location": "redmond", "tags": {}, 
"dependsOn": [], "properties": {"securityRules": [{"name": "default-allow-ssh", "properties": {"protocol": "Tcp", "sourcePortRange": "*", "destinationPortRange": "22", 
"sourceAddressPrefix": "*", "destinationAddressPrefix": "*", "access": "Allow", "priority": 1000, "direction": "Inbound"}}]}}, {"type": 
"Microsoft.Network/loadBalancers/inboundNatRules", "apiVersion": "2018-11-01", "name": "testvmssLB/NatRule", "location": "redmond", "properties": 
{"frontendIPConfiguration": {"id": "[concat(resourceId('Microsoft.Network/loadBalancers', 'testvmssLB'), '/frontendIPConfigurations/', 'loadBalancerFrontEnd')]"}, 
"backendAddressPool": {"id": "[concat(resourceId('Microsoft.Network/loadBalancers', 'testvmssLB'), '/backendAddressPools/', 'testvmssLBBEPool')]"}, "backendPort": 3389, 
"frontendPortRangeStart": "50000", "frontendPortRangeEnd": "50119", "protocol": "tcp", "idleTimeoutInMinutes": 5}, "dependsOn": 
["[concat('Microsoft.Network/loadBalancers/', 'testvmssLB')]"]}, {"type": "Microsoft.Compute/virtualMachineScaleSets", "name": "testvmss", "location": "redmond", "tags": 
{}, "apiVersion": "2020-06-01", "dependsOn": ["Microsoft.Network/virtualNetworks/testvmssVNET", "Microsoft.Network/loadBalancers/testvmssLB", 
"Microsoft.Network/networkSecurityGroups/testvmssNSG"], "properties": {"singlePlacementGroup": null, "platformFaultDomainCount": 1, "virtualMachineProfile": 
{"storageProfile": {"osDisk": {"createOption": "FromImage", "caching": "ReadWrite", "managedDisk": {"storageAccountType": null}}, "imageReference": {"publisher": 
"MicrosoftWindowsServer", "offer": "WindowsServer", "sku": "2016-Datacenter", "version": "latest"}}, "osProfile": {"computerNamePrefix": "testvmss", "adminUsername": 
"CanaryAdmin", "adminPassword": "[parameters('adminPassword')]"}, "networkProfile": {"networkInterfaceConfigurations": [{"name": "testv8c32Nic", "properties": 
{"ipConfigurations": [{"name": "testv8c32IPConfig", "properties": {"subnet": {"id": 
"/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Network/virtualNetworks/testvmssVNET/subnets/testvmssSubnet"}, 
"loadBalancerBackendAddressPools": [{"id": "/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Network/loadBalancers/testvms
sLB/backendAddressPools/testvmssLBBEPool"}]}}], "networkSecurityGroup": {"id": "[resourceId('Microsoft.Network/networkSecurityGroups', 'testvmssNSG')]"}, "primary": 
"true"}}]}}, "orchestrationMode": "Flexible"}, "sku": {"name": "Standard_DS1_v2", "capacity": 2}}], "outputs": {"VMSS": {"type": "object", "value": 
"[reference(resourceId('Microsoft.Compute/virtualMachineScaleSets', 'testvmss'),providers('Microsoft.Compute', 'virtualMachineScaleSets').apiVersions[0])]"}}}, 
"parameters": {"adminPassword": {"value": "<redacted password>"}}, "mode": "incremental"}}
DEBUG: urllib3.connectionpool: Starting new HTTPS connection (1): management.redmond.ext-rm0704.masd.stbtest.microsoft.com:443
DEBUG: urllib3.connectionpool: https://management.redmond.ext-rm0704.masd.stbtest.microsoft.com:443 "PUT /subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourcegroup
s/clivmssrg/providers/Microsoft.Resources/deployments/vmss_deploy_NcKALQtZ1KJQueSjqtB3yyQa1IVfjdGP?api-version=2019-10-01 HTTP/1.1" 201 3175
DEBUG: cli.azure.cli.core.sdk.policies: Response status: 201
DEBUG: cli.azure.cli.core.sdk.policies: Response headers:
DEBUG: cli.azure.cli.core.sdk.policies:     'Cache-Control': 'no-cache'
DEBUG: cli.azure.cli.core.sdk.policies:     'Pragma': 'no-cache'
DEBUG: cli.azure.cli.core.sdk.policies:     'Content-Length': '3175'
DEBUG: cli.azure.cli.core.sdk.policies:     'Content-Type': 'application/json; charset=utf-8'
DEBUG: cli.azure.cli.core.sdk.policies:     'Expires': '-1'
DEBUG: cli.azure.cli.core.sdk.policies:     'Azure-AsyncOperation': 'https://management.redmond.ext-rm0704.masd.stbtest.microsoft.com/subscriptions/a5145679-8cfa-4cd3-ba3
4-40d13b5de547/resourcegroups/clivmssrg/providers/Microsoft.Resources/deployments/vmss_deploy_NcKALQtZ1KJQueSjqtB3yyQa1IVfjdGP/operationStatuses/08585021224755680311?api-
version=2019-10-01'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-ratelimit-remaining-subscription-writes': '1197'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-request-id': 'a7dcfd2d-ee2e-4356-a7cd-6b06a8c9c367'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-correlation-request-id': 'a7dcfd2d-ee2e-4356-a7cd-6b06a8c9c367'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-routing-request-id': 'REDMOND:20231108T230010Z:a7dcfd2d-ee2e-4356-a7cd-6b06a8c9c367'
DEBUG: cli.azure.cli.core.sdk.policies:     'Strict-Transport-Security': 'max-age=31536000; includeSubDomains'
DEBUG: cli.azure.cli.core.sdk.policies:     'X-Content-Type-Options': 'nosniff'
DEBUG: cli.azure.cli.core.sdk.policies:     'Date': 'Wed, 08 Nov 2023 23:00:09 GMT'
DEBUG: cli.azure.cli.core.sdk.policies: Response content:
DEBUG: cli.azure.cli.core.sdk.policies: {"id":"/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Resources/deployments/vmss
_deploy_NcKALQtZ1KJQueSjqtB3yyQa1IVfjdGP","name":"vmss_deploy_NcKALQtZ1KJQueSjqtB3yyQa1IVfjdGP","type":"Microsoft.Resources/deployments","properties":{"templateHash":"962
5556506124042688","parameters":{"adminPassword":{"type":"SecureString"}},"mode":"Incremental","provisioningState":"Accepted","timestamp":"2023-11-08T23:00:10.0321591Z","d
uration":"PT0.0002319S","correlationId":"a7dcfd2d-ee2e-4356-a7cd-6b06a8c9c367","providers":[{"namespace":"Microsoft.Network","resourceTypes":[{"resourceType":"virtualNetw
orks","locations":["redmond"]},{"resourceType":"publicIPAddresses","locations":["redmond"]},{"resourceType":"loadBalancers","locations":["redmond"]},{"resourceType":"netw
orkSecurityGroups","locations":["redmond"]},{"resourceType":"loadBalancers/inboundNatRules","locations":["redmond"]}]},{"namespace":"Microsoft.Compute","resourceTypes":[{
"resourceType":"virtualMachineScaleSets","locations":["redmond"]}]}],"dependencies":[{"dependsOn":[{"id":"/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGrou
ps/clivmssrg/providers/Microsoft.Network/virtualNetworks/testvmssVNET","resourceType":"Microsoft.Network/virtualNetworks","resourceName":"testvmssVNET"},{"id":"/subscript
ions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Network/publicIPAddresses/testvmssLBPublicIP","resourceType":"Microsoft.Network/pub
licIPAddresses","resourceName":"testvmssLBPublicIP"}],"id":"/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Network/loadB
alancers/testvmssLB","resourceType":"Microsoft.Network/loadBalancers","resourceName":"testvmssLB"},{"dependsOn":[{"id":"/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de54
7/resourceGroups/clivmssrg/providers/Microsoft.Network/loadBalancers/testvmssLB","resourceType":"Microsoft.Network/loadBalancers","resourceName":"testvmssLB"}],"id":"/sub
scriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Network/loadBalancers/testvmssLB/inboundNatRules/NatRule","resourceType":"Mic
rosoft.Network/loadBalancers/inboundNatRules","resourceName":"testvmssLB/NatRule"},{"dependsOn":[{"id":"/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups
/clivmssrg/providers/Microsoft.Network/virtualNetworks/testvmssVNET","resourceType":"Microsoft.Network/virtualNetworks","resourceName":"testvmssVNET"},{"id":"/subscriptio
ns/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Network/loadBalancers/testvmssLB","resourceType":"Microsoft.Network/loadBalancers","r
esourceName":"testvmssLB"},{"id":"/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Network/networkSecurityGroups/testvmssN
SG","resourceType":"Microsoft.Network/networkSecurityGroups","resourceName":"testvmssNSG"}],"id":"/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivm
ssrg/providers/Microsoft.Compute/virtualMachineScaleSets/testvmss","resourceType":"Microsoft.Compute/virtualMachineScaleSets","resourceName":"testvmss"}]}}
DEBUG: cli.azure.cli.core.sdk.policies: Request URL: 'https://management.redmond.ext-rm0704.masd.stbtest.microsoft.com/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/
resourcegroups/clivmssrg/providers/Microsoft.Resources/deployments/vmss_deploy_NcKALQtZ1KJQueSjqtB3yyQa1IVfjdGP/operationStatuses/08585021224755680311?api-version=2019-10
-01'
DEBUG: cli.azure.cli.core.sdk.policies: Request method: 'GET'
DEBUG: cli.azure.cli.core.sdk.policies: Request headers:
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-client-request-id': '8e1a46b7-7e8a-11ee-906c-00155d02feed'
DEBUG: cli.azure.cli.core.sdk.policies:     'CommandName': 'vmss create'
DEBUG: cli.azure.cli.core.sdk.policies:     'ParameterSetName': '-g -n --admin-username --admin-password --image --authentication-type --upgrade-policy-mode --debug'
DEBUG: cli.azure.cli.core.sdk.policies:     'User-Agent': 'AZURECLI/2.54.0 (MSI) azsdk-python-azure-mgmt-resource/23.1.0b2 Python/3.11.5 (Windows-10-10.0.17763-SP0)'
DEBUG: cli.azure.cli.core.sdk.policies:     'Authorization': '*****'
DEBUG: cli.azure.cli.core.sdk.policies: Request body:
DEBUG: cli.azure.cli.core.sdk.policies: This request has no body
DEBUG: urllib3.connectionpool: https://management.redmond.ext-rm0704.masd.stbtest.microsoft.com:443 "GET /subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourcegroup
s/clivmssrg/providers/Microsoft.Resources/deployments/vmss_deploy_NcKALQtZ1KJQueSjqtB3yyQa1IVfjdGP/operationStatuses/08585021224755680311?api-version=2019-10-01 
HTTP/1.1" 200 21
DEBUG: cli.azure.cli.core.sdk.policies: Response status: 200
DEBUG: cli.azure.cli.core.sdk.policies: Response headers:
DEBUG: cli.azure.cli.core.sdk.policies:     'Cache-Control': 'no-cache'
DEBUG: cli.azure.cli.core.sdk.policies:     'Pragma': 'no-cache'
DEBUG: cli.azure.cli.core.sdk.policies:     'Content-Type': 'application/json; charset=utf-8'
DEBUG: cli.azure.cli.core.sdk.policies:     'Expires': '-1'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-ratelimit-remaining-subscription-reads': '14970'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-request-id': 'aab43b18-db73-4264-9dd1-3cece8e6f613'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-correlation-request-id': 'aab43b18-db73-4264-9dd1-3cece8e6f613'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-routing-request-id': 'REDMOND:20231108T230010Z:aab43b18-db73-4264-9dd1-3cece8e6f613'
DEBUG: cli.azure.cli.core.sdk.policies:     'Strict-Transport-Security': 'max-age=31536000; includeSubDomains'
DEBUG: cli.azure.cli.core.sdk.policies:     'X-Content-Type-Options': 'nosniff'
DEBUG: cli.azure.cli.core.sdk.policies:     'Date': 'Wed, 08 Nov 2023 23:00:09 GMT'
DEBUG: cli.azure.cli.core.sdk.policies:     'Content-Length': '21'
DEBUG: cli.azure.cli.core.sdk.policies: Response content:
DEBUG: cli.azure.cli.core.sdk.policies: {"status":"Accepted"}
DEBUG: cli.azure.cli.core.sdk.policies: Request URL: 'https://management.redmond.ext-rm0704.masd.stbtest.microsoft.com/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/
resourcegroups/clivmssrg/providers/Microsoft.Resources/deployments/vmss_deploy_NcKALQtZ1KJQueSjqtB3yyQa1IVfjdGP/operationStatuses/08585021224755680311?api-version=2019-10
-01'
DEBUG: cli.azure.cli.core.sdk.policies: Request method: 'GET'
DEBUG: cli.azure.cli.core.sdk.policies: Request headers:
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-client-request-id': '8e1a46b7-7e8a-11ee-906c-00155d02feed'
DEBUG: cli.azure.cli.core.sdk.policies:     'CommandName': 'vmss create'
DEBUG: cli.azure.cli.core.sdk.policies:     'ParameterSetName': '-g -n --admin-username --admin-password --image --authentication-type --upgrade-policy-mode --debug'
DEBUG: cli.azure.cli.core.sdk.policies:     'User-Agent': 'AZURECLI/2.54.0 (MSI) azsdk-python-azure-mgmt-resource/23.1.0b2 Python/3.11.5 (Windows-10-10.0.17763-SP0)'
DEBUG: cli.azure.cli.core.sdk.policies:     'Authorization': '*****'
DEBUG: cli.azure.cli.core.sdk.policies: Request body:
DEBUG: cli.azure.cli.core.sdk.policies: This request has no body
DEBUG: urllib3.connectionpool: https://management.redmond.ext-rm0704.masd.stbtest.microsoft.com:443 "GET /subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourcegroup
s/clivmssrg/providers/Microsoft.Resources/deployments/vmss_deploy_NcKALQtZ1KJQueSjqtB3yyQa1IVfjdGP/operationStatuses/08585021224755680311?api-version=2019-10-01 
HTTP/1.1" 200 464
DEBUG: cli.azure.cli.core.sdk.policies: Response status: 200
DEBUG: cli.azure.cli.core.sdk.policies: Response headers:
DEBUG: cli.azure.cli.core.sdk.policies:     'Cache-Control': 'no-cache'
DEBUG: cli.azure.cli.core.sdk.policies:     'Pragma': 'no-cache'
DEBUG: cli.azure.cli.core.sdk.policies:     'Content-Type': 'application/json; charset=utf-8'
DEBUG: cli.azure.cli.core.sdk.policies:     'Expires': '-1'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-ratelimit-remaining-subscription-reads': '14969'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-request-id': '2ccea60d-014d-43b7-9370-9e0d4dc561aa'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-correlation-request-id': '2ccea60d-014d-43b7-9370-9e0d4dc561aa'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-routing-request-id': 'REDMOND:20231108T230040Z:2ccea60d-014d-43b7-9370-9e0d4dc561aa'
DEBUG: cli.azure.cli.core.sdk.policies:     'Strict-Transport-Security': 'max-age=31536000; includeSubDomains'
DEBUG: cli.azure.cli.core.sdk.policies:     'X-Content-Type-Options': 'nosniff'
DEBUG: cli.azure.cli.core.sdk.policies:     'Date': 'Wed, 08 Nov 2023 23:00:40 GMT'
DEBUG: cli.azure.cli.core.sdk.policies:     'Content-Length': '464'
DEBUG: cli.azure.cli.core.sdk.policies: Response content:
DEBUG: cli.azure.cli.core.sdk.policies: {"status":"Failed","error":{"code":"DeploymentFailed","message":"At least one resource deployment operation failed. Please list 
deployment operations for details. Please see https://aka.ms/DeployOperations for usage details.","details":[{"code":"BadRequest","message":"{\r\n  \"error\": {\r\n    
\"code\": \"InvalidParameter\",\r\n    \"message\": \"Parameter 'virtualMachineProfile' is not allowed.\",\r\n    \"target\": \"virtualMachineProfile\"\r\n  }\r\n}"}]}}
DEBUG: cli.azure.cli.core.azclierror: Traceback (most recent call last):
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/base_polling.py", line 517, in run
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/base_polling.py", line 557, in _poll
azure.core.polling.base_polling.OperationFailed: Operation failed or canceled

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 697, in _run_job
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 333, in __call__
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/command_operation.py", line 121, in handler
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/vm/custom.py", line 3513, in create_vmss
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 1030, in __call__
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 1013, in __call__
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 1000, in __call__
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/_poller.py", line 255, in result
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/tracing/decorator.py", line 78, in wrapper_use_tracer
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/_poller.py", line 275, in wait
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/_poller.py", line 192, in _start
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/base_polling.py", line 535, in run
azure.core.exceptions.HttpResponseError: (DeploymentFailed) At least one resource deployment operation failed. Please list deployment operations for details. Please see 
https://aka.ms/DeployOperations for usage details.
Code: DeploymentFailed
Message: At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/DeployOperations for usage details.
Exception Details:	(BadRequest) {
	  "error": {
	    "code": "InvalidParameter",
	    "message": "Parameter 'virtualMachineProfile' is not allowed.",
	    "target": "virtualMachineProfile"
	  }
	}
	Code: BadRequest
	Message: {
	  "error": {
	    "code": "InvalidParameter",
	    "message": "Parameter 'virtualMachineProfile' is not allowed.",
	    "target": "virtualMachineProfile"
	  }
	}

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/arm.py", line 109, in handle_template_based_exception
AttributeError: 'OperationFailed' object has no attribute 'error'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\knack/cli.py", line 233, in invoke
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 663, in execute
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 718, in _run_job
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/arm.py", line 112, in handle_template_based_exception
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/arm.py", line 104, in raise_subdivision_deployment_error
azure.cli.core.azclierror.DeploymentError: {"status":"Failed","error":{"code":"DeploymentFailed","message":"At least one resource deployment operation failed. Please 
list deployment operations for details. Please see https://aka.ms/DeployOperations for usage details.","details":[{"code":"BadRequest","message":"{\r\n  \"error\": {\r\n 
   \"code\": \"InvalidParameter\",\r\n    \"message\": \"Parameter 'virtualMachineProfile' is not allowed.\",\r\n    \"target\": \"virtualMachineProfile\"\r\n  
}\r\n}"}]}}

ERROR: cli.azure.cli.core.azclierror: {"status":"Failed","error":{"code":"DeploymentFailed","message":"At least one resource deployment operation failed. Please list 
deployment operations for details. Please see https://aka.ms/DeployOperations for usage details.","details":[{"code":"BadRequest","message":"{\r\n  \"error\": {\r\n    
\"code\": \"InvalidParameter\",\r\n    \"message\": \"Parameter 'virtualMachineProfile' is not allowed.\",\r\n    \"target\": \"virtualMachineProfile\"\r\n  }\r\n}"}]}}
ERROR: az_command_data_logger: {"status":"Failed","error":{"code":"DeploymentFailed","message":"At least one resource deployment operation failed. Please list deployment 
operations for details. Please see https://aka.ms/DeployOperations for usage details.","details":[{"code":"BadRequest","message":"{\r\n  \"error\": {\r\n    \"code\": 
\"InvalidParameter\",\r\n    \"message\": \"Parameter 'virtualMachineProfile' is not allowed.\",\r\n    \"target\": \"virtualMachineProfile\"\r\n  }\r\n}"}]}}

Expected behavior

Should have no errors.

Environment Summary

azure-cli                         2.54.0
core                              2.54.0
telemetry                          1.1.0
Dependencies:
msal                            1.24.0b2
azure-mgmt-resource             23.1.0b2
Python location 'C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\python.exe'
Extensions directory 'C:\Users\Administrator.RM0704-DVM\.azure\cliextensions'
Python (Windows) 3.11.5 (tags/v3.11.5:cce6ba9, Aug 24 2023, 14:21:31) [MSC v.1936 32 bit (Intel)]
Legal docs and information: aka.ms/AzureCliLegal
Your CLI is up-to-date.

Additional context

I noticed a breaking change for az vmss create: https://techcommunity.microsoft.com/t5/azure-compute-blog/breaking-change-for-vmss-powershell-cli-customers/ba-p/3818295 The commit for Azure CLI was 2 days ago from this post: https://github.com/Azure/azure-cli/commit/d72b6cefb61072d91039dcc58f33b114d1768c06

So, I set the --orchestration-mode to Uniform:

az vmss create -g $vmssRgName -n $vmssName --admin-username $vmssAdminUserName --admin-password $vmssAdminPassword --image $imageName --authentication-type password --upgrade-policy-mode $upgradeMode --orchestration-mode Uniform --debug

but I get a new error:

DEBUG: cli.azure.cli.core.sdk.policies: Request method: 'GET'
DEBUG: cli.azure.cli.core.sdk.policies: Request headers:
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-client-request-id': '4f7299f1-7ebf-11ee-b1e5-00155d02feed'
DEBUG: cli.azure.cli.core.sdk.policies:     'CommandName': 'vmss create'
DEBUG: cli.azure.cli.core.sdk.policies:     'ParameterSetName': '-g -n --admin-username --admin-password --image --authentication-type --upgrade-policy-mode 
--orchestration-mode --debug'
DEBUG: cli.azure.cli.core.sdk.policies:     'User-Agent': 'AZURECLI/2.54.0 (MSI) azsdk-python-azure-mgmt-resource/23.1.0b2 Python/3.11.5 (Windows-10-10.0.17763-SP0)'
DEBUG: cli.azure.cli.core.sdk.policies:     'Authorization': '*****'
DEBUG: cli.azure.cli.core.sdk.policies: Request body:
DEBUG: cli.azure.cli.core.sdk.policies: This request has no body
DEBUG: urllib3.connectionpool: https://management.redmond.ext-rm0704.masd.stbtest.microsoft.com:443 "GET /subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourcegroup
s/clivmssrg/providers/Microsoft.Resources/deployments/vmss_deploy_21UgWkB04xXHnz27Hn4NloaXXNBMbXLv/operationStatuses/08585020998164562902?api-version=2019-10-01 
HTTP/1.1" 200 659
DEBUG: cli.azure.cli.core.sdk.policies: Response status: 200
DEBUG: cli.azure.cli.core.sdk.policies: Response headers:
DEBUG: cli.azure.cli.core.sdk.policies:     'Cache-Control': 'no-cache'
DEBUG: cli.azure.cli.core.sdk.policies:     'Pragma': 'no-cache'
DEBUG: cli.azure.cli.core.sdk.policies:     'Content-Type': 'application/json; charset=utf-8'
DEBUG: cli.azure.cli.core.sdk.policies:     'Expires': '-1'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-ratelimit-remaining-subscription-reads': '14997'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-request-id': '7065e9fe-8051-4658-8406-6a03a5cf5f70'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-correlation-request-id': '7065e9fe-8051-4658-8406-6a03a5cf5f70'
DEBUG: cli.azure.cli.core.sdk.policies:     'x-ms-routing-request-id': 'REDMOND:20231109T051819Z:7065e9fe-8051-4658-8406-6a03a5cf5f70'
DEBUG: cli.azure.cli.core.sdk.policies:     'Strict-Transport-Security': 'max-age=31536000; includeSubDomains'
DEBUG: cli.azure.cli.core.sdk.policies:     'X-Content-Type-Options': 'nosniff'
DEBUG: cli.azure.cli.core.sdk.policies:     'Date': 'Thu, 09 Nov 2023 05:18:19 GMT'
DEBUG: cli.azure.cli.core.sdk.policies:     'Content-Length': '659'
DEBUG: cli.azure.cli.core.sdk.policies: Response content:
DEBUG: cli.azure.cli.core.sdk.policies: {"status":"Failed","error":{"code":"DeploymentFailed","message":"At least one resource deployment operation failed. Please list 
deployment operations for details. Please see https://aka.ms/DeployOperations for usage details.","details":[{"code":"BadRequest","message":"{\r\n  \"error\": {\r\n    
\"code\": \"SkuCannotBeChangedOnUpdate\",\r\n    \"message\": \"Sku property is set at creation time and cannot be changed from Standard to Basic on resource update for 
resource /subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Network/publicIPAddresses/testvmssLBPublicIP.\",\r\n    
\"details\": []\r\n  }\r\n}"}]}}
DEBUG: cli.azure.cli.core.azclierror: Traceback (most recent call last):
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/base_polling.py", line 517, in run
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/base_polling.py", line 557, in _poll
azure.core.polling.base_polling.OperationFailed: Operation failed or canceled

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 697, in _run_job
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 333, in __call__
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/command_operation.py", line 121, in handler
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/command_modules/vm/custom.py", line 3513, in create_vmss
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 1030, in __call__
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 1013, in __call__
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 1000, in __call__
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/_poller.py", line 255, in result
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/tracing/decorator.py", line 78, in wrapper_use_tracer
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/_poller.py", line 275, in wait
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/_poller.py", line 192, in _start
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/base_polling.py", line 535, in run
azure.core.exceptions.HttpResponseError: (DeploymentFailed) At least one resource deployment operation failed. Please list deployment operations for details. Please see 
https://aka.ms/DeployOperations for usage details.
Code: DeploymentFailed
Message: At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/DeployOperations for usage details.
Exception Details:	(BadRequest) {
	  "error": {
	    "code": "SkuCannotBeChangedOnUpdate",
	    "message": "Sku property is set at creation time and cannot be changed from Standard to Basic on resource update for resource 
/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Network/publicIPAddresses/testvmssLBPublicIP.",
	    "details": []
	  }
	}
	Code: BadRequest
	Message: {
	  "error": {
	    "code": "SkuCannotBeChangedOnUpdate",
	    "message": "Sku property is set at creation time and cannot be changed from Standard to Basic on resource update for resource 
/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Network/publicIPAddresses/testvmssLBPublicIP.",
	    "details": []
	  }
	}

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/arm.py", line 109, in handle_template_based_exception
AttributeError: 'OperationFailed' object has no attribute 'error'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\knack/cli.py", line 233, in invoke
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 663, in execute
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 726, in _run_jobs_serially
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/__init__.py", line 718, in _run_job
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/arm.py", line 112, in handle_template_based_exception
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/cli/core/commands/arm.py", line 104, in raise_subdivision_deployment_error
azure.cli.core.azclierror.DeploymentError: {"status":"Failed","error":{"code":"DeploymentFailed","message":"At least one resource deployment operation failed. Please 
list deployment operations for details. Please see https://aka.ms/DeployOperations for usage details.","details":[{"code":"BadRequest","message":"{\r\n  \"error\": {\r\n 
   \"code\": \"SkuCannotBeChangedOnUpdate\",\r\n    \"message\": \"Sku property is set at creation time and cannot be changed from Standard to Basic on resource update 
for resource /subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Network/publicIPAddresses/testvmssLBPublicIP.\",\r\n    
\"details\": []\r\n  }\r\n}"}]}}

ERROR: cli.azure.cli.core.azclierror: {"status":"Failed","error":{"code":"DeploymentFailed","message":"At least one resource deployment operation failed. Please list 
deployment operations for details. Please see https://aka.ms/DeployOperations for usage details.","details":[{"code":"BadRequest","message":"{\r\n  \"error\": {\r\n    
\"code\": \"SkuCannotBeChangedOnUpdate\",\r\n    \"message\": \"Sku property is set at creation time and cannot be changed from Standard to Basic on resource update for 
resource /subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Network/publicIPAddresses/testvmssLBPublicIP.\",\r\n    
\"details\": []\r\n  }\r\n}"}]}}
ERROR: az_command_data_logger: {"status":"Failed","error":{"code":"DeploymentFailed","message":"At least one resource deployment operation failed. Please list deployment 
operations for details. Please see https://aka.ms/DeployOperations for usage details.","details":[{"code":"BadRequest","message":"{\r\n  \"error\": {\r\n    \"code\": 
\"SkuCannotBeChangedOnUpdate\",\r\n    \"message\": \"Sku property is set at creation time and cannot be changed from Standard to Basic on resource update for resource 
/subscriptions/a5145679-8cfa-4cd3-ba34-40d13b5de547/resourceGroups/clivmssrg/providers/Microsoft.Network/publicIPAddresses/testvmssLBPublicIP.\",\r\n    \"details\": 
[]\r\n  }\r\n}"}]}}

About this issue

  • Original URL
  • State: closed
  • Created 8 months ago
  • Comments: 17 (8 by maintainers)

Most upvoted comments

@Jing-song @yanzhudd Sorry, I was looking at whether the VMSS existed instead of the other resources that were created by the az vmss create command. I assumed that the resources should not exist if the VMSS failed from the first command using default flexible orchestration, but some of the resources like public IP were still created and persisted until the second command. After deleting the resources after the failed default flexible orchestration command, the second command with uniform orchestration mode succeeded.

+2
TheOnlyWei on Nov 10, 2023

@TheOnlyWei – The error message doesn’t appear to be related to any changes to the resources module. The only time virtualMachineProfile appears in the template included in the debug output is as a property on a Microsoft.Compute/virtualMachineScaleSets resource:

image

And the error message doesn’t match the language used by Azure Resource Manager for unrecognized parameters.

+2
jeskew on Nov 9, 2023

Hi @Jing-song, before we make any changes, let me reach out to Azure Stack Hub contacts to look into this further. Will let you know once we decide on next steps here. Thanks!

+1
hilaryw29 on Nov 17, 2023
Read more comments on GitHub
← azure-cli: `az vm run-command invoke` returns Deployment Failure with message "Finished executing command"
azure-cli: az vmss diagnostics set --resource-group <rg> --vmss-name <vmss> --settings router_config.json --protected-settings protected.json gives error The value of parameter type is invalid. →