terraform-provider-azurerm: Error creating azurerm_hdinsight_spark_cluster for HDInsight on Azure with Terraform

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave “+1” or “me too” comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Terraform (and AzureRM Provider) Version

terraform { required_version = “= 0.14.11” }

provider “azurerm” { version = “~> 2.0” }

Affected Resource(s)

https://registry.terraform.io/providers/hashicorp/azurerm/latest/docs/resources/hdinsight_spark_cluster

• azurerm_XXXXX

Terraform Configuration Files

# Copy-paste your Terraform configurations here - for large Terraform configs,
# please use a service like Dropbox and share a link to the ZIP file. For
# security, you can also encrypt the files using our GPG public key: https://keybase.io/hashicorp

Error Output

Error: creating HDInsight Spark Cluster "spark02-stg-stream" (Resource Group "rg-stg-stream"): hdinsight.ClustersClient#Create: Failure sending request: StatusCode=0 -- Original Error: Code="BadRequest" Message="Storage account 'name' in storage profile cannot be null or empty"

  on ../../../modules/azure/hdinsight-spark/main.tf line 1, in resource "azurerm_hdinsight_spark_cluster" "hid_spark_cluster":
   1: resource "azurerm_hdinsight_spark_cluster" "hid_spark_cluster" {

Panic Output

Expected Behaviour

Actual Behaviour

Steps to Reproduce

Plan Output

module.hdi-stg-spark-stream.azurerm_hdinsight_spark_cluster.hid_spark_cluster will be created
  + resource "azurerm_hdinsight_spark_cluster" "hid_spark_cluster" {
      + cluster_version               = "4.0"
      + encryption_in_transit_enabled = (known after apply)
      + https_endpoint                = (known after apply)
      + id                            = (known after apply)
      + location                      = "southeastasia"
      + name                          = "spark02-stg-stream"
      + resource_group_name           = "xxxx"
      + ssh_endpoint                  = (known after apply)
      
      + tier                          = "Standard"

      + component_version {
          + spark = "2.4"
        }

      + gateway {
          + enabled  = true
          + password = (sensitive value)
          + username = "admin"
        }

      + network {
          + connection_direction = "Outbound"
          + private_link_enabled = false
        }

     ........................

      + storage_account {
          + is_default           = true
          + storage_account_key  = (sensitive value)
          + storage_container_id = "/subscriptions/xxxxx/resourceGroups/xxx/providers/Microsoft.Storage/storageAccounts/xxxx/blobServices/default/containers/spark-test02"
        }
    }

Important Factoids

References

• #0000