terraform-provider-google: google_datastore_index has problems when indexes take a while to create

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request.
• Please do not leave +1 or me too comments, they generate extra noise for issue followers and do not help prioritize the request.
• If you are interested in working on this issue or have submitted a pull request, please leave a comment.
• If an issue is assigned to the modular-magician user, it is either in the process of being autogenerated, or is planned to be autogenerated soon. If an issue is assigned to a user, that user is claiming responsibility for the issue. If an issue is assigned to hashibot, a community member has claimed the issue already.

Terraform Version

Terraform v1.1.3
on darwin_amd64
+ provider registry.terraform.io/hashicorp/google v3.52.0
+ provider registry.terraform.io/hashicorp/google-beta v3.52.0

Affected Resource(s)

google_datastore_index

Terraform Configuration Files

# Copy-paste your Terraform configurations here.
#
# For large Terraform configs, please use a service like Dropbox and share a link to the ZIP file.
# For security, you can also encrypt the files using our GPG public key:
#    https://www.hashicorp.com/security
#
# If reproducing the bug involves modifying the config file (e.g., apply a config,
# change a value, apply the config again, see the bug), then please include both:
# * the version of the config before the change, and
# * the version of the config after the change.

Debug Output

While creating indexes if they take a while to complete there are errors like

│ Error: Error waiting to create Index: Error waiting for Creating Index: couldn't find resource (21 retries)
│ 
│   with google_datastore_index.card,
│   on main.tf line 539, in resource "google_datastore_index" "card":
│  539: resource "google_datastore_index" "card" {

Then if you rerun terraform apply you get errors like:

 Error: Error creating Index: googleapi: Error 409: index already exists
│ 
│   with google_datastore_index.card,
│   on main.tf line 539, in resource "google_datastore_index" "card":
│  539: resource "google_datastore_index" "card" {

Panic Output

Expected Behavior

If Indexes take a while to create this should be captured in the terraform state so that when re-running terraform apply it doesn’t attempt to recreate them and throw an error because thy already exist

Actual Behavior

If Indexes take a while to create terraform apply fails with an error and then attempting terraform apply again fails because it attempts to recreate those indexes (which are present and in the process of being created)

ultimately the only way to resolve is to import the indexes into the sate file using the terraform import command

Steps to Reproduce

1. terraform apply

Important Factoids

References

• #0000

b/303808201