pipelines: Cannot run pipeline samples in GCP IAP Deployment

What happened: We cannot run pipeline samples. Seems that gcloud related command cannot get workload identity correctly. The error messages are

ERROR: (gsutil) timed out
This may be due to network connectivity issues. Please check your network settings, and the status of the service you are trying to reach.

What did you expect to happen: We should run pipeline samples smoothly.

What steps did you take: Created a run and an experiment.

Anything else you would like to add: I tried this implementation and still cannot get correct result. https://github.com/kubeflow/pipelines/blob/master/samples/core/secret/secret.py

About this issue

  • Original URL
  • State: closed
  • Created 5 years ago
  • Comments: 17 (6 by maintainers)

Commits related to this issue

Most upvoted comments

When I retried deployment again, the message is changed to

AccessDeniedException: 403 Primary: /namespaces/dcard-data.svc.id.goog with additional claims does not have storage.objects.list access to dcard--bruce.

ERROR: (gcloud.container.clusters.upgrade) ResponseError: code=400, message=Master version “1.14.8-gke.17” is unsupported.

It means a new patch version has been released. The new 1.14.8-gke.x probably already have the fix.