google-cloud-dotnet: Dataflow standard template regional launch request failure
Launching a standard template with regional endpoint europe-west3 is failing with error:
Grpc.Core.RpcException: Status(StatusCode="FailedPrecondition", Detail="(d5c84d5dd719994a): The workflow could not be created, since it was sent to an invalid regional endpoint (europe-west3) or the wrong API endpoint was used. Please resubmit to a valid Cloud Dataflow regional endpoint and ensure you are using dataflow.projects.locations.templates.launch API endpoint. The list of Cloud Dataflow regional endpoints is at https://cloud.google.com/dataflow/docs/concepts/regional-endpoints. ")
Here’s how I’m trying to launch the job:
var r = await _templateClient.LaunchTemplateAsync(new GoogleDataflow.LaunchTemplateRequest()
{
GcsPath = launchRequest.TemplatePath,
Location = launchRequest.Region, //"europe-west3"
ProjectId = _googleOptions.ProjectId,
LaunchParameters = launchParams
});
It seems as if I need to change the endpoint using the client builder, but I’m not quite sure how to go about passing the resource name.
Edit: I’m using Dataflow Prime.
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Comments: 17 (8 by maintainers)
Commits related to this issue
- fix: Concat all values for the request parameter header using &. Closes googleapis/google-cloud-dotnet#9396 — committed to amanda-tarafa/gax-dotnet by amanda-tarafa a year ago
- feat: Concatenate routing header values. Closes googleapis/google-cloud-dotnet#9396 — committed to amanda-tarafa/gax-dotnet by amanda-tarafa a year ago
- fix: Concatenate request header parameters. Closes https://github.com/googleapis/google-cloud-dotnet/issues/9396 — committed to amanda-tarafa/gax-dotnet by amanda-tarafa a year ago
- fix: Concatenate request header parameters. Closes https://github.com/googleapis/google-cloud-dotnet/issues/9396 — committed to amanda-tarafa/gax-dotnet by amanda-tarafa a year ago
- fix: Concatenate request header parameters. Closes https://github.com/googleapis/google-cloud-dotnet/issues/9396 — committed to amanda-tarafa/gax-dotnet by amanda-tarafa a year ago
- Release Google.Cloud.Dataflow.V1Beta3 version 2.0.0-beta04 Changes in this release: No API surface changes; just dependency updates. However, the dependency update to GAX 4.3.1 fixes [issue 9396](ht... — committed to googleapis/google-cloud-dotnet by jskeet a year ago
- Release Google.Cloud.Dataflow.V1Beta3 version 2.0.0-beta04 Changes in this release: No API surface changes; just dependency updates. However, the dependency update to GAX 4.3.1 fixes [issue 9396](ht... — committed to googleapis/google-cloud-dotnet by jskeet a year ago
@nick-fenton I’ve reproduced your issues and I’ve raised it with the API team.
@meredithslota assigning to you for visibility: Although this doesn’t seem exactly like a recurrence of #7038, it is possibly related.
@nick-fenton We’ve released Google.Cloud.Dataflow.V1Beta3 v2.0.0-beta04 containing the library side fix. If you upgrade to that your original code should work as expected. Do let us know if you run into any other issues.
OK, we’ve found what the issue is, we’ll now have to make a decision on how to fix it, there are several options with different pros and cons, etc.
I’ll downgrade the priority of this issue to P2, given that there’s a workaround and that we have found the root cause. But we continue to actively work on it. Again, I’ll come back here when we know what we’ll do and the ETA for that.
There seems to be an issue with the library or with the Grpc.Net.Client dependencies, but we haven’t found what the problem is yet. For the time beeing, I can offer a workaround and that is to use Grpc.Core, for that, you need to:
The rest of your code should be the same as it is now.
We are actively looking into this and I’ll come back here with updates when I know more.
I’ll try to reproduce and bring this to the attention of the Dataflow team. I would have expect your code to work.