k8s-config-connector: Config Connector HTTP Error 413 (Request Entity Too Large)

Describe the bug After upgrading the config connector from 1.20.1 to 1.24.0, is not able to create BigQueryDatasets

ConfigConnector Version Version 1.24.0

To Reproduce Create a new BigQueryDatasets with the above YAML, and the config connector fails the reconciliation loop with different errors. The BigQueryDataSet is never created.

---
apiVersion: bigquery.cnrm.cloud.google.com/v1beta1
kind: BigQueryDataset
metadata:
  annotations:
    cnrm.cloud.google.com/delete-contents-on-destroy: "false"
  name: foo
spec:
  access:
  - role: OWNER
    specialGroup: projectOwners
  - groupByEmail: team@example.com
    role: READER
  - role: WRITER
    userByEmail: service-account-email@project-id.iam.gserviceaccount.com
  friendlyName: foo
  location: EU

When you describe the kubernetes resource you get this message as part of the status.conditions

"message": "Update call failed: error fetching live state: error reading underlying resource: summary: Error when reading or editing BigQueryDataset \"projects/project-id/datasets/foo\": Get \"https://bigquery.googleapis.com/bigquery/v2/projects/project-iddatasets/foo?alt=json\": net/http: invalid header field value \"Terraform/ (+https://www.terraform.io) Terraform-Plugin-SDK/2.0.3 terraform-provider-google-beta/dev \\x00      \\x00....

Or the following message in other occurrences:

Events:
  Type     Reason        Age                   From                        Message
  ----     ------        ----                  ----                        -------
  Warning  UpdateFailed  6m28s (x65 over 17h)  bigquerydataset-controller  Update call failed: error fetching live state: error reading underlying resource: summary: Error when reading or editing BigQueryDataset "projects/project-id/datasets/foo": googleapi: got HTTP response code 413 with body: <!DOCTYPE html>
<html lang=en>
  <meta charset=utf-8>
  <meta name=viewport content="initial-scale=1, minimum-scale=1, width=device-width">
  <title>Error 413 (Request Entity Too Large)!!1</title>
  <style>
    *{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7%!a(MISSING)uto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* > body{background:url(//www.google.com/images/errors/robot.png) 100%!p(MISSING)x no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png) no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat 0%/100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) 0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat;-webkit-background-size:100%}}#logo{display:inline-block;height:54px;width:150px}
  </style>
  <a href=//www.google.com/><span id=logo aria-label=Google></span></a>
  <p><b>413.</b> <ins>That’s an error.</ins>
  <p>Your client issued a request that was too large.
 <script>
  (function() { /*

 Copyright The Closure Library Authors.
 SPDX-License-Identifier: Apache-2.0
*/
var c=function(a,d,b){a=a+"=deleted; path="+d;null!=b&&(a+="; domain="+b);document.cookie=a+"; expires=Thu, 01 Jan 1970 00:00:00 GMT"};var g=function(a){var d=e,b=location.hostname;c(d,a,null);c(d,a,b);for(var f=0;;){f=b.indexOf(".",f+1);if(0>f)break;c(d,a,b.substring(f+1))}};var h;if(4E3<unescape(encodeURI(document.cookie)).length){for(var k=document.cookie.split(";"),l=[],m=0;m<k.length;m++){var n=k[m].match(/^\s*([^=]+)/);n&&l.push(n[1])}for(var p=0;p<l.length;p++){var e=l[p];g("/");for(var q=location.pathname,r=0;;){r=q.indexOf("/",r+1);if(0>r)break;var t=q.substring(0,r);g(t);g(t+"/")}"/"!=q.charAt(q.length-1)&&(g(q),g(q+"/"))}h=!0}else h=!1;
h&&setTimeout(function(){if(history.replaceState){var a=location.href;history.replaceState(null,"","/");location.replace(a)}},1E3); })();

</script>
 <ins>That’s all we know.</ins>
, detail:

About this issue

Original URL
State: closed
Created 4 years ago
Reactions: 2
Comments: 16 (9 by maintainers)

Most upvoted comments

@tonybenchsci thanks, we’re treating this as a high priority issue so we’re aiming to get a fix out sooner rather than later. Were you able to confirm if the workaround worked for you?

jcanseco on Oct 16, 2020