grafana-image-renderer: Browser page crashed

What happened:

overall setup is working well: image renderer works and sends nice images to slack.
Then, “something” happens, and from there on, image-renderer keeps on crashing. A pod restart solves the issue for any time between a few hours and 2 weeks. Logs, including 1 successfull call at the top (just to show that it does work fine)

 2021-05-18T22:26:33.755623434Z {"message":"::ffff:127.0.0.1 - - [18/May/2021:22:26:33 +0000] \"GET /render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=QAWfFera3MASlHo2K9CsSfU76HXIMt74&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F63dae39ae810539b3108233c3749bf114998da82%2Fsbr2-compliance-production%3ForgId%3D1%26panelId%3D29%26render%3D1&width=1000 HTTP/1.1\" 200 33110 \"-\" \"Grafana/7.1.5\"\n","level":"debug"}
 2021-05-18T22:26:33.755729023Z {"url":"http://localhost:3000/d-solo/63dae39ae810539b3108233c3749bf114998da82/sbr2-compliance-production?orgId=1&panelId=29&render=1","level":"debug","message":"Connection closed"}
 2021-05-18T22:31:27.805524963Z {"url":"http://localhost:3000/d-solo/63dae39ae810539b3108233c3749bf114998da82/sbr2-compliance-production?orgId=1&panelId=29&render=1","level":"debug","message":"Render request received"}
 2021-05-18T22:31:31.096108470Z {"file":"/tmp/9ef11c5d.png","level":"debug","message":"Deleting temporary file"}
 2021-05-18T22:31:31.096358221Z {"message":"::ffff:127.0.0.1 - - [18/May/2021:22:31:31 +0000] \"GET /render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=8760Dc4XtE6mw5ModH8Ni2gvA3BsA60M&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F63dae39ae810539b3108233c3749bf114998da82%2Fsbr2-compliance-production%3ForgId%3D1%26panelId%3D29%26render%3D1&width=1000 HTTP/1.1\" 200 35856 \"-\" \"Grafana/7.1.5\"\n","level":"debug"}
 2021-05-18T22:31:31.096447478Z {"url":"http://localhost:3000/d-solo/63dae39ae810539b3108233c3749bf114998da82/sbr2-compliance-production?orgId=1&panelId=29&render=1","level":"debug","message":"Connection closed"}
 2021-05-18T22:32:01.812452652Z {"url":"http://localhost:3000/d-solo/245f6eb185f8ac33ccace621ffa78b3d5f7168c7/pm-initializer-integration-production?orgId=1&panelId=29&render=1","level":"debug","message":"Render request received"}
 2021-05-18T22:32:01.893723534Z {"url":"http://localhost:3000/d-solo/245f6eb185f8ac33ccace621ffa78b3d5f7168c7/pm-initializer-integration-production?orgId=1&panelId=28&render=1","level":"debug","message":"Render request received"}
 2021-05-18T22:32:04.883703062Z {"error":"Error: Page crashed!","level":"error","message":"Browser page crashed"}
 2021-05-18T22:32:16.809733713Z {"url":"http://localhost:3000/d-solo/245f6eb185f8ac33ccace621ffa78b3d5f7168c7/pm-initializer-integration-production?orgId=1&panelId=29&render=1","level":"debug","message":"Connection closed"}
 2021-05-18T22:32:16.810404284Z {"message":"::ffff:127.0.0.1 - - [18/May/2021:22:32:16 +0000] \"GET /render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=swkT9o7zVkQqY3KrjnWZzJXswURm5baN&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F245f6eb185f8ac33ccace621ffa78b3d5f7168c7%2Fpm-initializer-integration-production%3ForgId%3D1%26panelId%3D29%26render%3D1&width=1000 HTTP/1.1\" - - \"-\" \"Grafana/7.1.5\"\n","level":"debug"}
 2021-05-18T22:32:16.888323005Z {"url":"http://localhost:3000/d-solo/245f6eb185f8ac33ccace621ffa78b3d5f7168c7/pm-initializer-integration-production?orgId=1&panelId=28&render=1","level":"debug","message":"Connection closed"}
 2021-05-18T22:32:16.888795363Z {"message":"::ffff:127.0.0.1 - - [18/May/2021:22:32:16 +0000] \"GET /render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=AMb767hooNw0xb901byUSpqDepO0hMXT&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F245f6eb185f8ac33ccace621ffa78b3d5f7168c7%2Fpm-initializer-integration-production%3ForgId%3D1%26panelId%3D28%26render%3D1&width=1000 HTTP/1.1\" - - \"-\" \"Grafana/7.1.5\"\n","level":"debug"}
 2021-05-18T22:32:17.908651634Z {"url":"/render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=swkT9o7zVkQqY3KrjnWZzJXswURm5baN&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F245f6eb185f8ac33ccace621ffa78b3d5f7168c7%2Fpm-initializer-integration-production%3ForgId%3D1%26panelId%3D29%26render%3D1&width=1000","stack":"TimeoutError: Navigation timeout of 15000 ms exceeded\n    at /usr/src/app/node_modules/puppeteer/lib/LifecycleWatcher.js:100:111\n  -- ASYNC --\n    at Frame.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/helper.js:94:19)\n    at Page.goto (/usr/src/app/node_modules/puppeteer/lib/Page.js:485:53)\n    at Page.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/helper.js:95:27)\n    at Browser.<anonymous> (/usr/src/app/build/browser/browser.js:171:24)\n    at Generator.next (<anonymous>)\n    at fulfilled (/usr/src/app/build/browser/browser.js:5:58)\n    at runMicrotasks (<anonymous>)\n    at processTicksAndRejections (internal/process/task_queues.js:93:5)","level":"error","message":"Request failed"}
 2021-05-18T22:34:11.806590238Z {"url":"http://localhost:3000/d-solo/245f6eb185f8ac33ccace621ffa78b3d5f7168c7/pm-initializer-integration-production?orgId=1&panelId=29&render=1","level":"debug","message":"Render request received"}
 2021-05-18T22:34:15.084875325Z {"error":"Error: Page crashed!","level":"error","message":"Browser page crashed"}
 2021-05-18T22:34:26.803764943Z {"url":"http://localhost:3000/d-solo/245f6eb185f8ac33ccace621ffa78b3d5f7168c7/pm-initializer-integration-production?orgId=1&panelId=29&render=1","level":"debug","message":"Connection closed"}
 2021-05-18T22:34:26.804331979Z {"message":"::ffff:127.0.0.1 - - [18/May/2021:22:34:26 +0000] \"GET /render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=mQFuAxOQNrkOpEuzTF25mLpurBk227Na&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F245f6eb185f8ac33ccace621ffa78b3d5f7168c7%2Fpm-initializer-integration-production%3ForgId%3D1%26panelId%3D29%26render%3D1&width=1000 HTTP/1.1\" - - \"-\" \"Grafana/7.1.5\"\n","level":"debug"}
 2021-05-18T22:34:28.387807137Z {"url":"/render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=mQFuAxOQNrkOpEuzTF25mLpurBk227Na&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F245f6eb185f8ac33ccace621ffa78b3d5f7168c7%2Fpm-initializer-integration-production%3ForgId%3D1%26panelId%3D29%26render%3D1&width=1000","stack":"TimeoutError: Navigation timeout of 15000 ms exceeded\n    at /usr/src/app/node_modules/puppeteer/lib/LifecycleWatcher.js:100:111\n  -- ASYNC --\n    at Frame.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/helper.js:94:19)\n    at Page.goto (/usr/src/app/node_modules/puppeteer/lib/Page.js:485:53)\n    at Page.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/helper.js:95:27)\n    at Browser.<anonymous> (/usr/src/app/build/browser/browser.js:171:24)\n    at Generator.next (<anonymous>)\n    at fulfilled (/usr/src/app/build/browser/browser.js:5:58)\n    at runMicrotasks (<anonymous>)\n    at processTicksAndRejections (internal/process/task_queues.js:93:5)","level":"error","message":"Request failed"}
 2021-05-18T22:40:15.890497352Z {"url":"http://localhost:3000/d-solo/63dae39ae810539b3108233c3749bf114998da82/sbr2-compliance-production?orgId=1&panelId=29&render=1","level":"debug","message":"Render request received"}
 2021-05-18T22:40:16.881013187Z {"url":"http://localhost:3000/d-solo/4uoyVOWMk/pod-container-alerts?orgId=1&panelId=8&render=1","level":"debug","message":"Render request received"}
 2021-05-18T22:40:18.942108149Z (node:6) UnhandledPromiseRejectionWarning: Error: Page crashed!
 2021-05-18T22:40:18.942140068Z     at Page._onTargetCrashed (/usr/src/app/node_modules/puppeteer/lib/Page.js:209:28)
 2021-05-18T22:40:18.942146488Z     at CDPSession.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/Page.js:129:57)
 2021-05-18T22:40:18.942150902Z     at CDPSession.emit (events.js:315:20)
 2021-05-18T22:40:18.942154045Z     at CDPSession._onMessage (/usr/src/app/node_modules/puppeteer/lib/Connection.js:166:18)
 2021-05-18T22:40:18.942157338Z     at Connection._onMessage (/usr/src/app/node_modules/puppeteer/lib/Connection.js:83:25)
 2021-05-18T22:40:18.942160645Z     at WebSocket.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/WebSocketTransport.js:25:32)
 2021-05-18T22:40:18.942164072Z     at WebSocket.onMessage (/usr/src/app/node_modules/ws/lib/event-target.js:132:16)
 2021-05-18T22:40:18.942166940Z     at WebSocket.emit (events.js:315:20)
 2021-05-18T22:40:18.942170077Z     at Receiver.receiverOnMessage (/usr/src/app/node_modules/ws/lib/websocket.js:835:20)
 2021-05-18T22:40:18.942173014Z     at Receiver.emit (events.js:315:20)
 2021-05-18T22:40:18.942284038Z (node:6) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). To terminate the node process on unhandled promise rejection, use the CLI flag `--unhandled-rejections=strict` (see https://nodejs.org/api/cli.html#cli_unhandled_rejections_mode). (rejection id: 11)
 2021-05-18T22:40:23.986605989Z {"error":"Error: Page crashed!","level":"error","message":"Browser page crashed"}
 2021-05-18T22:40:30.886978712Z {"url":"http://localhost:3000/d-solo/63dae39ae810539b3108233c3749bf114998da82/sbr2-compliance-production?orgId=1&panelId=29&render=1","level":"debug","message":"Connection closed"}
 2021-05-18T22:40:30.887584790Z {"message":"::ffff:127.0.0.1 - - [18/May/2021:22:40:30 +0000] \"GET /render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=tbDQgnUneD9mHGv8aCRTQ3481OO31s0q&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F63dae39ae810539b3108233c3749bf114998da82%2Fsbr2-compliance-production%3ForgId%3D1%26panelId%3D29%26render%3D1&width=1000 HTTP/1.1\" - - \"-\" \"Grafana/7.1.5\"\n","level":"debug"}
 2021-05-18T22:40:31.823169971Z {"url":"http://localhost:3000/d-solo/4uoyVOWMk/pod-container-alerts?orgId=1&panelId=8&render=1","level":"debug","message":"Connection closed"}
 2021-05-18T22:40:31.823587714Z {"message":"::ffff:127.0.0.1 - - [18/May/2021:22:40:31 +0000] \"GET /render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=57gnMY0Y8s0PuJHKz6nLpEGrlROrKbvG&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F4uoyVOWMk%2Fpod-container-alerts%3ForgId%3D1%26panelId%3D8%26render%3D1&width=1000 HTTP/1.1\" - - \"-\" \"Grafana/7.1.5\"\n","level":"debug"}
 2021-05-18T22:40:37.002166714Z {"url":"/render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=57gnMY0Y8s0PuJHKz6nLpEGrlROrKbvG&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F4uoyVOWMk%2Fpod-container-alerts%3ForgId%3D1%26panelId%3D8%26render%3D1&width=1000","stack":"TimeoutError: Navigation timeout of 15000 ms exceeded\n    at /usr/src/app/node_modules/puppeteer/lib/LifecycleWatcher.js:100:111\n  -- ASYNC --\n    at Frame.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/helper.js:94:19)\n    at Page.goto (/usr/src/app/node_modules/puppeteer/lib/Page.js:485:53)\n    at Page.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/helper.js:95:27)\n    at Browser.<anonymous> (/usr/src/app/build/browser/browser.js:171:24)\n    at Generator.next (<anonymous>)\n    at fulfilled (/usr/src/app/build/browser/browser.js:5:58)\n    at runMicrotasks (<anonymous>)\n    at processTicksAndRejections (internal/process/task_queues.js:93:5)","level":"error","message":"Request failed"}
 2021-05-18T22:41:21.805340266Z {"url":"http://localhost:3000/d-solo/63dae39ae810539b3108233c3749bf114998da82/sbr2-compliance-production?orgId=1&panelId=29&render=1","level":"debug","message":"Render request received"}
 2021-05-18T22:41:23.983682105Z {"error":"Error: Page crashed!","level":"error","message":"Browser page crashed"}
 2021-05-18T22:41:36.802288068Z {"url":"http://localhost:3000/d-solo/63dae39ae810539b3108233c3749bf114998da82/sbr2-compliance-production?orgId=1&panelId=29&render=1","level":"debug","message":"Connection closed"}
 2021-05-18T22:41:36.802720548Z {"message":"::ffff:127.0.0.1 - - [18/May/2021:22:41:36 +0000] \"GET /render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=iwLtTDdgUYu6OHE0uy9y2xj63ROJBUj8&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F63dae39ae810539b3108233c3749bf114998da82%2Fsbr2-compliance-production%3ForgId%3D1%26panelId%3D29%26render%3D1&width=1000 HTTP/1.1\" - - \"-\" \"Grafana/7.1.5\"\n","level":"debug"}
 2021-05-18T22:41:37.437403076Z {"url":"/render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=iwLtTDdgUYu6OHE0uy9y2xj63ROJBUj8&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F63dae39ae810539b3108233c3749bf114998da82%2Fsbr2-compliance-production%3ForgId%3D1%26panelId%3D29%26render%3D1&width=1000","stack":"TimeoutError: Navigation timeout of 15000 ms exceeded\n    at /usr/src/app/node_modules/puppeteer/lib/LifecycleWatcher.js:100:111\n  -- ASYNC --\n    at Frame.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/helper.js:94:19)\n    at Page.goto (/usr/src/app/node_modules/puppeteer/lib/Page.js:485:53)\n    at Page.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/helper.js:95:27)\n    at Browser.<anonymous> (/usr/src/app/build/browser/browser.js:171:24)\n    at Generator.next (<anonymous>)\n    at fulfilled (/usr/src/app/build/browser/browser.js:5:58)\n    at runMicrotasks (<anonymous>)\n    at processTicksAndRejections (internal/process/task_queues.js:93:5)","level":"error","message":"Request failed"}
 2021-05-18T22:44:04.806177231Z {"url":"http://localhost:3000/d-solo/4uoyVOWMk/pod-container-alerts?orgId=1&panelId=8&render=1","level":"debug","message":"Render request received"}
 2021-05-18T22:44:07.182613587Z {"error":"Error: Page crashed!","level":"error","message":"Browser page crashed"}
 2021-05-18T22:44:19.803106962Z {"url":"http://localhost:3000/d-solo/4uoyVOWMk/pod-container-alerts?orgId=1&panelId=8&render=1","level":"debug","message":"Connection closed"}
 2021-05-18T22:44:19.803643659Z {"message":"::ffff:127.0.0.1 - - [18/May/2021:22:44:19 +0000] \"GET /render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=AlbSZe0twKi0xJWpAa23grVatDpl2iYG&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F4uoyVOWMk%2Fpod-container-alerts%3ForgId%3D1%26panelId%3D8%26render%3D1&width=1000 HTTP/1.1\" - - \"-\" \"Grafana/7.1.5\"\n","level":"debug"}
 2021-05-18T22:44:20.422507056Z {"url":"/render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=AlbSZe0twKi0xJWpAa23grVatDpl2iYG&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F4uoyVOWMk%2Fpod-container-alerts%3ForgId%3D1%26panelId%3D8%26render%3D1&width=1000","stack":"TimeoutError: Navigation timeout of 15000 ms exceeded\n    at /usr/src/app/node_modules/puppeteer/lib/LifecycleWatcher.js:100:111\n  -- ASYNC --\n    at Frame.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/helper.js:94:19)\n    at Page.goto (/usr/src/app/node_modules/puppeteer/lib/Page.js:485:53)\n    at Page.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/helper.js:95:27)\n    at Browser.<anonymous> (/usr/src/app/build/browser/browser.js:171:24)\n    at Generator.next (<anonymous>)\n    at fulfilled (/usr/src/app/build/browser/browser.js:5:58)\n    at runMicrotasks (<anonymous>)\n    at processTicksAndRejections (internal/process/task_queues.js:93:5)","level":"error","message":"Request failed"}
 2021-05-18T22:45:12.911815863Z {"url":"http://localhost:3000/d-solo/63dae39ae810539b3108233c3749bf114998da82/sbr2-compliance-production?orgId=1&panelId=29&render=1","level":"debug","message":"Render request received"}
 2021-05-18T22:45:15.096438484Z {"error":"Error: Page crashed!","level":"error","message":"Browser page crashed"}
 2021-05-18T22:45:27.908590870Z {"url":"http://localhost:3000/d-solo/63dae39ae810539b3108233c3749bf114998da82/sbr2-compliance-production?orgId=1&panelId=29&render=1","level":"debug","message":"Connection closed"}
 2021-05-18T22:45:27.908900410Z {"message":"::ffff:127.0.0.1 - - [18/May/2021:22:45:27 +0000] \"GET /render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=gwF4unsyneEDM1soPTMKfB4sB0uTWfX1&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F63dae39ae810539b3108233c3749bf114998da82%2Fsbr2-compliance-production%3ForgId%3D1%26panelId%3D29%26render%3D1&width=1000 HTTP/1.1\" - - \"-\" \"Grafana/7.1.5\"\n","level":"debug"}
 2021-05-18T22:45:28.520988010Z {"url":"/render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=gwF4unsyneEDM1soPTMKfB4sB0uTWfX1&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F63dae39ae810539b3108233c3749bf114998da82%2Fsbr2-compliance-production%3ForgId%3D1%26panelId%3D29%26render%3D1&width=1000","stack":"TimeoutError: Navigation timeout of 15000 ms exceeded\n    at /usr/src/app/node_modules/puppeteer/lib/LifecycleWatcher.js:100:111\n  -- ASYNC --\n    at Frame.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/helper.js:94:19)\n    at Page.goto (/usr/src/app/node_modules/puppeteer/lib/Page.js:485:53)\n    at Page.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/helper.js:95:27)\n    at Browser.<anonymous> (/usr/src/app/build/browser/browser.js:171:24)\n    at Generator.next (<anonymous>)\n    at fulfilled (/usr/src/app/build/browser/browser.js:5:58)\n    at runMicrotasks (<anonymous>)\n    at processTicksAndRejections (internal/process/task_queues.js:93:5)","level":"error","message":"Request failed"}
 2021-05-18T22:52:21.806305091Z {"url":"http://localhost:3000/d-solo/63dae39ae810539b3108233c3749bf114998da82/sbr2-compliance-production?orgId=1&panelId=29&render=1","level":"debug","message":"Render request received"}
 2021-05-18T22:52:23.884499532Z {"error":"Error: Page crashed!","level":"error","message":"Browser page crashed"}
 2021-05-18T22:52:36.799639058Z {"url":"http://localhost:3000/d-solo/63dae39ae810539b3108233c3749bf114998da82/sbr2-compliance-production?orgId=1&panelId=29&render=1","level":"debug","message":"Connection closed"}
 2021-05-18T22:52:36.800045288Z {"message":"::ffff:127.0.0.1 - - [18/May/2021:22:52:36 +0000] \"GET /render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=EVY2ULNZs1JOgJk2LKQp1foCroMCB7XR&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F63dae39ae810539b3108233c3749bf114998da82%2Fsbr2-compliance-production%3ForgId%3D1%26panelId%3D29%26render%3D1&width=1000 HTTP/1.1\" - - \"-\" \"Grafana/7.1.5\"\n","level":"debug"}
 2021-05-18T22:52:37.518247053Z {"url":"/render?deviceScaleFactor=1.000000&domain=localhost&encoding=&height=500&renderKey=EVY2ULNZs1JOgJk2LKQp1foCroMCB7XR&timeout=15&timezone=&url=http%3A%2F%2Flocalhost%3A3000%2Fd-solo%2F63dae39ae810539b3108233c3749bf114998da82%2Fsbr2-compliance-production%3ForgId%3D1%26panelId%3D29%26render%3D1&width=1000","stack":"TimeoutError: Navigation timeout of 15000 ms exceeded\n    at /usr/src/app/node_modules/puppeteer/lib/LifecycleWatcher.js:100:111\n  -- ASYNC --\n    at Frame.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/helper.js:94:19)\n    at Page.goto (/usr/src/app/node_modules/puppeteer/lib/Page.js:485:53)\n    at Page.<anonymous> (/usr/src/app/node_modules/puppeteer/lib/helper.js:95:27)\n    at Browser.<anonymous> (/usr/src/app/build/browser/browser.js:171:24)\n    at Generator.next (<anonymous>)\n    at fulfilled (/usr/src/app/build/browser/browser.js:5:58)\n    at runMicrotasks (<anonymous>)\n    at processTicksAndRejections (internal/process/task_queues.js:93:5)","level":"error","message":"Request failed"}
 2021-05-18T22:56:12.895149535Z {"url":"http://localhost:3000/d-solo/63dae39ae810539b3108233c3749bf114998da82/sbr2-compliance-production?orgId=1&panelId=29&render=1","level":"debug","message":"Render request received"}
 2021-05-18T22:56:14.883797569Z {"error":"Error: Page crashed!","level":"error","message":"Browser page crashed"}

What you expected to happen: not crash 😃

How to reproduce it (as minimally and precisely as possible): I honestly don’t know …

Anything else we need to know?: Mem & CPU usage at that time (logs are in UTC, while screenshot is in UTC+10). This shows some high CPU usage (looks like there were failures at that time as well), then a manual restart of the pod at 9:25, and the pod going through the roof again (and having the same suite of errors)

Environment:

Grafana Image Renderer version: “grafana/grafana-image-renderer:latest”
Grafana version: 7.1.5
Installed plugin or remote renderer service: ?
OS Grafana Image Renderer is installed on: kubernetes AWS EKS 1.19
User OS & Browser: not relevant
Others: installed via this manifest, on top of grafana installed via rancher charts ( https://github.com/rancher/charts/tree/dev-v2.5/charts/rancher-monitoring/rancher-monitoring/9.4.203 )

spec:
  template:
    spec:
      containers:
      - image: grafana/grafana-image-renderer:latest
        imagePullPolicy: IfNotPresent
        name: grafana-image-renderer
        ports:
        - containerPort: 8081
          name: web
          protocol: TCP
        resources:
          limits:
            cpu: 1000m
            memory: 768Mi
          requests:
            cpu: 100m
            memory: 256Mi

About this issue

Original URL
State: closed
Created 3 years ago
Reactions: 2
Comments: 17 (6 by maintainers)

Most upvoted comments

quick update: I did upgrade the memory limit from 768M to 2G: renderer worked almost 5days before crashing again (up from a few hours). (not sure if it’s repeatable yet 😃 )

jgournet on May 25, 2021