prerender: a lot of 504 errors

I get so many 504 errors. it’s weirdly after 404 errors, not sure this is related though.

2017-12-04T11:43:08.122Z got 504 in 5ms for http://avinhandmade.ir/page/page/collection/about
11:43:28 1|server   | 2017-12-04T11:43:28.471Z getting https://domainaftermarket.ir/product/59dcf11284d21003b127541a
11:44:39 0|server   | 2017-12-04T11:44:39.462Z getting http://awaservice.ir/product/593a9dc6aa4fe10083642377
11:44:39 0|server   | Error: unexpected server response (404)
11:44:39 0|server   |     at ClientRequest._req.on (/usr/src/app/node_modules/ws/lib/WebSocket.js:651:26)
11:44:39 0|server   |     at emitOne (events.js:116:13)
11:44:39 0|server   |     at ClientRequest.emit (events.js:211:7)
11:44:39 0|server   |     at HTTPParser.parserOnIncomingClient (_http_client.js:551:21)
11:44:39 0|server   |     at HTTPParser.parserOnHeadersComplete (_http_common.js:117:23)
11:44:39 0|server   |     at Socket.socketOnData (_http_client.js:440:20)
11:44:39 0|server   |     at emitOne (events.js:116:13)
11:44:39 0|server   |     at Socket.emit (events.js:211:7)
11:44:39 0|server   |     at addChunk (_stream_readable.js:263:12)
11:44:39 0|server   |     at readableAddChunk (_stream_readable.js:250:11)
11:44:39 0|server   | 2017-12-04T11:44:39.467Z got 504 in 5ms for http://awaservice.ir/product/593a9dc6aa4fe10083642377
11:45:18 1|server   | 2017-12-04T11:45:18.447Z getting http://gbrand.ir/product/212VIP
11:45:57 0|server   | 2017-12-04T11:45:57.645Z getting http://kawaiishop.ir/collection/5931869ade6b390082256462
11:45:57 0|server   | Error: unexpected server response (404)
11:45:57 0|server   |     at ClientRequest._req.on (/usr/src/app/node_modules/ws/lib/WebSocket.js:651:26)
11:45:57 0|server   |     at emitOne (events.js:116:13)
11:45:57 0|server   |     at ClientRequest.emit (events.js:211:7)
11:45:57 0|server   |     at HTTPParser.parserOnIncomingClient (_http_client.js:551:21)
11:45:57 0|server   |     at HTTPParser.parserOnHeadersComplete (_http_common.js:117:23)
11:45:57 0|server   |     at Socket.socketOnData (_http_client.js:440:20)
11:45:57 0|server   |     at emitOne (events.js:116:13)
11:45:57 0|server   |     at Socket.emit (events.js:211:7)
11:45:57 0|server   |     at addChunk (_stream_readable.js:263:12)
11:45:57 0|server   |     at readableAddChunk (_stream_readable.js:250:11)
11:45:57 0|server   | 2017-12-04T11:45:57.651Z got 504 in 6ms for http://kawaiishop.ir/collection/5931869ade6b390082256462
11:46:22 1|server   | 2017-12-04T11:46:22.451Z getting http://monirshop.com/product/types/collection/faq
11:47:11 0|server   | 2017-12-04T11:47:11.553Z getting http://sportito.ir/tag/پوشاک کیک بوکس و موی تای
11:47:11 0|server   | Error: unexpected server response (404)
11:47:11 0|server   |     at ClientRequest._req.on (/usr/src/app/node_modules/ws/lib/WebSocket.js:651:26)
11:47:11 0|server   |     at emitOne (events.js:116:13)
11:47:11 0|server   |     at ClientRequest.emit (events.js:211:7)
11:47:11 0|server   |     at HTTPParser.parserOnIncomingClient (_http_client.js:551:21)
11:47:11 0|server   |     at HTTPParser.parserOnHeadersComplete (_http_common.js:117:23)
11:47:11 0|server   |     at Socket.socketOnData (_http_client.js:440:20)
11:47:11 0|server   |     at emitOne (events.js:116:13)
11:47:11 0|server   |     at Socket.emit (events.js:211:7)
11:47:11 0|server   |     at addChunk (_stream_readable.js:263:12)
11:47:11 0|server   |     at readableAddChunk (_stream_readable.js:250:11)
11:47:11 0|server   | 2017-12-04T11:47:11.560Z got 504 in 7ms for http://sportito.ir/tag/پوشاک کیک بوکس و موی تای
11:48:03 1|server   | 2017-12-04T11:48:03.427Z getting http://kawaiishop.ir/faq
11:49:14 0|server   | 2017-12-04T11:49:14.703Z getting http://domainaftermarket.ir/product/artbastan.ir
11:49:14 0|server   | Error: unexpected server response (404)
11:49:14 0|server   |     at ClientRequest._req.on (/usr/src/app/node_modules/ws/lib/WebSocket.js:651:26)
11:49:14 0|server   |     at emitOne (events.js:116:13)
11:49:14 0|server   |     at ClientRequest.emit (events.js:211:7)
11:49:14 0|server   |     at HTTPParser.parserOnIncomingClient (_http_client.js:551:21)
11:49:14 0|server   |     at HTTPParser.parserOnHeadersComplete (_http_common.js:117:23)
11:49:14 0|server   |     at Socket.socketOnData (_http_client.js:440:20)
11:49:14 0|server   |     at emitOne (events.js:116:13)
11:49:14 0|server   |     at Socket.emit (events.js:211:7)
11:49:14 0|server   |     at addChunk (_stream_readable.js:263:12)
11:49:14 0|server   |     at readableAddChunk (_stream_readable.js:250:11)
11:49:14 0|server   | 2017-12-04T11:49:14.707Z got 504 in 4ms for http://domainaftermarket.ir/product/artbastan.ir
11:50:09 1|server   | 2017-12-04T11:50:09.099Z getting http://baamco.ir/product/collection/page/register
11:50:58 0|server   | 2017-12-04T11:50:58.346Z getting http://awaservice.ir/product/5a196adc03ae920083403f83
11:50:58 0|server   | Error: unexpected server response (404)
11:50:58 0|server   |     at ClientRequest._req.on (/usr/src/app/node_modules/ws/lib/WebSocket.js:651:26)
11:50:58 0|server   |     at emitOne (events.js:116:13)
11:50:58 0|server   |     at ClientRequest.emit (events.js:211:7)
11:50:58 0|server   |     at HTTPParser.parserOnIncomingClient (_http_client.js:551:21)
11:50:58 0|server   |     at HTTPParser.parserOnHeadersComplete (_http_common.js:117:23)
11:50:58 0|server   |     at Socket.socketOnData (_http_client.js:440:20)
11:50:58 0|server   |     at emitOne (events.js:116:13)
11:50:58 0|server   |     at Socket.emit (events.js:211:7)
11:50:58 0|server   |     at addChunk (_stream_readable.js:263:12)
11:50:58 0|server   |     at readableAddChunk (_stream_readable.js:250:11)
11:50:58 0|server   | 2017-12-04T11:50:58.349Z got 504 in 3ms for http://awaservice.ir/product/5a196adc03ae920083403f83
11:51:29 1|server   | 2017-12-04T11:51:29.898Z getting http://kawaiishop.ir/collection/5947dd680ad47d00842489a9
11:58:06 0|server   | 2017-12-04T11:58:06.055Z getting http://annishop.ir/tag/ظرف/tag/faq
11:58:06 0|server   | Error: unexpected server response (404)
11:58:06 0|server   |     at ClientRequest._req.on (/usr/src/app/node_modules/ws/lib/WebSocket.js:651:26)
11:58:06 0|server   |     at emitOne (events.js:116:13)
11:58:06 0|server   |     at ClientRequest.emit (events.js:211:7)
11:58:06 0|server   |     at HTTPParser.parserOnIncomingClient (_http_client.js:551:21)
11:58:06 0|server   |     at HTTPParser.parserOnHeadersComplete (_http_common.js:117:23)
11:58:06 0|server   |     at Socket.socketOnData (_http_client.js:440:20)
11:58:06 0|server   |     at emitOne (events.js:116:13)
11:58:06 0|server   |     at Socket.emit (events.js:211:7)
11:58:06 0|server   |     at addChunk (_stream_readable.js:263:12)
11:58:06 0|server   |     at readableAddChunk (_stream_readable.js:250:11)
11:58:06 0|server   | 2017-12-04T11:58:06.060Z got 504 in 5ms for http://annishop.ir/tag/ظرف/tag/faq
11:58:39 1|server   | 2017-12-04T11:58:39.449Z getting http://inko.mykamva.ir/products/product/tag/login
11:59:20 0|server | 2017-12-04T11:59:20.595Z getting http://avinhandmade.ir/profile

I have no idea why I get 504 which is gateway timeout in like 5ms. I get so many of them! it’s worth noting that 404 errors are real but, I’m not getting 504 errors for those urls

About this issue

Original URL
State: closed
Created 7 years ago
Comments: 26 (14 by maintainers)

Most upvoted comments

I just pushed v5.2.0 of the Prerender server to have Prerender restart Chrome every 10 minutes if there are no requests in flight and every hour if there are requests in flight for the whole hour.

At the hour mark, all new requests will wait until in-flight requests have finished and until the server is restarted before continuing. Again, that’s only if there’s a browser request in flight for the full hour. The waiting is to prevent a 504 for any URLs by letting them take a little longer to load by waiting.

This bandaid isn’t ideal but it should be a short term fix and shouldn’t cause any issues.

Please let me know if you try this out and if it improves the stability of the Prerender server.

thoop on Dec 9, 2017