traefik: Pilot and Hub services are down and Traefik doesn't start
Welcome!
- Yes, I’ve searched similar issues on GitHub and didn’t find any.
- Yes, I’ve searched similar issues on the Traefik community forum and didn’t find any.
What did you do?
Configured a plugin, restarted Traefik, but pilot service (hub too) is down, so Traefik doesn’t start. Duplicate of #8617 that was closed as fixed.
What did you see instead?
Duplicate of #8617 that was closed as solved.
What version of Traefik are you using?
Version: 2.8.3
Codename: vacherin
Go version: go1.19
Built: 2022-08-12T14:24:34Z
OS/Arch: linux/amd64
What is your environment & configuration?
# N/A
Add more configuration information here.
If applicable, please paste the log output in DEBUG level
No response
About this issue
- Original URL
- State: closed
- Created 2 years ago
- Reactions: 1
- Comments: 18 (9 by maintainers)
If this can help, the list of plugins:
git clone git@github.com:17media/plugin-allowpath.gitgit clone git@github.com:23deg/jwt-middleware.gitgit clone git@github.com:aarlint/pathauth.gitgit clone git@github.com:acouvreur/traefik-modsecurity-plugin.gitgit clone git@github.com:acouvreur/traefik-ondemand-plugin.gitgit clone git@github.com:adyanth/traefik-container-manager.gitgit clone git@github.com:agence-gaya/traefik-plugin-blockuseragent.gitgit clone git@github.com:alex-held/traefik-plugin-rerouter.gitgit clone git@github.com:alexandrebouthinon/traefik-kuzzle-auth.gitgit clone git@github.com:alexandreh2ag/traefik-ipfilter-basicauth.gitgit clone git@github.com:apwe/headerproxy.gitgit clone git@github.com:argyle-engineering/copy-header-value-traefik-plugin.gitgit clone git@github.com:AustinHellerRepo/TraefikOutboundLimiter.gitgit clone git@github.com:axiaoxin/traefikplugindemo.gitgit clone git@github.com:bay1ts/SiriusGeo.gitgit clone git@github.com:Beanow/traefik-plugin-rawdata.gitgit clone git@github.com:benoitg31/traefik-forced-body-plugin.gitgit clone git@github.com:BetterCorp/cloudflarewarp.gitgit clone git@github.com:bukukasio/super-rate.gitgit clone git@github.com:carnage-sh/sessionmapper.gitgit clone git@github.com:che-incubator/header-rewrite-traefik-plugin.gitgit clone git@github.com:CorentinMAG/geoip.gitgit clone git@github.com:dariopb/traefikServiceFabricPlugin.gitgit clone git@github.com:dariusandz/header-transmute.gitgit clone git@github.com:darkweak/souin.gitgit clone git@github.com:dclairac/traefik-plugin-headers.gitgit clone git@github.com:dgzlopes/traefik-fault-injection.gitgit clone git@github.com:Dimoniq/jwtvalidator.gitgit clone git@github.com:dimorder/dimdanredirect.gitgit clone git@github.com:dkijkuit/azurejwttokenvalidation.gitgit clone git@github.com:dkijkuit/checkheadersplugin.gitgit clone git@github.com:domainesia/traefik-plugin-reformatheader.gitgit clone git@github.com:dragosnutu/traefik-plugin.gitgit clone git@github.com:EasySolutionsIO/traefikxrequeststart.gitgit clone git@github.com:evolves-fr/traefik-plugin-redirect.gitgit clone git@github.com:fdufault/mapheaders.gitgit clone git@github.com:FinalCAD/TraefikRegionalPlugin.gitgit clone git@github.com:florentinl/websitepathconverter.gitgit clone git@github.com:galaxias/traefik-vault-auth.gitgit clone git@github.com:GiGInnovationLabs/traefikgeoip2.gitgit clone git@github.com:GiGInnovationLabs/traefikuseragent.gitgit clone git@github.com:Hongbo-Miao/traefik-plugin-disable-graphql-introspection.gitgit clone git@github.com:igoooor/conteo-traefik-cache.gitgit clone git@github.com:irotem/jwt-rewrite.gitgit clone git@github.com:iYUYUE/traefik-forwarded-real-ip.gitgit clone git@github.com:jackhillman/pluginesi.gitgit clone git@github.com:jerrywoo96/AddForwardedHeader.gitgit clone git@github.com:jerrywoo96/AddMissingHeaders.gitgit clone git@github.com:jpxd/torblock.gitgit clone git@github.com:kevtainer/denyip.gitgit clone git@github.com:kingjan1999/traefik-plugin-exception-authbasic.gitgit clone git@github.com:kucjac/traefik-block-ua.gitgit clone git@github.com:kucjac/traefik-plugin-geoblock.gitgit clone git@github.com:kumina/headers-by-request.gitgit clone git@github.com:kumina/traefik-routing-plugin.gitgit clone git@github.com:kzmake/traefik-plugin-forward-request.gitgit clone git@github.com:Lepkem/traefik-plugin-response-code-override.gitgit clone git@github.com:lion7/traefik-jwt-headers-plugin.gitgit clone git@github.com:lixianliang/traefik-plugin-return-response.gitgit clone git@github.com:LyuHe-uestc/traefik-plugin-check.gitgit clone git@github.com:LyuHe-uestc/traefik-plugin-token-auth.gitgit clone git@github.com:mayankkumar2/traefik-plugin-securum-exire.gitgit clone git@github.com:mrdrelar/traefik-plugin-rewriteheader.gitgit clone git@github.com:muhgumus/traefik-token-middleware.gitgit clone git@github.com:nese/forwardcookie.gitgit clone git@github.com:nilskohrs/environmentheader.gitgit clone git@github.com:nilskohrs/headerblock.gitgit clone git@github.com:nilskohrs/pathauth.gitgit clone git@github.com:nilskohrs/regex2redirect.gitgit clone git@github.com:nilskohrs/reproxied.gitgit clone git@github.com:nilskohrs/stripcookie.gitgit clone git@github.com:n0m4dz/jwt-cors.gitgit clone git@github.com:nscuro/traefik-plugin-geoblock.gitgit clone git@github.com:packruler/rewrite-body.gitgit clone git@github.com:packruler/traefik-themepark.gitgit clone git@github.com:PascalMinder/geoblock.gitgit clone git@github.com:PavloZastavnyi/headerstransformation.gitgit clone git@github.com:Paxxs/traefik-get-real-ip.gitgit clone git@github.com:pierre-verhaeghe/traefik-replace-response-code.gitgit clone git@github.com:pipe01/plugin-requestid.gitgit clone git@github.com:portofrotterdam/environmentheader.gitgit clone git@github.com:portofrotterdam/headerblock.gitgit clone git@github.com:portofrotterdam/pathauth.gitgit clone git@github.com:portofrotterdam/regex2redirect.gitgit clone git@github.com:portofrotterdam/reproxied.gitgit clone git@github.com:portofrotterdam/stripcookie.gitgit clone git@github.com:pvalletbo/traefik-blocklist.gitgit clone git@github.com:pvalletbo/traefik-forwarded-real-ip.gitgit clone git@github.com:qxsugar/request-dispatch.gitgit clone git@github.com:qxsugar/request-mark.gitgit clone git@github.com:Rajabalian/ipclient.gitgit clone git@github.com:rocdove/replacepathfromurlregex.gitgit clone git@github.com:romracer/traefik-get-real-ip.gitgit clone git@github.com:Russia9/body-size-limit.gitgit clone git@github.com:scrazy77/plugin-simplecache-nocache.gitgit clone git@github.com:snapt/traefik-nova-plugin.gitgit clone git@github.com:soulbalz/correlationid.gitgit clone git@github.com:soulbalz/traefik-check-body.gitgit clone git@github.com:soulbalz/traefik-real-ip.gitgit clone git@github.com:s00rk/firebase-verify-token.gitgit clone git@github.com:sunalwaysknows/redirect2https.gitgit clone git@github.com:suteqa/plugin_record.gitgit clone git@github.com:team-carepay/traefik-jwt-plugin.gitgit clone git@github.com:team-carepay/traefik-opa-plugin.gitgit clone git@github.com:tnt-sbab/jwt-verifier.gitgit clone git@github.com:tnt-sbab/token-translator.gitgit clone git@github.com:togettoyou/traefik-timer-plugin.gitgit clone git@github.com:tomMoulard/fail2ban.gitgit clone git@github.com:tomMoulard/htransformation.gitgit clone git@github.com:traefik/plugin-blockpath.gitgit clone git@github.com:traefik/plugin-log4shell.gitgit clone git@github.com:traefik/plugin-rewritebody.gitgit clone git@github.com:traefik/plugin-simplecache.gitgit clone git@github.com:traefik/plugindemo.gitgit clone git@github.com:traefik/pluginproviderdemo.gitgit clone git@github.com:trinnylondon/lowercase.gitgit clone git@github.com:trinnylondon/redirector.gitgit clone git@github.com:trinnylondon/traefik-add-trace-id.gitgit clone git@github.com:Uscreen-video/traefik-plugin-rewritehost.gitgit clone git@github.com:vaspapadopoulos/traefik-cookie-handler-plugin.gitgit clone git@github.com:vidosits/header-pattern-proxy.gitgit clone git@github.com:vincentinttsh/cloudflareip.gitgit clone git@github.com:vincentinttsh/rewriteheaders.gitgit clone git@github.com:virtualzone/rewriteheaders.gitgit clone git@github.com:vtacquet/redbase-plugin.gitgit clone git@github.com:wiltonsr/ldapAuth.gitgit clone git@github.com:worldline-go/traefik-plugin-hello.gitgit clone git@github.com:XciD/traefik-plugin-rewrite-headers.gitgit clone git@github.com:0xDagal/charon-passto.gitgit clone git@github.com:ytyuanxi/userinfo.gitgit clone git@github.com:ZeroGachis/traefik-auth-middleware.gitgit clone git@github.com:ZeroGachis/traefik-magic-jwt.gitThanks a lot Ludovic.
The plugin services are restored. The hem chart is restored.
The other services will come back quickly.
Sorry for the service interruption.
I got the git clone line from the plugin repository, but the list is helpful for unexperienced people.
Good that the hub active config is not stopping the service.
I was thinking: maybe Traefik could automatically cache a local copy of the plugin, and use that, then periodically it can refresh the local cloned repo. So you don’t have to distinguish between local/remote plugins.
Ludovic, the local plugin is working perfectly, this is the config I used:
I didn’t need to disable the hub, Traefik starts anyway, and I see no errors in the log.
We’re currently restoring our cluster, we are doing the quickest we can.
@alexdelprete a workaround can be to use local plugins: https://github.com/traefik/plugindemo#local-mode
You will have to clone plugin repos (I can help to find it) and mount that.