superset: Helm chart fails completely
1. Describe Pods
$ kubectl describe pod superset-6d55cbd6cd-n4g26 -n superset
Name: superset-6d55cbd6cd-n4g26
Namespace: superset
Priority: 0
Node: ip-XXXXXXXXXXXXXXXXXX.internal/XXXXXXXXXXXXXXX
Start Time: Tue, 20 Oct 2020 19:00:33 -0400
Labels: app=superset
io.cattle.field/appId=superset
pod-template-hash=6d55cbd6cd
release=superset
Annotations: kubernetes.io/psp: eks.privileged
Status: Running
IP: 172.77.103.174
IPs:
IP: 172.77.103.174
Controlled By: ReplicaSet/superset-6d55cbd6cd
Init Containers:
wait-for-postgres:
Container ID: docker://6f69681cfae08d9e718387584743c9b5016f685709d308026d91c80ddcfae1df
Image: busybox:latest
Image ID: docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d
Port: <none>
Host Port: <none>
Command:
/bin/sh
-c
until nc -zv $DB_HOST $DB_PORT -w1; do echo 'waiting for db'; sleep 1; done
State: Terminated
Reason: Completed
Exit Code: 0
Started: Tue, 20 Oct 2020 19:00:34 -0400
Finished: Tue, 20 Oct 2020 19:00:34 -0400
Ready: True
Restart Count: 0
Environment Variables from:
superset-env Secret Optional: false
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from default-token-47hg6 (ro)
Containers:
superset:
Container ID: docker://2be8afd1300a905c7bc5fcb4638d2b9a8bf224ecccd2020203fa992514e42150
Image: preset/superset:latest
Image ID: docker-pullable://preset/superset@sha256:211d58cfbefa1daa0cb0ca2f850bef62b99ab730575ee9b6bdfa394a2cb9d031
Port: 8088/TCP
Host Port: 0/TCP
Command:
/bin/sh
-c
. /app/pythonpath/superset_bootstrap.sh; /usr/bin/docker-entrypoint.sh
State: Waiting
Reason: CrashLoopBackOff
Last State: Terminated
Reason: Error
Exit Code: 3
Started: Wed, 21 Oct 2020 10:29:17 -0400
Finished: Wed, 21 Oct 2020 10:29:20 -0400
Ready: False
Restart Count: 185
Environment Variables from:
superset-env Secret Optional: false
Environment:
SUPERSET_PORT: 8088
Mounts:
/app/pythonpath from superset-config (ro)
/var/run/secrets/kubernetes.io/serviceaccount from default-token-47hg6 (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
superset-config:
Type: Secret (a volume populated by a Secret)
SecretName: superset-config
Optional: false
default-token-47hg6:
Type: Secret (a volume populated by a Secret)
SecretName: default-token-47hg6
Optional: false
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning BackOff 80s (x4249 over 15h) kubelet, ip-XXXXXXXXXXXXXX.internal Back-off restarting failed container
2. Kubectl Logs:
$ kubectl logs -f superset-6d55cbd6cd-n4g26 -n superset
: not found /app/pythonpath/superset_bootstrap.sh:
: not found /app/pythonpath/superset_bootstrap.sh:
ERROR: Invalid requirement: ''
WARNING: You are using pip version 20.2.3; however, version 20.2.4 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
: not found /app/pythonpath/superset_bootstrap.sh:
[2020-10-21 14:29:18 +0000] [13] [INFO] Starting gunicorn 20.0.4
[2020-10-21 14:29:18 +0000] [13] [INFO] Listening at: http://0.0.0.0:8088 (13)
[2020-10-21 14:29:18 +0000] [13] [INFO] Using worker: gthread
[2020-10-21 14:29:18 +0000] [16] [INFO] Booting worker with pid: 16
Found but failed to import local superset_config
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/cachelib/redis.py", line 41, in __init__
import redis
ModuleNotFoundError: No module named 'redis'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/app/superset/config.py", line 956, in <module>
import superset_config # pylint: disable=import-error
File "/app/pythonpath/superset_config.py", line 39, in <module>
key_prefix='superset_results'
File "/usr/local/lib/python3.7/site-packages/cachelib/redis.py", line 43, in __init__
raise RuntimeError('no redis module found')
RuntimeError: no redis module found
Failed to create app
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/cachelib/redis.py", line 41, in __init__
import redis
ModuleNotFoundError: No module named 'redis'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/app/superset/app.py", line 59, in create_app
app.config.from_object(config_module)
File "/usr/local/lib/python3.7/site-packages/flask/config.py", line 174, in from_object
obj = import_string(obj)
File "/usr/local/lib/python3.7/site-packages/werkzeug/utils.py", line 568, in import_string
__import__(import_name)
File "/app/superset/config.py", line 956, in <module>
import superset_config # pylint: disable=import-error
File "/app/pythonpath/superset_config.py", line 39, in <module>
key_prefix='superset_results'
File "/usr/local/lib/python3.7/site-packages/cachelib/redis.py", line 43, in __init__
raise RuntimeError('no redis module found')
RuntimeError: no redis module found
[2020-10-21 14:29:19 +0000] [16] [ERROR] Exception in worker process
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/cachelib/redis.py", line 41, in __init__
import redis
ModuleNotFoundError: No module named 'redis'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/gunicorn/arbiter.py", line 583, in spawn_worker
worker.init_process()
File "/usr/local/lib/python3.7/site-packages/gunicorn/workers/gthread.py", line 92, in init_process
super().init_process()
File "/usr/local/lib/python3.7/site-packages/gunicorn/workers/base.py", line 119, in init_process
self.load_wsgi()
File "/usr/local/lib/python3.7/site-packages/gunicorn/workers/base.py", line 144, in load_wsgi
self.wsgi = self.app.wsgi()
File "/usr/local/lib/python3.7/site-packages/gunicorn/app/base.py", line 67, in wsgi
self.callable = self.load()
File "/usr/local/lib/python3.7/site-packages/gunicorn/app/wsgiapp.py", line 49, in load
return self.load_wsgiapp()
File "/usr/local/lib/python3.7/site-packages/gunicorn/app/wsgiapp.py", line 39, in load_wsgiapp
return util.import_app(self.app_uri)
File "/usr/local/lib/python3.7/site-packages/gunicorn/util.py", line 411, in import_app
app = app(*args, **kwargs)
File "/app/superset/app.py", line 69, in create_app
raise ex
File "/app/superset/app.py", line 59, in create_app
app.config.from_object(config_module)
File "/usr/local/lib/python3.7/site-packages/flask/config.py", line 174, in from_object
obj = import_string(obj)
File "/usr/local/lib/python3.7/site-packages/werkzeug/utils.py", line 568, in import_string
__import__(import_name)
File "/app/superset/config.py", line 956, in <module>
import superset_config # pylint: disable=import-error
File "/app/pythonpath/superset_config.py", line 39, in <module>
key_prefix='superset_results'
File "/usr/local/lib/python3.7/site-packages/cachelib/redis.py", line 43, in __init__
raise RuntimeError('no redis module found')
RuntimeError: no redis module found
[2020-10-21 14:29:19 +0000] [16] [INFO] Worker exiting (pid: 16)
[2020-10-21 14:29:20 +0000] [13] [INFO] Shutting down: Master
[2020-10-21 14:29:20 +0000] [13] [INFO] Reason: Worker failed to boot
About this issue
- Original URL
- State: closed
- Created 4 years ago
- Comments: 15 (6 by maintainers)
@mistercrunch plz see above — I’ve left multiple messages in slack channel. You didn’t do the right things to try & reproduce the issue. I’m a bit frustrated tbh: You also didn’t answer any of my questions to clarify carries in things.
Issue-Label Bot is automatically applying the label
#bugto this issue, with a confidence of 0.84. Please mark this comment with 👍 or 👎 to give our bot feedback!Links: app homepage, dashboard and code for this bot.