node_exporter: node_exporter can't work on Centos 7

Host operating system: output of uname -a

[aaa@localhost ~]$ uname -a

Linux localhost.localdomain 3.10.0-327.el7.x86_64 #1 SMP Thu Nov 19 22:10:57 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

node_exporter version: output of node_exporter --version

node_exporter, version 0.15.0 (branch: HEAD, revision: 6e2053c557f96efb63aef3691f15335a70baaffd) build user: root@168089f37ad9 build date: 20171006-11:33:58 go version: go1.9.1

node_exporter command line flags

sudo ./node_exporter --log.level=“debug” --no-collector.zfs

Are you running node_exporter in Docker?

no. it didn’t work in docker

What did you do that produced an error?

[aaa@localhost ~]$ sudo ./node_exporter --log.level=“debug” --no-collector.zfs INFO[0000] Starting node_exporter (version=0.15.0, branch=HEAD, revision=6e2053c557f96efb63aef3691f15335a70baaffd) source=“node_exporter.go:43” INFO[0000] Build context (go=go1.9.1, user=root@168089f37ad9, date=20171006-11:33:58) source=“node_exporter.go:44” INFO[0000] No directory specified, see --collector.textfile.directory source=“textfile.go:57” INFO[0000] Enabled collectors: source=“node_exporter.go:50” INFO[0000] - filesystem source=“node_exporter.go:52” INFO[0000] - vmstat source=“node_exporter.go:52” INFO[0000] - edac source=“node_exporter.go:52” INFO[0000] - hwmon source=“node_exporter.go:52” INFO[0000] - infiniband source=“node_exporter.go:52” INFO[0000] - meminfo source=“node_exporter.go:52” INFO[0000] - textfile source=“node_exporter.go:52” INFO[0000] - cpu source=“node_exporter.go:52” INFO[0000] - entropy source=“node_exporter.go:52” INFO[0000] - arp source=“node_exporter.go:52” INFO[0000] - sockstat source=“node_exporter.go:52” INFO[0000] - loadavg source=“node_exporter.go:52” INFO[0000] - netdev source=“node_exporter.go:52” INFO[0000] - wifi source=“node_exporter.go:52” INFO[0000] - timex source=“node_exporter.go:52” INFO[0000] - xfs source=“node_exporter.go:52” INFO[0000] - netstat source=“node_exporter.go:52” INFO[0000] - diskstats source=“node_exporter.go:52” INFO[0000] - mdadm source=“node_exporter.go:52” INFO[0000] - time source=“node_exporter.go:52” INFO[0000] - conntrack source=“node_exporter.go:52” INFO[0000] - filefd source=“node_exporter.go:52” INFO[0000] - ipvs source=“node_exporter.go:52” INFO[0000] - stat source=“node_exporter.go:52” INFO[0000] - uname source=“node_exporter.go:52” INFO[0000] - bcache source=“node_exporter.go:52” INFO[0000] Listening on :9100 source=“node_exporter.go:76” DEBU[0005] OK: bcache collector succeeded after 0.000072s. source=“collector.go:126” DEBU[0005] CPU “/sys/bus/cpu/devices/cpu0” is missing cpufreq source=“cpu_linux.go:114” DEBU[0005] CPU “/sys/bus/cpu/devices/cpu0” is missing thermal_throttle source=“cpu_linux.go:135” DEBU[0005] Package “/sys/bus/node/devices/node0” CPU “0” is missing package_throttle source=“cpu_linux.go:166” DEBU[0005] OK: cpu collector succeeded after 0.000471s. source=“collector.go:126” DEBU[0005] Ignoring mount point: /sys source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /proc source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /dev source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/kernel/security source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /dev/shm source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /dev/pts source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/fs/cgroup source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/fs/cgroup/systemd source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/fs/pstore source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/fs/cgroup/devices source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/fs/cgroup/cpu,cpuacct source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/fs/cgroup/memory source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/fs/cgroup/perf_event source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/fs/cgroup/freezer source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/fs/cgroup/net_cls source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/fs/cgroup/cpuset source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/fs/cgroup/hugetlb source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/fs/cgroup/blkio source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/kernel/config source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /proc/sys/fs/binfmt_misc source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /sys/kernel/debug source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /dev/mqueue source=“filesystem_linux.go:42” DEBU[0005] Ignoring mount point: /dev/hugepages source=“filesystem_linux.go:42” DEBU[0005] OK: filesystem collector succeeded after 0.000990s. source=“collector.go:126” DEBU[0005] OK: edac collector succeeded after 0.000022s. source=“collector.go:126” DEBU[0005] Unable to detect InfiniBand devices source=“infiniband_linux.go:110” DEBU[0005] OK: infiniband collector succeeded after 0.000081s. source=“collector.go:126” DEBU[0005] Set node_mem: map[string]float64{“WritebackTmp”:0, “HugePages_Rsvd”:0, “DirectMap4k”:6.2849024e+07, “DirectMap2M”:2.084569088e+09, “Inactive_file”:1.22441728e+08, “SwapTotal”:2.147479552e+09, “KernelStack”:2.12992e+06, “PageTables”:4.52608e+06, “VmallocTotal”:3.5184372087808e+13, “Buffers”:970752, “Unevictable”:0, “HugePages_Total”:0, “Dirty”:8192, “CommitLimit”:3.112349696e+09, “Active_file”:3.760128e+07, “AnonPages”:5.5844864e+07, “SUnreclaim”:1.570816e+07, “Committed_AS”:4.00420864e+08, “MemAvailable”:1.667551232e+09, “Cached”:1.6797696e+08, “Mlocked”:0, “HugePages_Surp”:0, “MemTotal”:1.929740288e+09, “MemFree”:1.611333632e+09, “SwapFree”:2.147479552e+09, “Shmem”:8.904704e+06, “SReclaimable”:2.299904e+07, “Bounce”:0, “AnonHugePages”:8.388608e+06, “Active”:9.3741056e+07, “Inactive”:1.3099008e+08, “HugePages_Free”:0, “Hugepagesize”:2.097152e+06, “Writeback”:0, “VmallocChunk”:3.5184201691136e+13, “Inactive_anon”:8.548352e+06, “Mapped”:4.3884544e+07, “Slab”:3.87072e+07, “NFS_Unstable”:0, “VmallocUsed”:1.61316864e+08, “HardwareCorrupted”:0, “SwapCached”:0, “Active_anon”:5.6139776e+07} source=“meminfo.go:48” DEBU[0005] OK: meminfo collector succeeded after 0.000517s. source=“collector.go:126” DEBU[0005] OK: textfile collector succeeded after 0.000000s. source=“collector.go:126” DEBU[0005] OK: entropy collector succeeded after 0.000061s. source=“collector.go:126” DEBU[0005] OK: arp collector succeeded after 0.000098s. source=“collector.go:126” DEBU[0005] OK: sockstat collector succeeded after 0.000149s. source=“collector.go:126” DEBU[0005] return load 0: 0.000000 source=“loadavg.go:51” DEBU[0005] return load 1: 0.010000 source=“loadavg.go:51” DEBU[0005] return load 2: 0.050000 source=“loadavg.go:51” DEBU[0005] OK: loadavg collector succeeded after 0.000116s. source=“collector.go:126” DEBU[0005] OK: netdev collector succeeded after 0.000479s. source=“collector.go:126” DEBU[0005] OK: wifi collector succeeded after 0.000247s. source=“collector.go:126” DEBU[0005] OK: timex collector succeeded after 0.000024s. source=“collector.go:126” DEBU[0005] OK: xfs collector succeeded after 0.000157s. source=“collector.go:126” DEBU[0005] OK: netstat collector succeeded after 0.001702s. source=“collector.go:126” DEBU[0005] Ignoring device: fd0 source=“diskstats_linux.go:175” DEBU[0005] Ignoring device: sda1 source=“diskstats_linux.go:175” DEBU[0005] Ignoring device: sda2 source=“diskstats_linux.go:175” DEBU[0005] OK: diskstats collector succeeded after 0.000333s. source=“collector.go:126” DEBU[0005] OK: mdadm collector succeeded after 0.000084s. source=“collector.go:126” DEBU[0005] Return time: 1507873748.996584 source=“time.go:47” DEBU[0005] OK: time collector succeeded after 0.000041s. source=“collector.go:126” DEBU[0005] OK: conntrack collector succeeded after 0.000086s. source=“collector.go:126” DEBU[0005] OK: filefd collector succeeded after 0.000064s. source=“collector.go:126” DEBU[0005] ipvs collector metrics are not available for this system source=“ipvs_linux.go:113” DEBU[0005] OK: ipvs collector succeeded after 0.000099s. source=“collector.go:126” DEBU[0005] OK: stat collector succeeded after 0.000185s. source=“collector.go:126” DEBU[0005] OK: uname collector succeeded after 0.000049s. source=“collector.go:126” DEBU[0005] OK: vmstat collector succeeded after 0.008549s. source=“collector.go:126”

use curl to do a testing [aaa@localhost ~]$ curl http://10.29.101.101:9100/metrics --max-time 10 -kvv

  • About to connect() to 10.29.101.101 port 9100 (#0)
  • Trying 10.29.101.101…
  • Connected to 10.29.101.101 (10.29.101.101) port 9100 (#0)

GET /metrics HTTP/1.1 User-Agent: curl/7.29.0 Host: 10.29.101.101:9100 Accept: /

  • Operation timed out after 10001 milliseconds with 0 out of -1 bytes received
  • Closing connection 0 curl: (28) Operation timed out after 10001 milliseconds with 0 out of -1 bytes received

What did you expect to see?

no output on Centos7 http://10.29.101.101:9100/metrics. The same process can work well on ubuntu 16.04. it seem it is hanging on some step, would you please take a look?

What did you see instead?

About this issue

  • Original URL
  • State: closed
  • Created 7 years ago
  • Comments: 47 (19 by maintainers)

Most upvoted comments

We have published v0.15.1 that contains the workaround for broken hwmon data. Please post if it improves things.