kubernetes: Nodes do not report memory on 1.21.0

Is this a request for help?

If yes, you should use our troubleshooting guide and community support channels, see http://kubernetes.io/docs/troubleshooting/.

If no, delete this section and continue on.

What keywords did you search in kubeadm issues before filing this one?

memory, no report, metrics

Is this a BUG REPORT or FEATURE REQUEST?

Choose one: BUG REPORT

Versions

kubeadm version (use kubeadm version):

Environment:

  • Kubernetes version (use kubectl version): Client Version: version.Info{Major:"1", Minor:"21", GitVersion:"v1.21.0", GitCommit:"cb303e613a121a29364f75cc67d3d580833a7479", GitTreeState:"clean", BuildDate:"2021-04-26T00:00:00Z", GoVersion:"go1.16.3", Compiler:"gc", Platform:"linux/amd64"}
  • Cloud provider or hardware configuration: DigitalOcean
  • OS (e.g. from /etc/os-release): openSUSE Kubic
  • Kernel (e.g. uname -a): 5.12.0
  • Others: CRI-O

What happened?

kubectl get --raw /api/v1/nodes/nyc1-master-1/proxy/stats/summary

Does not report memory

What you expected to happen?

{                                                                                                                                                                            
 "node": {                                                                                                                                                                   
  "nodeName": "nyc1-master-1",                                                                                                                                               
  "systemContainers": [                                                                                                                                                      
   {                                                                                                                                                                         
    "name": "kubelet",                                                                                                                                                       
    "startTime": "2021-05-06T01:33:03Z",                                                                                                                                     
    "cpu": {                                                                                                                                                                 
     "time": "2021-05-06T21:53:29Z",                                                                                                                                         
     "usageNanoCores": 0,                                                                                                                                                    
     "usageCoreNanoSeconds": 0                                                                                                                                               
    },                                                                                                                                                                       
    "memory": {                                                                                                                                                              
     "time": "2021-05-06T21:53:29Z",                                                                                                                                         
     "availableBytes": 4108148736,                                                                                                                                           
     "usageBytes": 0,                                                                                                                                                        
     "workingSetBytes": 0,                                                                                                                                                   
     "rssBytes": 0,                                                                                                                                                          
     "pageFaults": 0,                                                                                                                                                        
     "majorPageFaults": 0                                                                                                                                                    
    }                                                                                                                                                                        
   },                                                                                                                                                                        
   {                                                                                                                                                                         
    "name": "pods",                                                                                                                                                          
    "startTime": "2021-05-06T01:33:03Z",                                                                                                                                     
    "cpu": {                                                                                                                                                                 
     "time": "2021-05-06T21:53:31Z",                                                                                                                                         
     "usageNanoCores": 194810666,                                                                                                                                            
     "usageCoreNanoSeconds": 15374004459000                                                                                                                                  
    },                                                                                                                                                                       
    "memory": {                                                                                                                                                              
     "time": "2021-05-06T21:53:31Z",                                                                                                                                         
     "availableBytes": 1932058624,                                                                                                                                           
     "usageBytes": 2959253504,                                                                                                                                               
     "workingSetBytes": 2176090112,                                                                                                                                          
     "rssBytes": 1329647616,                                                                                                                                                 
     "pageFaults": 1091871,                                                                                                                                                  
     "majorPageFaults": 33                                                                                                                                                   
    }                                                                                                                                                                        
   }                                                                                                                                                                         
  ],  

Memory metrics populated

How to reproduce it (as minimally and precisely as possible)?

  1. Install Kubic
  2. kubeadm init
  3. kubectl get --raw /api/v1/nodes/nyc1-master-1/proxy/stats/summary

Anything else we need to know?

Tracking related issues

https://github.com/kubernetes-sigs/metrics-server/issues/738 https://github.com/cri-o/cri-o/issues/4867 https://github.com/kubernetes/kubeadm/issues/2470

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Reactions: 1
  • Comments: 18 (7 by maintainers)

Most upvoted comments

I checked that 1.21.2 and 1.21.0 are using cadvisor v0.39.0. /area cadivisor /triage accepted