Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cadvisor Metrics doesn't show metrics for all containers #7436

Closed
RispyCZ opened this issue Dec 16, 2024 · 7 comments
Closed

Cadvisor Metrics doesn't show metrics for all containers #7436

RispyCZ opened this issue Dec 16, 2024 · 7 comments

Comments

@RispyCZ
Copy link

RispyCZ commented Dec 16, 2024 •
edited
Loading

Environmental Info:
RKE2 Version:

rke2 version v1.30.6+rke2r1 (2959cd2)
go version go1.22.8 X:boringcrypto

Node(s) CPU architecture, OS, and Version:

Linux xxx 6.1.0-23-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.99-1 (2024-07-15) x86_64 GNU/Linux
Cluster Configuration:

3 controlplanes and 8 workers
Describe the bug:

build-in cadvisor (in kubelet) doesn't contain metrics for containers other then those in the kube-system namespace. When I tried to run standalone cadvisor pod, it contained metrics from all containers.

Steps To Reproduce:

  • Installed RKE2:

Controlplane
curl -fL https:///system-agent-install.sh | sudo sh -s - --server https:// -label 'cattle.io/os=linux' --token xxxx --etcd --controlplane

Worker
curl -fL https:///system-agent-install.sh | sudo sh -s - --server https:// -label 'cattle.io/os=linux' --token xxxx --worker

Expected behavior:

Metrics from cadvisor contains metrics about containers from all namespaces.

Actual behavior:

Cadvisor contains metrics only for containers in kube-system namespace

Additional context / logs:
@brandond
Copy link
Member

I can't reproduce this. Can you show exactly what you're seeing and where? Are you sure you're not filtering metrics to show only pods in the kube-system namespace?

@RispyCZ
Copy link
Author

RispyCZ commented Dec 16, 2024

I used this endpoint https://<node_ip>:10250/metrics/cadvisor

@brandond
Copy link
Member

brandond commented Dec 16, 2024 •
edited
Loading

Yes, that is where you would get metrics from. This is not an example of the issue though. Can you show the pods running in other namespaces on that node that are not present in the output?

@brandond
Copy link
Member

Example of correct metrics:

brandond@dev01:~$ kubectl get node -o wide
NAME            STATUS   ROLES                       AGE    VERSION          INTERNAL-IP   EXTERNAL-IP   OS-IMAGE             KERNEL-VERSION   CONTAINER-RUNTIME
rke2-server-1   Ready    control-plane,etcd,master   6m2s   v1.30.6+rke2r1   172.17.0.4    <none>        Ubuntu 22.04.5 LTS   6.8.0-1016-aws   containerd://1.7.22-k3s1

brandond@dev01:~$ kubectl get pod -n default -o wide
NAME                       READY   STATUS    RESTARTS   AGE     IP           NODE            NOMINATED NODE   READINESS GATES
example-5fdbf749fc-wnvv6   1/1     Running   0          3m10s   10.42.0.15   rke2-server-1   <none>           <none>

brandond@dev01:~$ kubectl get --raw /api/v1/nodes/rke2-server-1/proxy/metrics/cadvisor | grep 'namespace="default"'
container_blkio_device_usage_total{container="",device="/dev/nvme0n1",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",major="259",minor="1",name="",namespace="default",operation="Read",pod="example-5fdbf749fc-wnvv6"} 16384 1734380418525
container_blkio_device_usage_total{container="",device="/dev/nvme0n1",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",major="259",minor="1",name="",namespace="default",operation="Write",pod="example-5fdbf749fc-wnvv6"} 0 1734380418525
container_blkio_device_usage_total{container="",device="/dev/nvme0n1",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",major="259",minor="1",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",operation="Read",pod="example-5fdbf749fc-wnvv6"} 16384 1734380410856
container_blkio_device_usage_total{container="",device="/dev/nvme0n1",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",major="259",minor="1",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",operation="Write",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_cpu_load_average_10s{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380418525
container_cpu_load_average_10s{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_cpu_load_average_10s{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380420946
container_cpu_system_seconds_total{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0.040529 1734380418525
container_cpu_system_seconds_total{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0.007121 1734380410856
container_cpu_system_seconds_total{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0.033205 1734380420946
container_cpu_usage_seconds_total{container="",cpu="total",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0.090178 1734380418525
container_cpu_usage_seconds_total{container="",cpu="total",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0.037642 1734380410856
container_cpu_usage_seconds_total{container="socat",cpu="total",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0.052536 1734380420946
container_cpu_user_seconds_total{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0.049648 1734380418525
container_cpu_user_seconds_total{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0.03052 1734380410856
container_cpu_user_seconds_total{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0.01933 1734380420946
container_file_descriptors{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380418525
container_file_descriptors{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 3 1734380410856
container_file_descriptors{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 6 1734380420946
container_fs_reads_bytes_total{container="",device="/dev/nvme0n1",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 16384 1734380418525
container_fs_reads_bytes_total{container="",device="/dev/nvme0n1",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 16384 1734380410856
container_fs_reads_total{container="",device="/dev/nvme0n1",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 1 1734380418525
container_fs_reads_total{container="",device="/dev/nvme0n1",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 1 1734380410856
container_fs_writes_bytes_total{container="",device="/dev/nvme0n1",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380418525
container_fs_writes_bytes_total{container="",device="/dev/nvme0n1",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_fs_writes_total{container="",device="/dev/nvme0n1",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380418525
container_fs_writes_total{container="",device="/dev/nvme0n1",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_last_seen{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 1.734380426e+09 1734380426002
container_last_seen{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 1.734380425e+09 1734380425999
container_last_seen{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 1.734380426e+09 1734380426007
container_memory_cache{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 16384 1734380418525
container_memory_cache{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 16384 1734380410856
container_memory_cache{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380420946
container_memory_failcnt{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380418525
container_memory_failcnt{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_memory_failcnt{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380420946
container_memory_failures_total{container="",failure_type="pgfault",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6",scope="container"} 4157 1734380418525
container_memory_failures_total{container="",failure_type="pgfault",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6",scope="hierarchy"} 4157 1734380418525
container_memory_failures_total{container="",failure_type="pgfault",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6",scope="container"} 1115 1734380410856
container_memory_failures_total{container="",failure_type="pgfault",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6",scope="hierarchy"} 1115 1734380410856
container_memory_failures_total{container="",failure_type="pgmajfault",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6",scope="container"} 1 1734380418525
container_memory_failures_total{container="",failure_type="pgmajfault",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6",scope="hierarchy"} 1 1734380418525
container_memory_failures_total{container="",failure_type="pgmajfault",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6",scope="container"} 1 1734380410856
container_memory_failures_total{container="",failure_type="pgmajfault",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6",scope="hierarchy"} 1 1734380410856
container_memory_failures_total{container="socat",failure_type="pgfault",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6",scope="container"} 3042 1734380420946
container_memory_failures_total{container="socat",failure_type="pgfault",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6",scope="hierarchy"} 3042 1734380420946
container_memory_failures_total{container="socat",failure_type="pgmajfault",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6",scope="container"} 0 1734380420946
container_memory_failures_total{container="socat",failure_type="pgmajfault",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6",scope="hierarchy"} 0 1734380420946
container_memory_kernel_usage{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380418525
container_memory_kernel_usage{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_memory_kernel_usage{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380420946
container_memory_mapped_file{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380418525
container_memory_mapped_file{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_memory_mapped_file{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380420946
container_memory_max_usage_bytes{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 4.067328e+06 1734380418525
container_memory_max_usage_bytes{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 4.046848e+06 1734380410856
container_memory_max_usage_bytes{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 2.568192e+06 1734380420946
container_memory_rss{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 630784 1734380418525
container_memory_rss{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 40960 1734380410856
container_memory_rss{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 589824 1734380420946
container_memory_swap{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380418525
container_memory_swap{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_memory_swap{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380420946
container_memory_usage_bytes{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 1.101824e+06 1734380418525
container_memory_usage_bytes{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 237568 1734380410856
container_memory_usage_bytes{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 823296 1734380420946
container_memory_working_set_bytes{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 1.101824e+06 1734380418525
container_memory_working_set_bytes{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 237568 1734380410856
container_memory_working_set_bytes{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 823296 1734380420946
container_network_receive_bytes_total{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",interface="eth0",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 8450 1734380410856
container_network_receive_errors_total{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",interface="eth0",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_network_receive_packets_dropped_total{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",interface="eth0",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_network_receive_packets_total{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",interface="eth0",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 97 1734380410856
container_network_transmit_bytes_total{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",interface="eth0",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 9626 1734380410856
container_network_transmit_errors_total{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",interface="eth0",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_network_transmit_packets_dropped_total{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",interface="eth0",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_network_transmit_packets_total{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",interface="eth0",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 103 1734380410856
container_oom_events_total{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380418525
container_oom_events_total{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_oom_events_total{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380420946
container_processes{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380418525
container_processes{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 1 1734380410856
container_processes{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 1 1734380420946
container_sockets{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380418525
container_sockets{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_sockets{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 3 1734380420946
container_spec_cpu_period{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 100000
container_spec_cpu_period{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 100000
container_spec_cpu_period{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 100000
container_spec_cpu_shares{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 2
container_spec_cpu_shares{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 2
container_spec_cpu_shares{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 2
container_spec_memory_limit_bytes{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0
container_spec_memory_limit_bytes{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0
container_spec_memory_limit_bytes{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0
container_spec_memory_reservation_limit_bytes{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0
container_spec_memory_reservation_limit_bytes{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0
container_spec_memory_reservation_limit_bytes{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0
container_spec_memory_swap_limit_bytes{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0
container_spec_memory_swap_limit_bytes{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0
container_spec_memory_swap_limit_bytes{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0
container_start_time_seconds{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 1.734380232e+09
container_start_time_seconds{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 1.734380232e+09
container_start_time_seconds{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 1.734380235e+09
container_tasks_state{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6",state="iowaiting"} 0 1734380418525
container_tasks_state{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6",state="running"} 0 1734380418525
container_tasks_state{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6",state="sleeping"} 0 1734380418525
container_tasks_state{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6",state="stopped"} 0 1734380418525
container_tasks_state{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6",state="uninterruptible"} 0 1734380418525
container_tasks_state{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6",state="iowaiting"} 0 1734380410856
container_tasks_state{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6",state="running"} 0 1734380410856
container_tasks_state{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6",state="sleeping"} 0 1734380410856
container_tasks_state{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6",state="stopped"} 0 1734380410856
container_tasks_state{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6",state="uninterruptible"} 0 1734380410856
container_tasks_state{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6",state="iowaiting"} 0 1734380420946
container_tasks_state{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6",state="running"} 0 1734380420946
container_tasks_state{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6",state="sleeping"} 0 1734380420946
container_tasks_state{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6",state="stopped"} 0 1734380420946
container_tasks_state{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6",state="uninterruptible"} 0 1734380420946
container_threads{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 2 1734380418525
container_threads{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 1 1734380410856
container_threads{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 1 1734380420946
container_threads_max{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4",image="",name="",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380418525
container_threads_max{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380410856
container_threads_max{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6"} 0 1734380420946
container_ulimits_soft{container="",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",image="docker.io/rancher/mirrored-pause:3.6",name="c47c1e1f4767764c3fe0b5cc274d5b80877d4c5d5a90cf0d475719e434db6a16",namespace="default",pod="example-5fdbf749fc-wnvv6",ulimit="max_open_files"} 1.048576e+06 1734380410856
container_ulimits_soft{container="socat",id="/kubepods/besteffort/podb933ae96-6ca5-4382-bdae-c3edad27d2a4/efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",image="docker.io/alpine/socat:1.7.4.3-r1",name="efccca1f375f17aa0863195e8b5c9e3c6b85070c298e6323bf0e5c4f8a61c30e",namespace="default",pod="example-5fdbf749fc-wnvv6",ulimit="max_open_files"} 1.048576e+06 1734380420946

@RispyCZ
Copy link
Author

RispyCZ commented Dec 16, 2024

My bad now its working correctly

@brandond
Copy link
Member

brandond commented Dec 16, 2024 •
edited
Loading

Yeah you didn't have any pods in other namespaces on that node did you.

@RispyCZ
Copy link
Author

RispyCZ commented Dec 16, 2024

Yeah It was controlplane 🤦 Thanks for help :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@brandond @RispyCZ