Time Namespace Component RelatedObject Reason Message

kube-system

kas-connection-checker-685895c7c9-zp66b

FailedScheduling

no nodes available to schedule pods

default

apiserver

kube-system

TerminationStoppedServing

Server has stopped listening

default

default-dsc

ProvisioningError

failed to lookup object /default-kserve: no matches for kind "Kserve" in version "components.platform.opendatahub.io/v1alpha1"

default

default-dsc

ProvisioningError

failed to lookup object /default-kserve: no matches for kind "Kserve" in version "components.platform.opendatahub.io/v1alpha1"

default

default-dsc

ProvisioningError

failed to lookup object /default-kserve: no matches for kind "Kserve" in version "components.platform.opendatahub.io/v1alpha1"

default

default-dsc

ProvisioningError

failed to lookup object /default-kserve: no matches for kind "Kserve" in version "components.platform.opendatahub.io/v1alpha1"

default

default-dsc

ProvisioningError

failed to lookup object /default-kserve: no matches for kind "Kserve" in version "components.platform.opendatahub.io/v1alpha1"

default

default-dsc

ProvisioningError

failed to lookup object /default-kserve: no matches for kind "Kserve" in version "components.platform.opendatahub.io/v1alpha1"

default

default-dsc

ProvisioningError

failed to lookup object /default-kserve: no matches for kind "Kserve" in version "components.platform.opendatahub.io/v1alpha1"

default

172.31.234.167

IPAddressNotAllocated

IPAddress: 172.31.234.167 for Service openshift-ingress/payload-processing-e2e-ipp-a-f84ad8 appears to have leaked: cleaning up

kube-system

global-pull-secret-syncer-vl6zb

Scheduled

Successfully assigned kube-system/global-pull-secret-syncer-vl6zb to ip-10-0-135-138.ec2.internal

kube-system

konnectivity-agent-d5t6w

Scheduled

Successfully assigned kube-system/konnectivity-agent-d5t6w to ip-10-0-135-138.ec2.internal

kube-system

global-pull-secret-syncer-l52v6

Scheduled

Successfully assigned kube-system/global-pull-secret-syncer-l52v6 to ip-10-0-129-45.ec2.internal

default

apiserver

kube-system

TerminationStart

Received signal to terminate, becoming unready, but keeping serving

kube-system

kas-connection-checker-685895c7c9-zp66b

Scheduled

Successfully assigned kube-system/kas-connection-checker-685895c7c9-zp66b to ip-10-0-133-143.ec2.internal

kube-system

kas-connection-checker-685895c7c9-zp66b

FailedScheduling

no nodes available to schedule pods

kube-system

global-pull-secret-syncer-gc6sk

Scheduled

Successfully assigned kube-system/global-pull-secret-syncer-gc6sk to ip-10-0-133-143.ec2.internal

kube-system

kas-connection-checker-685895c7c9-dhlcp

Scheduled

Successfully assigned kube-system/kas-connection-checker-685895c7c9-dhlcp to ip-10-0-133-143.ec2.internal

kube-system

kas-connection-checker-685895c7c9-dhlcp

FailedScheduling

no nodes available to schedule pods

kube-system

kas-connection-checker-685895c7c9-dhlcp

FailedScheduling

no nodes available to schedule pods

kube-system

kas-connection-checker-685895c7c9-bt2l4

Scheduled

Successfully assigned kube-system/kas-connection-checker-685895c7c9-bt2l4 to ip-10-0-133-143.ec2.internal

kube-system

konnectivity-agent-svzrl

Scheduled

Successfully assigned kube-system/konnectivity-agent-svzrl to ip-10-0-133-143.ec2.internal

kube-system

kas-connection-checker-685895c7c9-bt2l4

FailedScheduling

no nodes available to schedule pods

kube-system

kas-connection-checker-685895c7c9-bt2l4

FailedScheduling

no nodes available to schedule pods

default

apiserver

kube-system

TerminationMinimalShutdownDurationFinished

The minimal shutdown duration of 15s finished

kube-system

konnectivity-agent-29z4k

Scheduled

Successfully assigned kube-system/konnectivity-agent-29z4k to ip-10-0-129-45.ec2.internal

default

apiserver

kube-system

TerminationPreShutdownHooksFinished

All pre-shutdown hooks have been finished

default

apiserver

kube-system

TerminationGracefulTerminationFinished

All pending requests processed

default

apiserver

openshift-kube-apiserver

KubeAPIReadyz

readyz=true

kube-system

default-scheduler

kube-scheduler

LeaderElection

kube-scheduler-5c6668c85f-tbl52_2f41907e-7cfb-4374-b0b2-869811acb16c became leader

kube-system

kube-controller-manager

kube-controller-manager

LeaderElection

kube-controller-manager-f7896f7c5-4crhw_280fa765-b750-40cf-8c0e-362fe412bb1f became leader

openshift-cluster-version

openshift-cluster-version

version

LeaderElection

cluster-version-operator-687b9b7cc4-bfrp4_c72e39c9-1d6f-415b-a021-431113ab949b became leader

openshift-cluster-version

openshift-cluster-version

version

RetrievePayload

Retrieving and verifying payload version="4.22.20" image="registry.build03.ci.openshift.org/ci-op-dpqh7tmt/release@sha256:b94e4b85832b43dfa35785551effe5d16e122e3fa3ed277b6d765c945fe5ef14"

openshift-cluster-version

openshift-cluster-version

version

LoadPayload

Loading payload version="4.22.20" image="registry.build03.ci.openshift.org/ci-op-dpqh7tmt/release@sha256:b94e4b85832b43dfa35785551effe5d16e122e3fa3ed277b6d765c945fe5ef14"

openshift-cluster-version

openshift-cluster-version

version

PayloadLoaded

Payload loaded version="4.22.20" image="registry.build03.ci.openshift.org/ci-op-dpqh7tmt/release@sha256:b94e4b85832b43dfa35785551effe5d16e122e3fa3ed277b6d765c945fe5ef14" architecture="Multi"

kube-system

deployment-controller

kas-connection-checker

ScalingReplicaSet

Scaled up replica set kas-connection-checker-685895c7c9 from 0 to 3

kube-system

replicaset-controller

kas-connection-checker-685895c7c9

SuccessfulCreate

Created pod: kas-connection-checker-685895c7c9-zp66b

kube-system

replicaset-controller

kas-connection-checker-685895c7c9

SuccessfulCreate

Created pod: kas-connection-checker-685895c7c9-bt2l4

kube-system

replicaset-controller

kas-connection-checker-685895c7c9

SuccessfulCreate

Created pod: kas-connection-checker-685895c7c9-dhlcp

kube-system

kube-controller-manager

kube-controller-manager

LeaderElection

kube-controller-manager-7784fcb8bd-4gvpg_2be037af-3841-473d-abb2-6b36495dd658 became leader
(x7)

default

kubelet

ip-10-0-133-143.ec2.internal

NodeHasSufficientPID

Node ip-10-0-133-143.ec2.internal status is now: NodeHasSufficientPID
(x7)

default

kubelet

ip-10-0-133-143.ec2.internal

NodeHasNoDiskPressure

Node ip-10-0-133-143.ec2.internal status is now: NodeHasNoDiskPressure

default

kubelet

ip-10-0-133-143.ec2.internal

NodeAllocatableEnforced

Updated Node Allocatable limit across pods

default

kubelet

ip-10-0-133-143.ec2.internal

NodeAllocatableEnforced

Updated limits on system reserved cgroup /system.slice

kube-system

kubelet

kube-apiserver-proxy-ip-10-0-133-143.ec2.internal

Pulling

Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e"

default

cloud-node-controller

ip-10-0-133-143.ec2.internal

Synced

Node synced successfully
(x8)

default

kubelet

ip-10-0-133-143.ec2.internal

NodeHasSufficientMemory

Node ip-10-0-133-143.ec2.internal status is now: NodeHasSufficientMemory

kube-system

daemonset-controller

global-pull-secret-syncer

SuccessfulCreate

Created pod: global-pull-secret-syncer-gc6sk

kube-system

daemonset-controller

konnectivity-agent

SuccessfulCreate

Created pod: konnectivity-agent-svzrl

kube-system

kubelet

kube-apiserver-proxy-ip-10-0-133-143.ec2.internal

Pulled

Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" in 1.56s (1.56s including waiting). Image size: 294084393 bytes.

kube-system

kubelet

kube-apiserver-proxy-ip-10-0-133-143.ec2.internal

Created

Container created

kube-system

kubelet

kube-apiserver-proxy-ip-10-0-133-143.ec2.internal

Started

Container started

default

node-controller

ip-10-0-133-143.ec2.internal

RegisteredNode

Node ip-10-0-133-143.ec2.internal event: Registered Node ip-10-0-133-143.ec2.internal in Controller

kube-system

kubelet

konnectivity-agent-svzrl

Pulling

Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ef3d8a5c5a290fbfb7b3688e9a224e9c47d9f3326f05a0f73577656437e3f406"

kube-system

kubelet

konnectivity-agent-svzrl

Started

Container started

kube-system

kubelet

konnectivity-agent-svzrl

Created

Container created

kube-system

kubelet

konnectivity-agent-svzrl

Pulled

Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ef3d8a5c5a290fbfb7b3688e9a224e9c47d9f3326f05a0f73577656437e3f406" in 3.956s (3.956s including waiting). Image size: 276927292 bytes.
(x6)

kube-system

kubelet

global-pull-secret-syncer-gc6sk

FailedMount

MountVolume.SetUp failed for volume "original-pull-secret" : object "kube-system"/"original-pull-secret" not registered

default

kubelet

ip-10-0-135-138.ec2.internal

NodeAllocatableEnforced

Updated Node Allocatable limit across pods

kube-system

daemonset-controller

konnectivity-agent

SuccessfulCreate

Created pod: konnectivity-agent-d5t6w
(x7)

default

kubelet

ip-10-0-135-138.ec2.internal

NodeHasNoDiskPressure

Node ip-10-0-135-138.ec2.internal status is now: NodeHasNoDiskPressure
(x7)

default

ovnk-controlplane

ip-10-0-133-143.ec2.internal

ErrorReconcilingNode

[k8s.ovn.org/node-chassis-id annotation not found for node ip-10-0-133-143.ec2.internal, error getting gateway config for node ip-10-0-133-143.ec2.internal: k8s.ovn.org/l3-gateway-config annotation not found for node "ip-10-0-133-143.ec2.internal", failed to update chassis to local for local node ip-10-0-133-143.ec2.internal, error: failed to parse node chassis-id for node - ip-10-0-133-143.ec2.internal, error: k8s.ovn.org/node-chassis-id annotation not found for node ip-10-0-133-143.ec2.internal]
(x7)

default

kubelet

ip-10-0-135-138.ec2.internal

NodeHasSufficientMemory

Node ip-10-0-135-138.ec2.internal status is now: NodeHasSufficientMemory
(x7)

default

kubelet

ip-10-0-135-138.ec2.internal

NodeHasSufficientPID

Node ip-10-0-135-138.ec2.internal status is now: NodeHasSufficientPID

default

kubelet

ip-10-0-135-138.ec2.internal

NodeAllocatableEnforced

Updated limits on system reserved cgroup /system.slice

kube-system

kubelet

kube-apiserver-proxy-ip-10-0-135-138.ec2.internal

Pulling

Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e"

default

cloud-node-controller

ip-10-0-135-138.ec2.internal

Synced

Node synced successfully

kube-system

daemonset-controller

global-pull-secret-syncer

SuccessfulCreate

Created pod: global-pull-secret-syncer-vl6zb

kube-system

kubelet

konnectivity-agent-d5t6w

Pulling

Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ef3d8a5c5a290fbfb7b3688e9a224e9c47d9f3326f05a0f73577656437e3f406"

kube-system

kubelet

kube-apiserver-proxy-ip-10-0-135-138.ec2.internal

Pulled

Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" in 2.165s (2.165s including waiting). Image size: 294084393 bytes.

kube-system

kubelet

kube-apiserver-proxy-ip-10-0-135-138.ec2.internal

Created

Container created

kube-system

kubelet

kube-apiserver-proxy-ip-10-0-135-138.ec2.internal

Started

Container started

default

node-controller

ip-10-0-135-138.ec2.internal

RegisteredNode

Node ip-10-0-135-138.ec2.internal event: Registered Node ip-10-0-135-138.ec2.internal in Controller
(x14)

kube-system

kubelet

global-pull-secret-syncer-gc6sk

NetworkNotReady

network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?

kube-system

daemonset-controller

global-pull-secret-syncer

SuccessfulCreate

Created pod: global-pull-secret-syncer-l52v6
(x7)

default

kubelet

ip-10-0-129-45.ec2.internal

NodeHasNoDiskPressure

Node ip-10-0-129-45.ec2.internal status is now: NodeHasNoDiskPressure
(x7)

default

kubelet

ip-10-0-129-45.ec2.internal

NodeHasSufficientPID

Node ip-10-0-129-45.ec2.internal status is now: NodeHasSufficientPID

default

cloud-node-controller

ip-10-0-129-45.ec2.internal

Synced

Node synced successfully

default

kubelet

ip-10-0-129-45.ec2.internal

NodeAllocatableEnforced

Updated limits on system reserved cgroup /system.slice

default

kubelet

ip-10-0-129-45.ec2.internal

NodeAllocatableEnforced

Updated Node Allocatable limit across pods

kube-system

daemonset-controller

konnectivity-agent

SuccessfulCreate

Created pod: konnectivity-agent-29z4k

kube-system

kubelet

kube-apiserver-proxy-ip-10-0-129-45.ec2.internal

Pulling

Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e"

kube-system

kubelet

konnectivity-agent-d5t6w

Created

Container created
(x8)

default

kubelet

ip-10-0-129-45.ec2.internal

NodeHasSufficientMemory

Node ip-10-0-129-45.ec2.internal status is now: NodeHasSufficientMemory

kube-system

kubelet

konnectivity-agent-d5t6w

Pulled

Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ef3d8a5c5a290fbfb7b3688e9a224e9c47d9f3326f05a0f73577656437e3f406" in 3.897s (3.897s including waiting). Image size: 276927292 bytes.

kube-system

kubelet

konnectivity-agent-d5t6w

Started

Container started

kube-system

multus

kas-connection-checker-685895c7c9-dhlcp

AddedInterface

Add eth0 [10.132.0.7/23] from ovn-kubernetes

kube-system

kubelet

kas-connection-checker-685895c7c9-zp66b

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472" already present on machine and can be accessed by the pod

kube-system

multus

kas-connection-checker-685895c7c9-zp66b

AddedInterface

Add eth0 [10.132.0.8/23] from ovn-kubernetes

kube-system

kubelet

kas-connection-checker-685895c7c9-dhlcp

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472" already present on machine and can be accessed by the pod

kube-system

kubelet

konnectivity-agent-29z4k

Pulling

Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ef3d8a5c5a290fbfb7b3688e9a224e9c47d9f3326f05a0f73577656437e3f406"

kube-system

kubelet

kas-connection-checker-685895c7c9-bt2l4

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2a8b58f028a9a4a0345ad1f809e47fb9913d7f77c731bfd785819e1c71be9472" already present on machine and can be accessed by the pod

kube-system

multus

kas-connection-checker-685895c7c9-bt2l4

AddedInterface

Add eth0 [10.132.0.6/23] from ovn-kubernetes

kube-system

kubelet

kube-apiserver-proxy-ip-10-0-129-45.ec2.internal

Pulled

Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" in 1.437s (1.437s including waiting). Image size: 294084393 bytes.

kube-system

kubelet

kube-apiserver-proxy-ip-10-0-129-45.ec2.internal

Started

Container started

kube-system

kubelet

kas-connection-checker-685895c7c9-dhlcp

Started

Container started

kube-system

kubelet

kube-apiserver-proxy-ip-10-0-129-45.ec2.internal

Created

Container created

kube-system

kubelet

kas-connection-checker-685895c7c9-dhlcp

Created

Container created

kube-system

kubelet

kas-connection-checker-685895c7c9-bt2l4

Started

Container started

kube-system

kubelet

kas-connection-checker-685895c7c9-zp66b

Created

Container created

kube-system

kubelet

kas-connection-checker-685895c7c9-zp66b

Started

Container started

kube-system

kubelet

kas-connection-checker-685895c7c9-bt2l4

Created

Container created

default

node-controller

ip-10-0-129-45.ec2.internal

RegisteredNode

Node ip-10-0-129-45.ec2.internal event: Registered Node ip-10-0-129-45.ec2.internal in Controller

kube-system

multus

global-pull-secret-syncer-gc6sk

AddedInterface

Add eth0 [10.132.0.3/23] from ovn-kubernetes

kube-system

kubelet

global-pull-secret-syncer-gc6sk

Pulling

Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fe8e89e6cbec3b50985683a4c052c0353f3b869fd22dae8191f84dbdcb591f87"

kube-system

kubelet

konnectivity-agent-29z4k

Created

Container created

kube-system

kubelet

konnectivity-agent-29z4k

Started

Container started

kube-system

kubelet

konnectivity-agent-29z4k

Pulled

Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ef3d8a5c5a290fbfb7b3688e9a224e9c47d9f3326f05a0f73577656437e3f406" in 3.39s (3.39s including waiting). Image size: 276927292 bytes.

kube-system

kubelet

global-pull-secret-syncer-gc6sk

Pulled

Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fe8e89e6cbec3b50985683a4c052c0353f3b869fd22dae8191f84dbdcb591f87" in 6.695s (6.695s including waiting). Image size: 627364882 bytes.

default

kubelet

ip-10-0-133-143.ec2.internal

NodeAllocatableEnforced

Updated Node Allocatable limit across pods

default

kubelet

ip-10-0-133-143.ec2.internal

NodeAllocatableEnforced

Updated limits on system reserved cgroup /system.slice

kube-system

kubelet

global-pull-secret-syncer-gc6sk

Started

Container started

kube-system

kubelet

global-pull-secret-syncer-gc6sk

Created

Container created

default

kubelet

ip-10-0-133-143.ec2.internal

Starting

Starting kubelet.

default

kubelet

ip-10-0-133-143.ec2.internal

NodeHasNoDiskPressure

Node ip-10-0-133-143.ec2.internal status is now: NodeHasNoDiskPressure

default

kubelet

ip-10-0-133-143.ec2.internal

NodeHasSufficientPID

Node ip-10-0-133-143.ec2.internal status is now: NodeHasSufficientPID

default

kubelet

ip-10-0-133-143.ec2.internal

NodeHasSufficientMemory

Node ip-10-0-133-143.ec2.internal status is now: NodeHasSufficientMemory
(x7)

kube-system

kubelet

global-pull-secret-syncer-vl6zb

FailedMount

MountVolume.SetUp failed for volume "original-pull-secret" : object "kube-system"/"original-pull-secret" not registered
(x18)

kube-system

kubelet

global-pull-secret-syncer-vl6zb

NetworkNotReady

network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?

kube-system

kube-controller-manager

kube-controller-manager

LeaderElection

kube-controller-manager-77778949f7-64bpq_10dc0f8f-15d1-4fad-b964-552ffab1b5fd became leader

kube-system

node-controller

kube-apiserver-proxy-ip-10-0-129-45.ec2.internal

NodeNotReady

Node is not ready

kube-system

node-controller

konnectivity-agent-d5t6w

NodeNotReady

Node is not ready

default

node-controller

ip-10-0-135-138.ec2.internal

RegisteredNode

Node ip-10-0-135-138.ec2.internal event: Registered Node ip-10-0-135-138.ec2.internal in Controller

default

node-controller

ip-10-0-129-45.ec2.internal

RegisteredNode

Node ip-10-0-129-45.ec2.internal event: Registered Node ip-10-0-129-45.ec2.internal in Controller

kube-system

node-controller

kube-apiserver-proxy-ip-10-0-135-138.ec2.internal

NodeNotReady

Node is not ready

default

node-controller

ip-10-0-133-143.ec2.internal

RegisteredNode

Node ip-10-0-133-143.ec2.internal event: Registered Node ip-10-0-133-143.ec2.internal in Controller

kube-system

node-controller

konnectivity-agent-29z4k

NodeNotReady

Node is not ready
(x7)

default

ovnk-controlplane

ip-10-0-129-45.ec2.internal

ErrorReconcilingNode

[k8s.ovn.org/node-chassis-id annotation not found for node ip-10-0-129-45.ec2.internal, error getting gateway config for node ip-10-0-129-45.ec2.internal: k8s.ovn.org/l3-gateway-config annotation not found for node "ip-10-0-129-45.ec2.internal", failed to update chassis to local for local node ip-10-0-129-45.ec2.internal, error: failed to parse node chassis-id for node - ip-10-0-129-45.ec2.internal, error: k8s.ovn.org/node-chassis-id annotation not found for node ip-10-0-129-45.ec2.internal]
(x7)

kube-system

kubelet

global-pull-secret-syncer-l52v6

FailedMount

MountVolume.SetUp failed for volume "original-pull-secret" : object "kube-system"/"original-pull-secret" not registered
(x8)

default

ovnk-controlplane

ip-10-0-135-138.ec2.internal

ErrorReconcilingNode

[k8s.ovn.org/node-chassis-id annotation not found for node ip-10-0-135-138.ec2.internal, error getting gateway config for node ip-10-0-135-138.ec2.internal: k8s.ovn.org/l3-gateway-config annotation not found for node "ip-10-0-135-138.ec2.internal", failed to update chassis to local for local node ip-10-0-135-138.ec2.internal, error: failed to parse node chassis-id for node - ip-10-0-135-138.ec2.internal, error: k8s.ovn.org/node-chassis-id annotation not found for node ip-10-0-135-138.ec2.internal]
(x18)

kube-system

kubelet

global-pull-secret-syncer-l52v6

NetworkNotReady

network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?

default

kubelet

ip-10-0-135-138.ec2.internal

NodeReady

Node ip-10-0-135-138.ec2.internal status is now: NodeReady

kube-system

multus

global-pull-secret-syncer-vl6zb

AddedInterface

Add eth0 [10.133.0.4/23] from ovn-kubernetes

kube-system

kubelet

global-pull-secret-syncer-vl6zb

Pulling

Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fe8e89e6cbec3b50985683a4c052c0353f3b869fd22dae8191f84dbdcb591f87"

kube-system

kubelet

global-pull-secret-syncer-vl6zb

Started

Container started

kube-system

kubelet

global-pull-secret-syncer-vl6zb

Created

Container created

kube-system

kubelet

global-pull-secret-syncer-vl6zb

Pulled

Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fe8e89e6cbec3b50985683a4c052c0353f3b869fd22dae8191f84dbdcb591f87" in 4.56s (4.56s including waiting). Image size: 627364882 bytes.

default

kubelet

ip-10-0-135-138.ec2.internal

Starting

Starting kubelet.

kube-system

multus

global-pull-secret-syncer-l52v6

AddedInterface

Add eth0 [10.134.0.5/23] from ovn-kubernetes

default

kubelet

ip-10-0-135-138.ec2.internal

NodeAllocatableEnforced

Updated Node Allocatable limit across pods

default

kubelet

ip-10-0-135-138.ec2.internal

NodeHasSufficientMemory

Node ip-10-0-135-138.ec2.internal status is now: NodeHasSufficientMemory

default

kubelet

ip-10-0-135-138.ec2.internal

NodeHasNoDiskPressure

Node ip-10-0-135-138.ec2.internal status is now: NodeHasNoDiskPressure

default

kubelet

ip-10-0-135-138.ec2.internal

NodeHasSufficientPID

Node ip-10-0-135-138.ec2.internal status is now: NodeHasSufficientPID

kube-system

kubelet

global-pull-secret-syncer-l52v6

Pulling

Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fe8e89e6cbec3b50985683a4c052c0353f3b869fd22dae8191f84dbdcb591f87"

default

kubelet

ip-10-0-135-138.ec2.internal

NodeAllocatableEnforced

Updated limits on system reserved cgroup /system.slice

kube-system

kubelet

global-pull-secret-syncer-l52v6

Created

Container created

kube-system

kubelet

global-pull-secret-syncer-l52v6

Started

Container started

kube-system

kubelet

global-pull-secret-syncer-l52v6

Pulled

Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fe8e89e6cbec3b50985683a4c052c0353f3b869fd22dae8191f84dbdcb591f87" in 4.54s (4.54s including waiting). Image size: 627364882 bytes.

default

kubelet

ip-10-0-129-45.ec2.internal

NodeAllocatableEnforced

Updated Node Allocatable limit across pods

default

kubelet

ip-10-0-129-45.ec2.internal

NodeAllocatableEnforced

Updated limits on system reserved cgroup /system.slice

default

kubelet

ip-10-0-129-45.ec2.internal

Starting

Starting kubelet.

default

kubelet

ip-10-0-129-45.ec2.internal

NodeHasSufficientPID

Node ip-10-0-129-45.ec2.internal status is now: NodeHasSufficientPID

default

kubelet

ip-10-0-129-45.ec2.internal

NodeHasNoDiskPressure

Node ip-10-0-129-45.ec2.internal status is now: NodeHasNoDiskPressure

default

kubelet

ip-10-0-129-45.ec2.internal

NodeHasSufficientMemory

Node ip-10-0-129-45.ec2.internal status is now: NodeHasSufficientMemory

kube-system

cert-manager-cainjector-5c57bbd4fc-f6qf4_3a73a4a9-f763-43f4-908d-add866985e7a

cert-manager-cainjector-leader-election

LeaderElection

cert-manager-cainjector-5c57bbd4fc-f6qf4_3a73a4a9-f763-43f4-908d-add866985e7a became leader

kube-system

cert-manager-leader-election

cert-manager-controller

LeaderElection

cert-manager-597b95cb84-8xljz-external-cert-manager-controller became leader

default

endpoint-controller

e2e-worker-w4-7ecfe1-openshift-default

FailedToCreateEndpoint

Failed to create endpoint for service openshift-ingress/e2e-worker-w4-7ecfe1-openshift-default: endpoints "e2e-worker-w4-7ecfe1-openshift-default" already exists

default

endpoint-controller

e2e-worker-w3-624254-openshift-default

FailedToCreateEndpoint

Failed to create endpoint for service openshift-ingress/e2e-worker-w3-624254-openshift-default: endpoints "e2e-worker-w3-624254-openshift-default" already exists

default

endpoint-controller

distinct-2-w3-624254-kserve-workload-svc

FailedToCreateEndpoint

Failed to create endpoint for service e2e-models-e2e-worker-w3-624254/distinct-2-w3-624254-kserve-workload-svc: endpoints "distinct-2-w3-624254-kserve-workload-svc" already exists

default

endpoint-controller

test-model-f975ed-kserve-workload-svc

FailedToCreateEndpoint

Failed to create endpoint for service ai-tenant-e2e-inf-a-f975ed/test-model-f975ed-kserve-workload-svc: endpoints "test-model-f975ed-kserve-workload-svc" already exists

default

endpoint-controller

e2e-shared-a-w3-f6f1a0-openshift-default

FailedToCreateEndpoint

Failed to create endpoint for service openshift-ingress/e2e-shared-a-w3-f6f1a0-openshift-default: endpoints "e2e-shared-a-w3-f6f1a0-openshift-default" already exists

default

endpoint-controller

auth-test-model-453864-kserve-workload-svc

FailedToCreateEndpoint

Failed to create endpoint for service ai-tenant-e2e-shared-b-w0-453864/auth-test-model-453864-kserve-workload-svc: endpoints "auth-test-model-453864-kserve-workload-svc" already exists

default

endpoint-controller

e2e-shared-b-w3-28da58-openshift-default

FailedToCreateEndpoint

Failed to create endpoint for service openshift-ingress/e2e-shared-b-w3-28da58-openshift-default: endpoints "e2e-shared-b-w3-28da58-openshift-default" already exists
(x3)

kube-system

kubelet

kube-apiserver-proxy-ip-10-0-133-143.ec2.internal

Unhealthy

Liveness probe failed: Get "https://172.20.0.1:6443/version": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)