| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
openshift-ingress |
e2e-inf-b-664c72-openshift-default-5b9f79d75b-jx5h6 |
Scheduled |
Successfully assigned openshift-ingress/e2e-inf-b-664c72-openshift-default-5b9f79d75b-jx5h6 to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6 to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
e2e-shared-a-f58a29-openshift-default-57456d4488-7fdlc |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-a-f58a29-openshift-default-57456d4488-7fdlc to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
e2e-shared-b-052d16-openshift-default-66ff8fdd5b-gkzd5 |
Scheduled |
Successfully assigned openshift-ingress/e2e-shared-b-052d16-openshift-default-66ff8fdd5b-gkzd5 to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-5677ccb49b-fgbbp |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-fgbbp to ip-10-0-143-46.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
e2e-mt-44b2dff2-openshift-default-7786bc96d4-sclsq |
Scheduled |
Successfully assigned openshift-ingress/e2e-mt-44b2dff2-openshift-default-7786bc96d4-sclsq to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-7b7995d5cd-n8pt4 |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8pt4 to ip-10-0-143-46.ec2.internal | ||
openshift-ingress |
e2e-ait-3af40866-openshift-default-58768868f6-x5vxv |
Scheduled |
Successfully assigned openshift-ingress/e2e-ait-3af40866-openshift-default-58768868f6-x5vxv to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-ipp-a-c4dbeb-5ccb489cf6-scm45 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-c4dbeb-5ccb489cf6-scm45 to ip-10-0-143-46.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6 to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-derive-b2ba96cb-6547b75d4d-4g54j |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-b2ba96cb-6547b75d4d-4g54j to ip-10-0-143-46.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2 to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-api-a-fcb199-695946fb8-zqfch |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-api-a-fcb199-695946fb8-zqfch to ip-10-0-143-46.ec2.internal | ||
openshift-ingress |
e2e-inf-a-0d2dee-openshift-default-589c6c9c8-54jtj |
Scheduled |
Successfully assigned openshift-ingress/e2e-inf-a-0d2dee-openshift-default-589c6c9c8-54jtj to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8 to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
e2e-ait-654abfac-openshift-default-5cc7d78784-bfp4d |
Scheduled |
Successfully assigned openshift-ingress/e2e-ait-654abfac-openshift-default-5cc7d78784-bfp4d to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
e2e-mt-22f7c4a2-openshift-default-88ccf85d4-fw52t |
Scheduled |
Successfully assigned openshift-ingress/e2e-mt-22f7c4a2-openshift-default-88ccf85d4-fw52t to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
kube-auth-proxy-cd65dd67b-vrwf2 |
Scheduled |
Successfully assigned openshift-ingress/kube-auth-proxy-cd65dd67b-vrwf2 to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
data-science-gateway-data-science-gateway-class-d66cd8c7c-vjtwb |
Scheduled |
Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vjtwb to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q |
Scheduled |
Successfully assigned openshift-ingress/e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
kube-auth-proxy-cd65dd67b-xsqns |
Scheduled |
Successfully assigned openshift-ingress/kube-auth-proxy-cd65dd67b-xsqns to ip-10-0-143-46.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858 to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-ait-3af40866-747858cbb4-lv2l6 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-ait-3af40866-747858cbb4-lv2l6 to ip-10-0-143-46.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
e2e-ipp-cleanup-4cd197-openshift-default-8656db6f68-kcwmw |
Scheduled |
Successfully assigned openshift-ingress/e2e-ipp-cleanup-4cd197-openshift-default-8656db6f68-kcwmw to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
maas-default-gateway-openshift-default-78bb78ff78-tthvj |
Scheduled |
Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tthvj to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
e2e-ipp-b-809b00-openshift-default-78486bc4c8-p2l2m |
Scheduled |
Successfully assigned openshift-ingress/e2e-ipp-b-809b00-openshift-default-78486bc4c8-p2l2m to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
payload-pre-processing-687dbb6cf6-hsfch |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-hsfch to ip-10-0-143-46.ec2.internal | ||
openshift-ingress |
e2e-ipp-a-c4dbeb-openshift-default-7b67fc547d-5nzx2 |
Scheduled |
Successfully assigned openshift-ingress/e2e-ipp-a-c4dbeb-openshift-default-7b67fc547d-5nzx2 to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
e2e-api-a-fcb199-openshift-default-77bbf74bd8-md85r |
Scheduled |
Successfully assigned openshift-ingress/e2e-api-a-fcb199-openshift-default-77bbf74bd8-md85r to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
payload-processing-5cc6cd444b-j5jfp |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-j5jfp to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
e2e-derive-b2ba96cb-openshift-default-57c4649cdd-wdb8r |
Scheduled |
Successfully assigned openshift-ingress/e2e-derive-b2ba96cb-openshift-default-57c4649cdd-wdb8r to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
router-default-6f8c885cd9-2mgwd |
Scheduled |
Successfully assigned openshift-ingress/router-default-6f8c885cd9-2mgwd to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
router-default-6f8c885cd9-2mgwd |
FailedScheduling |
0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling. | ||
openshift-ingress |
payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7 to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4 to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2 |
Scheduled |
Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2 to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2 |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2 to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
e2e-api-b-fbf2d4-openshift-default-755b97855d-w749l |
Scheduled |
Successfully assigned openshift-ingress/e2e-api-b-fbf2d4-openshift-default-755b97855d-w749l to ip-10-0-135-218.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-ipp-a-c4dbeb-75f5bcb6b-kttnk |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-c4dbeb-75f5bcb6b-kttnk to ip-10-0-143-46.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-inf-a-0d2dee-5f79b46b46-7b4xf |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-0d2dee-5f79b46b46-7b4xf to ip-10-0-143-46.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm |
Scheduled |
Successfully assigned openshift-ingress/payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm to ip-10-0-143-164.ec2.internal | ||
openshift-ingress |
deployment-controller |
router-default |
ScalingReplicaSet |
Scaled up replica set router-default-6f8c885cd9 from 0 to 1 | |
| (x10) | openshift-ingress |
replicaset-controller |
router-default-6f8c885cd9 |
FailedCreate |
Error creating: pods "router-default-6f8c885cd9-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
openshift-ingress |
service-controller |
router-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
service-controller |
router-default |
UnAvailableLoadBalancer |
There are no available nodes for LoadBalancer | |
openshift-ingress |
service-controller |
router-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x16) | openshift-ingress |
replicaset-controller |
router-default-6f8c885cd9 |
FailedCreate |
Error creating: pods "router-default-6f8c885cd9-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
openshift-ingress |
replicaset-controller |
router-default-6f8c885cd9 |
SuccessfulCreate |
Created pod: router-default-6f8c885cd9-2mgwd | |
| (x3) | openshift-ingress |
service-controller |
router-default |
UpdatedLoadBalancer |
Updated load balancer with new hosts |
| (x6) | openshift-ingress |
kubelet |
router-default-6f8c885cd9-2mgwd |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
| (x6) | openshift-ingress |
kubelet |
router-default-6f8c885cd9-2mgwd |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
openshift-ingress |
multus |
router-default-6f8c885cd9-2mgwd |
AddedInterface |
Add eth0 [10.132.0.9/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
router-default-6f8c885cd9-2mgwd |
Pulled |
Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine | |
openshift-ingress |
kubelet |
router-default-6f8c885cd9-2mgwd |
Created |
Created container: router | |
openshift-ingress |
kubelet |
router-default-6f8c885cd9-2mgwd |
Started |
Started container router | |
openshift-ingress |
deployment-controller |
kube-auth-proxy |
ScalingReplicaSet |
Scaled up replica set kube-auth-proxy-cd65dd67b from 0 to 2 | |
openshift-ingress |
replicaset-controller |
kube-auth-proxy-cd65dd67b |
SuccessfulCreate |
Created pod: kube-auth-proxy-cd65dd67b-xsqns | |
openshift-ingress |
replicaset-controller |
kube-auth-proxy-cd65dd67b |
SuccessfulCreate |
Created pod: kube-auth-proxy-cd65dd67b-vrwf2 | |
| (x5) | openshift-ingress |
replicaset-controller |
kube-auth-proxy-cd65dd67b |
FailedCreate |
Error creating: pods "kube-auth-proxy-cd65dd67b-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found |
openshift-ingress |
multus |
kube-auth-proxy-cd65dd67b-xsqns |
AddedInterface |
Add eth0 [10.133.0.22/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1 | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7b7995d5cd |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-7b7995d5cd-n8pt4 | |
openshift-ingress |
kubelet |
kube-auth-proxy-cd65dd67b-vrwf2 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" | |
openshift-ingress |
kubelet |
kube-auth-proxy-cd65dd67b-xsqns |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" | |
openshift-ingress |
multus |
kube-auth-proxy-cd65dd67b-vrwf2 |
AddedInterface |
Add eth0 [10.134.0.22/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7b7995d5cd-n8pt4 |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" | |
openshift-ingress |
multus |
istiod-openshift-gateway-7b7995d5cd-n8pt4 |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-fgbbp |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1 | |
openshift-ingress |
kubelet |
kube-auth-proxy-cd65dd67b-xsqns |
Started |
Started container kube-auth-proxy | |
openshift-ingress |
kubelet |
kube-auth-proxy-cd65dd67b-vrwf2 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.689s (2.689s including waiting). Image size: 265120132 bytes. | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-5677ccb49b |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-5677ccb49b-fgbbp | |
openshift-ingress |
kubelet |
kube-auth-proxy-cd65dd67b-vrwf2 |
Started |
Started container kube-auth-proxy | |
openshift-ingress |
multus |
istiod-openshift-gateway-5677ccb49b-fgbbp |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
kube-auth-proxy-cd65dd67b-vrwf2 |
Created |
Created container: kube-auth-proxy | |
openshift-ingress |
kubelet |
kube-auth-proxy-cd65dd67b-xsqns |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.636s (2.636s including waiting). Image size: 265120132 bytes. | |
openshift-ingress |
kubelet |
kube-auth-proxy-cd65dd67b-xsqns |
Created |
Created container: kube-auth-proxy | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-fgbbp |
Created |
Created container: discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7b7995d5cd-n8pt4 |
Created |
Created container: discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7b7995d5cd-n8pt4 |
Started |
Started container discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7b7995d5cd-n8pt4 |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.475s (3.475s including waiting). Image size: 181126104 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-fgbbp |
Started |
Started container discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-fgbbp |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 1.775s (1.775s including waiting). Image size: 181126104 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7b7995d5cd-n8pt4 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7b7995d5cd-n8pt4 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-fgbbp |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-fgbbp |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
replicaset-controller |
data-science-gateway-data-science-gateway-class-d66cd8c7c |
SuccessfulCreate |
Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-vjtwb | |
openshift-ingress |
kubelet |
data-science-gateway-data-science-gateway-class-d66cd8c7c-vjtwb |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" | |
openshift-ingress |
deployment-controller |
data-science-gateway-data-science-gateway-class |
ScalingReplicaSet |
Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1 | |
openshift-ingress |
multus |
data-science-gateway-data-science-gateway-class-d66cd8c7c-vjtwb |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0 | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7b7995d5cd |
SuccessfulDelete |
Deleted pod: istiod-openshift-gateway-7b7995d5cd-n8pt4 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7b7995d5cd-n8pt4 |
Killing |
Stopping container discovery | |
openshift-ingress |
kubelet |
data-science-gateway-data-science-gateway-class-d66cd8c7c-vjtwb |
Started |
Started container istio-proxy | |
openshift-ingress |
kubelet |
data-science-gateway-data-science-gateway-class-d66cd8c7c-vjtwb |
Created |
Created container: istio-proxy | |
openshift-ingress |
kubelet |
data-science-gateway-data-science-gateway-class-d66cd8c7c-vjtwb |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.102s (3.102s including waiting). Image size: 181318953 bytes. | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
kube-auth-proxy |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
openshift-ingress |
deployment-controller |
maas-default-gateway-openshift-default |
ScalingReplicaSet |
Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
maas-default-gateway |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway | |
openshift-ingress |
replicaset-controller |
maas-default-gateway-openshift-default-78bb78ff78 |
SuccessfulCreate |
Created pod: maas-default-gateway-openshift-default-78bb78ff78-tthvj | |
openshift-ingress |
multus |
maas-default-gateway-openshift-default-78bb78ff78-tthvj |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-processing-5cc6cd444b |
SuccessfulCreate |
Created pod: payload-processing-5cc6cd444b-j5jfp | |
openshift-ingress |
deployment-controller |
payload-processing |
ScalingReplicaSet |
Scaled up replica set payload-processing-5cc6cd444b from 0 to 1 | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-pre-processing-687dbb6cf6 |
FailedCreate |
Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found |
| (x5) | openshift-ingress |
replicaset-controller |
payload-processing-5cc6cd444b |
FailedCreate |
Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1 | |
openshift-ingress |
kubelet |
payload-processing-5cc6cd444b-j5jfp |
Pulling |
Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" | |
openshift-ingress |
multus |
payload-pre-processing-687dbb6cf6-hsfch |
AddedInterface |
Add eth0 [10.133.0.41/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-687dbb6cf6-hsfch |
Pulling |
Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" | |
openshift-ingress |
multus |
payload-processing-5cc6cd444b-j5jfp |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-687dbb6cf6 |
SuccessfulCreate |
Created pod: payload-pre-processing-687dbb6cf6-hsfch | |
openshift-ingress |
kubelet |
payload-processing-5cc6cd444b-j5jfp |
Started |
Started container payload-processing | |
openshift-ingress |
kubelet |
payload-processing-5cc6cd444b-j5jfp |
Created |
Created container: payload-processing | |
openshift-ingress |
kubelet |
payload-processing-5cc6cd444b-j5jfp |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.871s (1.871s including waiting). Image size: 165907129 bytes. | |
openshift-ingress |
kubelet |
payload-pre-processing-687dbb6cf6-hsfch |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.502s (2.502s including waiting). Image size: 165907129 bytes. | |
openshift-ingress |
kubelet |
payload-pre-processing-687dbb6cf6-hsfch |
Created |
Created container: payload-pre-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-687dbb6cf6-hsfch |
Started |
Started container payload-pre-processing | |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-78bb78ff78-tthvj |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-78bb78ff78-tthvj |
Created |
Created container: istio-proxy |
| (x2) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-78bb78ff78-tthvj |
Started |
Started container istio-proxy |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-78bb78ff78-tthvj |
ProbeError |
Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body: |
| (x4) | openshift-ingress |
kubelet |
maas-default-gateway-openshift-default-78bb78ff78-tthvj |
Unhealthy |
Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused |
openshift-ingress |
deployment-controller |
e2e-ait-654abfac-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-ait-654abfac-openshift-default-5cc7d78784 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
e2e-ait-654abfac-openshift-default-5cc7d78784 |
SuccessfulCreate |
Created pod: e2e-ait-654abfac-openshift-default-5cc7d78784-bfp4d | |
openshift-ingress |
multus |
e2e-ait-654abfac-openshift-default-5cc7d78784-bfp4d |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
openshift-ingress |
gateway_labeler_controller |
e2e-ait-654abfac |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-ait-654abfac | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ait-654abfac-6f4dc488fb |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2 | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
multus |
payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr |
Created |
Created container: payload-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr |
Started |
Started container payload-processing | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-ait-654abfac-97c59ff6d |
SuccessfulCreate |
Created pod: payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-ait-654abfac-97c59ff6d |
FailedCreate |
Error creating: pods "payload-processing-e2e-ait-654abfac-97c59ff6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-654abfac: serviceaccount "payload-processing-e2e-ait-654abfac" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-ait-654abfac |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-ait-654abfac-6f4dc488fb from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-ait-654abfac |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-ait-654abfac-97c59ff6d from 0 to 1 | |
openshift-ingress |
multus |
payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2 |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2 |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2 |
Created |
Created container: payload-pre-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2 |
Started |
Started container payload-pre-processing | |
| (x4) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ait-654abfac-6f4dc488fb |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-654abfac: serviceaccount "payload-processing-e2e-ait-654abfac" not found |
openshift-ingress |
kubelet |
e2e-ait-654abfac-openshift-default-5cc7d78784-bfp4d |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.39:15021/healthz/ready": read tcp 10.132.0.2:53020->10.132.0.39:15021: read: connection reset by peer | |
openshift-ingress |
kubelet |
e2e-ait-654abfac-openshift-default-5cc7d78784-bfp4d |
ProbeError |
Readiness probe error: Get "http://10.132.0.39:15021/healthz/ready": read tcp 10.132.0.2:53020->10.132.0.39:15021: read: connection reset by peer body: | |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-654abfac-openshift-default-5cc7d78784-bfp4d |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-654abfac-openshift-default-5cc7d78784-bfp4d |
Started |
Started container istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-654abfac-openshift-default-5cc7d78784-bfp4d |
Created |
Created container: istio-proxy |
| (x4) | openshift-ingress |
kubelet |
e2e-ait-654abfac-openshift-default-5cc7d78784-bfp4d |
ProbeError |
Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body: |
| (x4) | openshift-ingress |
kubelet |
e2e-ait-654abfac-openshift-default-5cc7d78784-bfp4d |
Unhealthy |
Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-654abfac-97c59ff6d-drbtr |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-654abfac-6f4dc488fb-8tqv2 |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-ait-654abfac-openshift-default-5cc7d78784-bfp4d |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4 |
SuccessfulCreate |
Created pod: e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q | |
openshift-ingress |
deployment-controller |
e2e-migrate-58d49f55-gw-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4 from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-migrate-58d49f55-gw |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-58d49f55-gw | |
openshift-ingress |
kubelet |
e2e-ait-654abfac-openshift-default-5cc7d78784-bfp4d |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-ait-654abfac-openshift-default-5cc7d78784-bfp4d |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q |
FailedCreatePodSandBox |
Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q_openshift-ingress_3781af2b-aefa-43ed-a302-232e93e65f5e_0(3ddf3746df1fb64f3f9619611856a98106d45417c376f9029536ec1a6594e2ce): error adding pod openshift-ingress_e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3ddf3746df1fb64f3f9619611856a98106d45417c376f9029536ec1a6594e2ce" Netns:"/var/run/netns/e41f7795-3cab-4112-a022-843603795b84" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress;K8S_POD_NAME=e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q;K8S_POD_INFRA_CONTAINER_ID=3ddf3746df1fb64f3f9619611856a98106d45417c376f9029536ec1a6594e2ce;K8S_POD_UID=3781af2b-aefa-43ed-a302-232e93e65f5e" Path:"" ERRORED: error configuring pod [openshift-ingress/e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q] networking: Multus: [openshift-ingress/e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q/3781af2b-aefa-43ed-a302-232e93e65f5e]: error waiting for pod: Get "https://aec4395a0df5348538f12988908e86f1-d9d3b76b8a75332a.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress/pods/e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q?timeout=1m0s": context deadline exceeded ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} | |
openshift-ingress |
kubelet |
e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q |
FailedCreatePodSandBox |
Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q_openshift-ingress_3781af2b-aefa-43ed-a302-232e93e65f5e_0(bf4d090e8a464cb9cab9f1d5f6f3084c4fe3d47ce26b034c20ff773b4578be88): error adding pod openshift-ingress_e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"bf4d090e8a464cb9cab9f1d5f6f3084c4fe3d47ce26b034c20ff773b4578be88" Netns:"/var/run/netns/98b696fb-ccc0-409e-9a3f-5e0f885fef35" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress;K8S_POD_NAME=e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q;K8S_POD_INFRA_CONTAINER_ID=bf4d090e8a464cb9cab9f1d5f6f3084c4fe3d47ce26b034c20ff773b4578be88;K8S_POD_UID=3781af2b-aefa-43ed-a302-232e93e65f5e" Path:"" ERRORED: error configuring pod [openshift-ingress/e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q] networking: Multus: [openshift-ingress/e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q/3781af2b-aefa-43ed-a302-232e93e65f5e]: error waiting for pod: Get "https://aec4395a0df5348538f12988908e86f1-d9d3b76b8a75332a.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress/pods/e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q?timeout=1m0s": context deadline exceeded ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} | |
openshift-ingress |
kubelet |
e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q |
FailedCreatePodSandBox |
Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q_openshift-ingress_3781af2b-aefa-43ed-a302-232e93e65f5e_0(6ff3e0f49ff93f5c3f11222594517656e67622708a59f3440330eca1bfe3c2a0): error adding pod openshift-ingress_e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"6ff3e0f49ff93f5c3f11222594517656e67622708a59f3440330eca1bfe3c2a0" Netns:"/var/run/netns/1f352a9c-36c3-4613-aa28-1a28ecf6b9bd" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-ingress;K8S_POD_NAME=e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q;K8S_POD_INFRA_CONTAINER_ID=6ff3e0f49ff93f5c3f11222594517656e67622708a59f3440330eca1bfe3c2a0;K8S_POD_UID=3781af2b-aefa-43ed-a302-232e93e65f5e" Path:"" ERRORED: error configuring pod [openshift-ingress/e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q] networking: Multus: [openshift-ingress/e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q/3781af2b-aefa-43ed-a302-232e93e65f5e]: error waiting for pod: Get "https://aec4395a0df5348538f12988908e86f1-d9d3b76b8a75332a.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-ingress/pods/e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q?timeout=1m0s": context deadline exceeded ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} | |
openshift-ingress |
multus |
e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-migrate-58d49f55 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-migrate-58d49f55-54d89f64df from 0 to 1 | |
| (x3) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-58d49f55: serviceaccount "payload-processing-e2e-migrate-58d49f55" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-migrate-58d49f55 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d from 0 to 1 | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-migrate-58d49f55-54d89f64df |
FailedCreate |
Error creating: pods "payload-processing-e2e-migrate-58d49f55-54d89f64df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-58d49f55: serviceaccount "payload-processing-e2e-migrate-58d49f55" not found |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-migrate-58d49f55-54d89f64df |
SuccessfulCreate |
Created pod: payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6 | |
| (x2) | openshift-ingress |
kubelet |
e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
| (x2) | openshift-ingress |
kubelet |
e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q |
Created |
Created container: istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q |
Started |
Started container istio-proxy |
| (x3) | openshift-ingress |
kubelet |
e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q |
ProbeError |
Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body: |
| (x3) | openshift-ingress |
kubelet |
e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q |
Unhealthy |
Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858 |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
multus |
payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858 |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6 |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
multus |
payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6 |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858 |
Created |
Created container: payload-pre-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858 |
Started |
Started container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6 |
Started |
Started container payload-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6 |
Created |
Created container: payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-migrate-58d49f55-57bb78d78d-rz858 |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-migrate-58d49f55-54d89f64df-mxdz6 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
e2e-migrate-58d49f55-gw-openshift-default-778cbcd4b4-4w87q |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
e2e-ait-3af40866-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-ait-3af40866-openshift-default-58768868f6 from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-ait-3af40866 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-ait-3af40866 | |
openshift-ingress |
replicaset-controller |
e2e-ait-3af40866-openshift-default-58768868f6 |
SuccessfulCreate |
Created pod: e2e-ait-3af40866-openshift-default-58768868f6-x5vxv | |
openshift-ingress |
multus |
e2e-ait-3af40866-openshift-default-58768868f6-x5vxv |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ait-3af40866-5bd6f97d8 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-ait-3af40866-747858cbb4 |
SuccessfulCreate |
Created pod: payload-processing-e2e-ait-3af40866-747858cbb4-lv2l6 | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
multus |
payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ait-3af40866-5bd6f97d8 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3af40866: serviceaccount "payload-processing-e2e-ait-3af40866" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-ait-3af40866 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-ait-3af40866-5bd6f97d8 from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-ait-3af40866 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-ait-3af40866-747858cbb4 from 0 to 1 | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-ait-3af40866-747858cbb4 |
FailedCreate |
Error creating: pods "payload-processing-e2e-ait-3af40866-747858cbb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3af40866: serviceaccount "payload-processing-e2e-ait-3af40866" not found |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd |
Started |
Started container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-3af40866-747858cbb4-lv2l6 |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd |
Created |
Created container: payload-pre-processing | |
openshift-ingress |
multus |
payload-processing-e2e-ait-3af40866-747858cbb4-lv2l6 |
AddedInterface |
Add eth0 [10.133.0.52/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-3af40866-747858cbb4-lv2l6 |
Started |
Started container payload-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-3af40866-747858cbb4-lv2l6 |
Created |
Created container: payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.45:9004: connect: connection refused | |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-3af40866-openshift-default-58768868f6-x5vxv |
Started |
Started container istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-3af40866-openshift-default-58768868f6-x5vxv |
Created |
Created container: istio-proxy |
openshift-ingress |
kubelet |
e2e-ait-3af40866-openshift-default-58768868f6-x5vxv |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.42:15021/healthz/ready": read tcp 10.132.0.2:51296->10.132.0.42:15021: read: connection reset by peer | |
| (x2) | openshift-ingress |
kubelet |
e2e-ait-3af40866-openshift-default-58768868f6-x5vxv |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
openshift-ingress |
kubelet |
e2e-ait-3af40866-openshift-default-58768868f6-x5vxv |
ProbeError |
Readiness probe error: Get "http://10.132.0.42:15021/healthz/ready": read tcp 10.132.0.2:51296->10.132.0.42:15021: read: connection reset by peer body: | |
| (x4) | openshift-ingress |
kubelet |
e2e-ait-3af40866-openshift-default-58768868f6-x5vxv |
ProbeError |
Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body: |
| (x4) | openshift-ingress |
kubelet |
e2e-ait-3af40866-openshift-default-58768868f6-x5vxv |
Unhealthy |
Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused |
openshift-ingress |
endpoint-controller |
payload-pre-processing-e2e-ait-3af40866 |
FailedToUpdateEndpoint |
Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-3af40866: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-3af40866": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-3af40866, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c24e4380-fc3b-4ee3-b997-6643d1567b04, UID in object meta: | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ait-3af40866-5bd6f97d8-j4zgd |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-ait-3af40866-747858cbb4-lv2l6 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
e2e-ait-3af40866-openshift-default-58768868f6-x5vxv |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
multus |
e2e-derive-b2ba96cb-openshift-default-57c4649cdd-wdb8r |
AddedInterface |
Add eth0 [10.132.0.43/23] from ovn-kubernetes | |
openshift-ingress |
gateway_labeler_controller |
e2e-derive-b2ba96cb |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-derive-b2ba96cb | |
openshift-ingress |
deployment-controller |
e2e-derive-b2ba96cb-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-derive-b2ba96cb-openshift-default-57c4649cdd from 0 to 1 | |
openshift-ingress |
replicaset-controller |
e2e-derive-b2ba96cb-openshift-default-57c4649cdd |
SuccessfulCreate |
Created pod: e2e-derive-b2ba96cb-openshift-default-57c4649cdd-wdb8r | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-derive-b2ba96cb-795bc6cd9d |
SuccessfulCreate |
Created pod: payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-derive-b2ba96cb |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-derive-b2ba96cb-6547b75d4d from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-derive-b2ba96cb |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-derive-b2ba96cb-795bc6cd9d from 0 to 1 | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-derive-b2ba96cb-795bc6cd9d |
FailedCreate |
Error creating: pods "payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b2ba96cb: serviceaccount "payload-processing-e2e-derive-b2ba96cb" not found |
openshift-ingress |
kubelet |
payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
multus |
payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-derive-b2ba96cb-6547b75d4d |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-derive-b2ba96cb-6547b75d4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b2ba96cb: serviceaccount "payload-processing-e2e-derive-b2ba96cb" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-derive-b2ba96cb-6547b75d4d |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-derive-b2ba96cb-6547b75d4d-4g54j | |
openshift-ingress |
multus |
payload-pre-processing-e2e-derive-b2ba96cb-6547b75d4d-4g54j |
AddedInterface |
Add eth0 [10.133.0.55/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-derive-b2ba96cb-6547b75d4d-4g54j |
Started |
Started container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl |
Started |
Started container payload-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl |
Created |
Created container: payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-derive-b2ba96cb-6547b75d4d-4g54j |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-derive-b2ba96cb-6547b75d4d-4g54j |
Created |
Created container: payload-pre-processing | |
| (x2) | openshift-ingress |
kubelet |
e2e-derive-b2ba96cb-openshift-default-57c4649cdd-wdb8r |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
| (x2) | openshift-ingress |
kubelet |
e2e-derive-b2ba96cb-openshift-default-57c4649cdd-wdb8r |
Started |
Started container istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-derive-b2ba96cb-openshift-default-57c4649cdd-wdb8r |
Created |
Created container: istio-proxy |
| (x4) | openshift-ingress |
kubelet |
e2e-derive-b2ba96cb-openshift-default-57c4649cdd-wdb8r |
ProbeError |
Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body: |
| (x4) | openshift-ingress |
kubelet |
e2e-derive-b2ba96cb-openshift-default-57c4649cdd-wdb8r |
Unhealthy |
Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused |
openshift-ingress |
kubelet |
payload-processing-e2e-derive-b2ba96cb-795bc6cd9d-xd8hl |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-derive-b2ba96cb-6547b75d4d-4g54j |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-derive-b2ba96cb-openshift-default-57c4649cdd-wdb8r |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
e2e-mt-22f7c4a2-openshift-default-88ccf85d4 |
SuccessfulCreate |
Created pod: e2e-mt-22f7c4a2-openshift-default-88ccf85d4-fw52t | |
openshift-ingress |
deployment-controller |
e2e-mt-22f7c4a2-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-mt-22f7c4a2-openshift-default-88ccf85d4 from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-mt-22f7c4a2 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-mt-22f7c4a2 | |
openshift-ingress |
multus |
e2e-mt-22f7c4a2-openshift-default-88ccf85d4-fw52t |
AddedInterface |
Add eth0 [10.132.0.45/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-mt-22f7c4a2-55b8647978 |
SuccessfulCreate |
Created pod: payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-mt-22f7c4a2-54779d667b |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-mt-22f7c4a2 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-mt-22f7c4a2-54779d667b from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-mt-22f7c4a2 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-mt-22f7c4a2-55b8647978 from 0 to 1 | |
| (x4) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-mt-22f7c4a2-54779d667b |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-22f7c4a2: serviceaccount "payload-processing-e2e-mt-22f7c4a2" not found |
| (x5) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-mt-22f7c4a2-55b8647978 |
FailedCreate |
Error creating: pods "payload-processing-e2e-mt-22f7c4a2-55b8647978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-22f7c4a2: serviceaccount "payload-processing-e2e-mt-22f7c4a2" not found |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
multus |
payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c |
AddedInterface |
Add eth0 [10.134.0.47/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c |
Started |
Started container payload-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c |
Created |
Created container: payload-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
multus |
payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j |
AddedInterface |
Add eth0 [10.134.0.48/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j |
Created |
Created container: payload-pre-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j |
Started |
Started container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-mt-22f7c4a2-openshift-default-88ccf85d4-fw52t |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused | |
| (x2) | openshift-ingress |
kubelet |
e2e-mt-22f7c4a2-openshift-default-88ccf85d4-fw52t |
Created |
Created container: istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-mt-22f7c4a2-openshift-default-88ccf85d4-fw52t |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
openshift-ingress |
kubelet |
e2e-mt-22f7c4a2-openshift-default-88ccf85d4-fw52t |
ProbeError |
Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body: | |
| (x2) | openshift-ingress |
kubelet |
e2e-mt-22f7c4a2-openshift-default-88ccf85d4-fw52t |
Started |
Started container istio-proxy |
| (x4) | openshift-ingress |
kubelet |
e2e-mt-22f7c4a2-openshift-default-88ccf85d4-fw52t |
ProbeError |
Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body: |
| (x4) | openshift-ingress |
kubelet |
e2e-mt-22f7c4a2-openshift-default-88ccf85d4-fw52t |
Unhealthy |
Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-22f7c4a2-55b8647978-d242c |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-22f7c4a2-54779d667b-rbd2j |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-mt-22f7c4a2-openshift-default-88ccf85d4-fw52t |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-mt-22f7c4a2-openshift-default-88ccf85d4-fw52t |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-mt-22f7c4a2-openshift-default-88ccf85d4-fw52t |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
deployment-controller |
e2e-mt-44b2dff2-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-mt-44b2dff2-openshift-default-7786bc96d4 from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-mt-44b2dff2 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-mt-44b2dff2 | |
openshift-ingress |
replicaset-controller |
e2e-mt-44b2dff2-openshift-default-7786bc96d4 |
SuccessfulCreate |
Created pod: e2e-mt-44b2dff2-openshift-default-7786bc96d4-sclsq | |
openshift-ingress |
multus |
e2e-mt-44b2dff2-openshift-default-7786bc96d4-sclsq |
AddedInterface |
Add eth0 [10.132.0.46/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-mt-44b2dff2 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-mt-44b2dff2-5db57f469b from 0 to 1 | |
| (x6) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-mt-44b2dff2-8b8f4957d |
FailedCreate |
Error creating: pods "payload-processing-e2e-mt-44b2dff2-8b8f4957d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-44b2dff2: serviceaccount "payload-processing-e2e-mt-44b2dff2" not found |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p |
Created |
Created container: payload-pre-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p |
Started |
Started container payload-pre-processing | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-mt-44b2dff2-5db57f469b |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-44b2dff2: serviceaccount "payload-processing-e2e-mt-44b2dff2" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-mt-44b2dff2-5db57f469b |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p | |
openshift-ingress |
multus |
payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4 |
AddedInterface |
Add eth0 [10.134.0.50/23] from ovn-kubernetes | |
openshift-ingress |
multus |
payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p |
AddedInterface |
Add eth0 [10.134.0.49/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4 |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4 |
Created |
Created container: payload-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4 |
Started |
Started container payload-processing | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-mt-44b2dff2 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-mt-44b2dff2-8b8f4957d from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-mt-44b2dff2-8b8f4957d |
SuccessfulCreate |
Created pod: payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4 | |
| (x2) | openshift-ingress |
kubelet |
e2e-mt-44b2dff2-openshift-default-7786bc96d4-sclsq |
Created |
Created container: istio-proxy |
openshift-ingress |
kubelet |
e2e-mt-44b2dff2-openshift-default-7786bc96d4-sclsq |
ProbeError |
Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
| (x2) | openshift-ingress |
kubelet |
e2e-mt-44b2dff2-openshift-default-7786bc96d4-sclsq |
Started |
Started container istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-mt-44b2dff2-openshift-default-7786bc96d4-sclsq |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
openshift-ingress |
kubelet |
e2e-mt-44b2dff2-openshift-default-7786bc96d4-sclsq |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
| (x4) | openshift-ingress |
kubelet |
e2e-mt-44b2dff2-openshift-default-7786bc96d4-sclsq |
ProbeError |
Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body: |
| (x4) | openshift-ingress |
kubelet |
e2e-mt-44b2dff2-openshift-default-7786bc96d4-sclsq |
Unhealthy |
Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-mt-44b2dff2-5db57f469b-jcs6p |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-mt-44b2dff2-8b8f4957d-542h4 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
e2e-mt-44b2dff2-openshift-default-7786bc96d4-sclsq |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
deployment-controller |
e2e-inf-a-0d2dee-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-inf-a-0d2dee-openshift-default-589c6c9c8 from 0 to 1 | |
openshift-ingress |
multus |
e2e-inf-a-0d2dee-openshift-default-589c6c9c8-54jtj |
AddedInterface |
Add eth0 [10.132.0.47/23] from ovn-kubernetes | |
openshift-ingress |
gateway_labeler_controller |
e2e-inf-a-0d2dee |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-0d2dee | |
openshift-ingress |
replicaset-controller |
e2e-inf-a-0d2dee-openshift-default-589c6c9c8 |
SuccessfulCreate |
Created pod: e2e-inf-a-0d2dee-openshift-default-589c6c9c8-54jtj | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-inf-a-0d2dee |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-inf-a-0d2dee |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-inf-a-0d2dee-5f79b46b46 from 0 to 1 | |
| (x4) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-0d2dee: serviceaccount "payload-processing-e2e-inf-a-0d2dee" not found |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6 |
Started |
Started container payload-pre-processing | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-inf-a-0d2dee-5f79b46b46 |
FailedCreate |
Error creating: pods "payload-processing-e2e-inf-a-0d2dee-5f79b46b46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-0d2dee: serviceaccount "payload-processing-e2e-inf-a-0d2dee" not found |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-a-0d2dee-5f79b46b46-7b4xf |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6 | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6 |
Created |
Created container: payload-pre-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6 |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-inf-a-0d2dee-5f79b46b46 |
SuccessfulCreate |
Created pod: payload-processing-e2e-inf-a-0d2dee-5f79b46b46-7b4xf | |
openshift-ingress |
multus |
payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6 |
AddedInterface |
Add eth0 [10.134.0.52/23] from ovn-kubernetes | |
openshift-ingress |
multus |
payload-processing-e2e-inf-a-0d2dee-5f79b46b46-7b4xf |
AddedInterface |
Add eth0 [10.133.0.61/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-a-0d2dee-5f79b46b46-7b4xf |
Started |
Started container payload-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-a-0d2dee-5f79b46b46-7b4xf |
Created |
Created container: payload-processing | |
openshift-ingress |
replicaset-controller |
e2e-inf-b-664c72-openshift-default-5b9f79d75b |
SuccessfulCreate |
Created pod: e2e-inf-b-664c72-openshift-default-5b9f79d75b-jx5h6 | |
openshift-ingress |
deployment-controller |
e2e-inf-b-664c72-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-inf-b-664c72-openshift-default-5b9f79d75b from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-inf-b-664c72 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-664c72 | |
openshift-ingress |
multus |
e2e-inf-b-664c72-openshift-default-5b9f79d75b-jx5h6 |
AddedInterface |
Add eth0 [10.132.0.48/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-inf-b-664c72 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-inf-b-664c72-7b756ddb5b from 0 to 1 | |
| (x4) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-inf-b-664c72-b84cc47b4 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-664c72: serviceaccount "payload-processing-e2e-inf-b-664c72" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-inf-b-664c72-b84cc47b4 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-inf-b-664c72-7b756ddb5b |
SuccessfulCreate |
Created pod: payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-inf-b-664c72 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-inf-b-664c72-b84cc47b4 from 0 to 1 | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-inf-b-664c72-7b756ddb5b |
FailedCreate |
Error creating: pods "payload-processing-e2e-inf-b-664c72-7b756ddb5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-664c72: serviceaccount "payload-processing-e2e-inf-b-664c72" not found |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp |
Started |
Started container payload-pre-processing | |
openshift-ingress |
multus |
payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c |
AddedInterface |
Add eth0 [10.134.0.54/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c |
Created |
Created container: payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp |
Created |
Created container: payload-pre-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
multus |
payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp |
AddedInterface |
Add eth0 [10.134.0.53/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c |
Started |
Started container payload-processing | |
| (x2) | openshift-ingress |
kubelet |
e2e-inf-a-0d2dee-openshift-default-589c6c9c8-54jtj |
Started |
Started container istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-inf-a-0d2dee-openshift-default-589c6c9c8-54jtj |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
| (x2) | openshift-ingress |
kubelet |
e2e-inf-a-0d2dee-openshift-default-589c6c9c8-54jtj |
Created |
Created container: istio-proxy |
| (x4) | openshift-ingress |
kubelet |
e2e-inf-a-0d2dee-openshift-default-589c6c9c8-54jtj |
Unhealthy |
Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused |
| (x4) | openshift-ingress |
kubelet |
e2e-inf-a-0d2dee-openshift-default-589c6c9c8-54jtj |
ProbeError |
Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body: |
| (x2) | openshift-ingress |
kubelet |
e2e-inf-b-664c72-openshift-default-5b9f79d75b-jx5h6 |
Started |
Started container istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-inf-b-664c72-openshift-default-5b9f79d75b-jx5h6 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
openshift-ingress |
kubelet |
e2e-inf-b-664c72-openshift-default-5b9f79d75b-jx5h6 |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": read tcp 10.132.0.2:44148->10.132.0.48:15021: read: connection reset by peer | |
openshift-ingress |
kubelet |
e2e-inf-b-664c72-openshift-default-5b9f79d75b-jx5h6 |
ProbeError |
Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": read tcp 10.132.0.2:44148->10.132.0.48:15021: read: connection reset by peer body: | |
| (x2) | openshift-ingress |
kubelet |
e2e-inf-b-664c72-openshift-default-5b9f79d75b-jx5h6 |
Created |
Created container: istio-proxy |
| (x4) | openshift-ingress |
kubelet |
e2e-inf-b-664c72-openshift-default-5b9f79d75b-jx5h6 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused |
| (x4) | openshift-ingress |
kubelet |
e2e-inf-b-664c72-openshift-default-5b9f79d75b-jx5h6 |
ProbeError |
Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-a-0d2dee-5f79b46b46-7b4xf |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-a-0d2dee-dfcf7d46d-m7db6 |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-inf-a-0d2dee-openshift-default-589c6c9c8-54jtj |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-inf-a-0d2dee-openshift-default-589c6c9c8-54jtj |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
e2e-inf-a-0d2dee-openshift-default-589c6c9c8-54jtj |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-inf-b-664c72-b84cc47b4-9gccp |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-inf-b-664c72-7b756ddb5b-n996c |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
e2e-inf-b-664c72-openshift-default-5b9f79d75b-jx5h6 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
e2e-api-a-fcb199-openshift-default-77bbf74bd8 |
SuccessfulCreate |
Created pod: e2e-api-a-fcb199-openshift-default-77bbf74bd8-md85r | |
openshift-ingress |
gateway_labeler_controller |
e2e-api-a-fcb199 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-fcb199 | |
openshift-ingress |
deployment-controller |
e2e-api-a-fcb199-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-api-a-fcb199-openshift-default-77bbf74bd8 from 0 to 1 | |
openshift-ingress |
multus |
e2e-api-a-fcb199-openshift-default-77bbf74bd8-md85r |
AddedInterface |
Add eth0 [10.132.0.50/23] from ovn-kubernetes | |
| (x4) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-api-a-fcb199-77797f7cfb |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-fcb199: serviceaccount "payload-processing-e2e-api-a-fcb199" not found |
| (x5) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-api-a-fcb199-695946fb8 |
FailedCreate |
Error creating: pods "payload-processing-e2e-api-a-fcb199-695946fb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-fcb199: serviceaccount "payload-processing-e2e-api-a-fcb199" not found |
openshift-ingress |
deployment-controller |
payload-processing-e2e-api-a-fcb199 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-api-a-fcb199-695946fb8 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-api-a-fcb199-695946fb8 |
SuccessfulCreate |
Created pod: payload-processing-e2e-api-a-fcb199-695946fb8-zqfch | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-api-a-fcb199 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-api-a-fcb199-77797f7cfb from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-api-a-fcb199-77797f7cfb |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-a-fcb199-695946fb8-zqfch |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-a-fcb199-695946fb8-zqfch |
Created |
Created container: payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f |
Started |
Started container payload-pre-processing | |
openshift-ingress |
multus |
payload-processing-e2e-api-a-fcb199-695946fb8-zqfch |
AddedInterface |
Add eth0 [10.133.0.67/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f |
Created |
Created container: payload-pre-processing | |
openshift-ingress |
multus |
payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f |
AddedInterface |
Add eth0 [10.134.0.57/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-a-fcb199-695946fb8-zqfch |
Started |
Started container payload-processing | |
openshift-ingress |
gateway_labeler_controller |
e2e-api-b-fbf2d4 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-fbf2d4 | |
openshift-ingress |
deployment-controller |
e2e-api-b-fbf2d4-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-api-b-fbf2d4-openshift-default-755b97855d from 0 to 1 | |
openshift-ingress |
replicaset-controller |
e2e-api-b-fbf2d4-openshift-default-755b97855d |
SuccessfulCreate |
Created pod: e2e-api-b-fbf2d4-openshift-default-755b97855d-w749l | |
openshift-ingress |
multus |
e2e-api-b-fbf2d4-openshift-default-755b97855d-w749l |
AddedInterface |
Add eth0 [10.132.0.51/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-api-b-fbf2d4 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-api-b-fbf2d4-5bb64d694b |
FailedCreate |
Error creating: pods "payload-processing-e2e-api-b-fbf2d4-5bb64d694b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-fbf2d4: serviceaccount "payload-processing-e2e-api-b-fbf2d4" not found |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-api-b-fbf2d4-5bb64d694b |
SuccessfulCreate |
Created pod: payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-api-b-fbf2d4 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-api-b-fbf2d4-5bb64d694b from 0 to 1 | |
| (x4) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-fbf2d4: serviceaccount "payload-processing-e2e-api-b-fbf2d4" not found |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv |
Created |
Created container: payload-pre-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
multus |
payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv |
AddedInterface |
Add eth0 [10.134.0.58/23] from ovn-kubernetes | |
openshift-ingress |
multus |
payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm |
AddedInterface |
Add eth0 [10.134.0.59/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv |
Started |
Started container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm |
Created |
Created container: payload-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm |
Started |
Started container payload-processing | |
| (x2) | openshift-ingress |
kubelet |
e2e-api-a-fcb199-openshift-default-77bbf74bd8-md85r |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
| (x2) | openshift-ingress |
kubelet |
e2e-api-a-fcb199-openshift-default-77bbf74bd8-md85r |
Started |
Started container istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-api-a-fcb199-openshift-default-77bbf74bd8-md85r |
Created |
Created container: istio-proxy |
| (x5) | openshift-ingress |
kubelet |
e2e-api-a-fcb199-openshift-default-77bbf74bd8-md85r |
ProbeError |
Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
e2e-api-a-fcb199-openshift-default-77bbf74bd8-md85r |
Unhealthy |
Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.58:9004: connect: connection refused | |
openshift-ingress |
kubelet |
e2e-api-b-fbf2d4-openshift-default-755b97855d-w749l |
ProbeError |
Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
e2e-api-b-fbf2d4-openshift-default-755b97855d-w749l |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
| (x2) | openshift-ingress |
kubelet |
e2e-api-b-fbf2d4-openshift-default-755b97855d-w749l |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
| (x2) | openshift-ingress |
kubelet |
e2e-api-b-fbf2d4-openshift-default-755b97855d-w749l |
Started |
Started container istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-api-b-fbf2d4-openshift-default-755b97855d-w749l |
Created |
Created container: istio-proxy |
| (x5) | openshift-ingress |
kubelet |
e2e-api-b-fbf2d4-openshift-default-755b97855d-w749l |
ProbeError |
Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
e2e-api-b-fbf2d4-openshift-default-755b97855d-w749l |
Unhealthy |
Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-a-fcb199-77797f7cfb-lqr4f |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-a-fcb199-695946fb8-zqfch |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
e2e-api-a-fcb199-openshift-default-77bbf74bd8-md85r |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-api-a-fcb199-openshift-default-77bbf74bd8-md85r |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-api-a-fcb199-openshift-default-77bbf74bd8-md85r |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
payload-processing-e2e-api-b-fbf2d4-5bb64d694b-wdpxm |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-api-b-fbf2d4-6ccf7f6dd-xsvwv |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-api-b-fbf2d4-openshift-default-755b97855d-w749l |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
replicaset-controller |
e2e-shared-a-f58a29-openshift-default-57456d4488 |
SuccessfulCreate |
Created pod: e2e-shared-a-f58a29-openshift-default-57456d4488-7fdlc | |
openshift-ingress |
gateway_labeler_controller |
e2e-shared-a-f58a29 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-f58a29 | |
openshift-ingress |
deployment-controller |
e2e-shared-a-f58a29-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-a-f58a29-openshift-default-57456d4488 from 0 to 1 | |
openshift-ingress |
multus |
e2e-shared-a-f58a29-openshift-default-57456d4488-7fdlc |
AddedInterface |
Add eth0 [10.132.0.52/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-api-b-fbf2d4-openshift-default-755b97855d-w749l |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-api-b-fbf2d4-openshift-default-755b97855d-w749l |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
| (x4) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-a-f58a29-55fc5df844 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-f58a29: serviceaccount "payload-processing-e2e-shared-a-f58a29" not found |
| (x5) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-a-f58a29-7f66684fd |
FailedCreate |
Error creating: pods "payload-processing-e2e-shared-a-f58a29-7f66684fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-f58a29: serviceaccount "payload-processing-e2e-shared-a-f58a29" not found |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-a-f58a29-55fc5df844 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-shared-a-f58a29 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-shared-a-f58a29-55fc5df844 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-a-f58a29-7f66684fd |
SuccessfulCreate |
Created pod: payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-shared-a-f58a29 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-shared-a-f58a29-7f66684fd from 0 to 1 | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m |
Started |
Started container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8 |
Started |
Started container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m |
Created |
Created container: payload-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
multus |
payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m |
AddedInterface |
Add eth0 [10.134.0.61/23] from ovn-kubernetes | |
openshift-ingress |
multus |
payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8 |
AddedInterface |
Add eth0 [10.134.0.60/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8 |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8 |
Created |
Created container: payload-pre-processing | |
openshift-ingress |
replicaset-controller |
e2e-shared-b-052d16-openshift-default-66ff8fdd5b |
SuccessfulCreate |
Created pod: e2e-shared-b-052d16-openshift-default-66ff8fdd5b-gkzd5 | |
openshift-ingress |
gateway_labeler_controller |
e2e-shared-b-052d16 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-052d16 | |
openshift-ingress |
multus |
e2e-shared-b-052d16-openshift-default-66ff8fdd5b-gkzd5 |
AddedInterface |
Add eth0 [10.132.0.53/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
e2e-shared-b-052d16-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-shared-b-052d16-openshift-default-66ff8fdd5b from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-shared-b-052d16 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-shared-b-052d16-5b487fc986 from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-shared-b-052d16 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-shared-b-052d16-5f9fc667b from 0 to 1 | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-b-052d16-5b487fc986 |
FailedCreate |
Error creating: pods "payload-processing-e2e-shared-b-052d16-5b487fc986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-052d16: serviceaccount "payload-processing-e2e-shared-b-052d16" not found |
| (x4) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-b-052d16-5f9fc667b |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-052d16: serviceaccount "payload-processing-e2e-shared-b-052d16" not found |
openshift-ingress |
multus |
payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7 |
AddedInterface |
Add eth0 [10.134.0.63/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-shared-b-052d16-5b487fc986 |
SuccessfulCreate |
Created pod: payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7 | |
openshift-ingress |
multus |
payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb |
AddedInterface |
Add eth0 [10.134.0.62/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb |
Created |
Created container: payload-pre-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb |
Started |
Started container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7 |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7 |
Created |
Created container: payload-processing | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-shared-b-052d16-5f9fc667b |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7 |
Started |
Started container payload-processing | |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-a-f58a29-openshift-default-57456d4488-7fdlc |
Created |
Created container: istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-a-f58a29-openshift-default-57456d4488-7fdlc |
Started |
Started container istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-a-f58a29-openshift-default-57456d4488-7fdlc |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
| (x4) | openshift-ingress |
kubelet |
e2e-shared-a-f58a29-openshift-default-57456d4488-7fdlc |
Unhealthy |
Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused |
| (x4) | openshift-ingress |
kubelet |
e2e-shared-a-f58a29-openshift-default-57456d4488-7fdlc |
ProbeError |
Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
e2e-shared-b-052d16-openshift-default-66ff8fdd5b-gkzd5 |
ProbeError |
Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:53268->10.132.0.53:15021: read: connection reset by peer body: | |
openshift-ingress |
kubelet |
e2e-shared-b-052d16-openshift-default-66ff8fdd5b-gkzd5 |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": read tcp 10.132.0.2:53268->10.132.0.53:15021: read: connection reset by peer | |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-b-052d16-openshift-default-66ff8fdd5b-gkzd5 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-b-052d16-openshift-default-66ff8fdd5b-gkzd5 |
Created |
Created container: istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-shared-b-052d16-openshift-default-66ff8fdd5b-gkzd5 |
Started |
Started container istio-proxy |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-b-052d16-openshift-default-66ff8fdd5b-gkzd5 |
ProbeError |
Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
e2e-shared-b-052d16-openshift-default-66ff8fdd5b-gkzd5 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused |
openshift-ingress |
replicaset-controller |
e2e-ipp-a-c4dbeb-openshift-default-7b67fc547d |
SuccessfulCreate |
Created pod: e2e-ipp-a-c4dbeb-openshift-default-7b67fc547d-5nzx2 | |
openshift-ingress |
deployment-controller |
e2e-ipp-a-c4dbeb-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-ipp-a-c4dbeb-openshift-default-7b67fc547d from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-ipp-a-c4dbeb |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-c4dbeb | |
openshift-ingress |
multus |
e2e-ipp-a-c4dbeb-openshift-default-7b67fc547d-5nzx2 |
AddedInterface |
Add eth0 [10.132.0.62/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ipp-a-c4dbeb-5ccb489cf6 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-ipp-a-c4dbeb-5ccb489cf6-scm45 | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-ipp-a-c4dbeb-75f5bcb6b |
FailedCreate |
Error creating: pods "payload-processing-e2e-ipp-a-c4dbeb-75f5bcb6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c4dbeb: serviceaccount "payload-processing-e2e-ipp-a-c4dbeb" not found |
| (x4) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ipp-a-c4dbeb-5ccb489cf6 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-ipp-a-c4dbeb-5ccb489cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-c4dbeb: serviceaccount "payload-processing-e2e-ipp-a-c4dbeb" not found |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-ipp-a-c4dbeb |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-ipp-a-c4dbeb-5ccb489cf6 from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-ipp-a-c4dbeb |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-ipp-a-c4dbeb-75f5bcb6b from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-ipp-a-c4dbeb-75f5bcb6b |
SuccessfulCreate |
Created pod: payload-processing-e2e-ipp-a-c4dbeb-75f5bcb6b-kttnk | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-a-c4dbeb-5ccb489cf6-scm45 |
Created |
Created container: payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-a-c4dbeb-75f5bcb6b-kttnk |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-a-c4dbeb-75f5bcb6b-kttnk |
Started |
Started container payload-processing | |
openshift-ingress |
multus |
payload-pre-processing-e2e-ipp-a-c4dbeb-5ccb489cf6-scm45 |
AddedInterface |
Add eth0 [10.133.0.74/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-a-c4dbeb-5ccb489cf6-scm45 |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
multus |
payload-processing-e2e-ipp-a-c4dbeb-75f5bcb6b-kttnk |
AddedInterface |
Add eth0 [10.133.0.75/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-a-c4dbeb-75f5bcb6b-kttnk |
Created |
Created container: payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-a-c4dbeb-5ccb489cf6-scm45 |
Started |
Started container payload-pre-processing | |
openshift-ingress |
deployment-controller |
e2e-ipp-b-809b00-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-ipp-b-809b00-openshift-default-78486bc4c8 from 0 to 1 | |
openshift-ingress |
gateway_labeler_controller |
e2e-ipp-b-809b00 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-809b00 | |
openshift-ingress |
replicaset-controller |
e2e-ipp-b-809b00-openshift-default-78486bc4c8 |
SuccessfulCreate |
Created pod: e2e-ipp-b-809b00-openshift-default-78486bc4c8-p2l2m | |
openshift-ingress |
multus |
e2e-ipp-b-809b00-openshift-default-78486bc4c8-p2l2m |
AddedInterface |
Add eth0 [10.132.0.63/23] from ovn-kubernetes | |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-a-c4dbeb-openshift-default-7b67fc547d-5nzx2 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-a-c4dbeb-openshift-default-7b67fc547d-5nzx2 |
Created |
Created container: istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-a-c4dbeb-openshift-default-7b67fc547d-5nzx2 |
Started |
Started container istio-proxy |
openshift-ingress |
deployment-controller |
payload-processing-e2e-ipp-b-809b00 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-ipp-b-809b00-5d5c5c774 from 0 to 1 | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-ipp-b-809b00-5d5c5c774 |
FailedCreate |
Error creating: pods "payload-processing-e2e-ipp-b-809b00-5d5c5c774-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-809b00: serviceaccount "payload-processing-e2e-ipp-b-809b00" not found |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ipp-b-809b00-558b94856 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ipp-b-809b00-558b94856 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-ipp-b-809b00-558b94856-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-809b00: serviceaccount "payload-processing-e2e-ipp-b-809b00" not found |
openshift-ingress |
multus |
payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj |
AddedInterface |
Add eth0 [10.134.0.68/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
multus |
payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc |
AddedInterface |
Add eth0 [10.134.0.69/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj |
Created |
Created container: payload-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj |
Started |
Started container payload-processing | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-ipp-b-809b00 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-ipp-b-809b00-558b94856 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-ipp-b-809b00-5d5c5c774 |
SuccessfulCreate |
Created pod: payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc |
Started |
Started container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc |
Created |
Created container: payload-pre-processing | |
| (x6) | openshift-ingress |
kubelet |
e2e-ipp-a-c4dbeb-openshift-default-7b67fc547d-5nzx2 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
e2e-ipp-a-c4dbeb-openshift-default-7b67fc547d-5nzx2 |
ProbeError |
Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body: |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-b-809b00-openshift-default-78486bc4c8-p2l2m |
Started |
Started container istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-b-809b00-openshift-default-78486bc4c8-p2l2m |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-b-809b00-openshift-default-78486bc4c8-p2l2m |
Created |
Created container: istio-proxy |
| (x4) | openshift-ingress |
kubelet |
e2e-ipp-b-809b00-openshift-default-78486bc4c8-p2l2m |
Unhealthy |
Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused |
| (x4) | openshift-ingress |
kubelet |
e2e-ipp-b-809b00-openshift-default-78486bc4c8-p2l2m |
ProbeError |
Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body: |
openshift-ingress |
gateway_labeler_controller |
e2e-ipp-cleanup-4cd197 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-4cd197 | |
openshift-ingress |
GatewayAuthBootstrap |
e2e-ipp-cleanup-4cd197 |
ReconcileError |
Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-cleanup-4cd197-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-cleanup-4cd197-authn-ssl" already exists | |
openshift-ingress |
multus |
e2e-ipp-cleanup-4cd197-openshift-default-8656db6f68-kcwmw |
AddedInterface |
Add eth0 [10.132.0.64/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
e2e-ipp-cleanup-4cd197-openshift-default |
ScalingReplicaSet |
Scaled up replica set e2e-ipp-cleanup-4cd197-openshift-default-8656db6f68 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
e2e-ipp-cleanup-4cd197-openshift-default-8656db6f68 |
SuccessfulCreate |
Created pod: e2e-ipp-cleanup-4cd197-openshift-default-8656db6f68-kcwmw | |
openshift-ingress |
deployment-controller |
payload-processing-e2e-ipp-cleanup-4cd197 |
ScalingReplicaSet |
Scaled up replica set payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6 from 0 to 1 | |
openshift-ingress |
deployment-controller |
payload-pre-processing-e2e-ipp-cleanup-4cd197 |
ScalingReplicaSet |
Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8 from 0 to 1 | |
openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8 |
SuccessfulCreate |
Created pod: payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2 | |
| (x4) | openshift-ingress |
replicaset-controller |
payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8 |
FailedCreate |
Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197: serviceaccount "payload-processing-e2e-ipp-cleanup-4cd197" not found |
openshift-ingress |
replicaset-controller |
payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6 |
SuccessfulCreate |
Created pod: payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2 | |
| (x5) | openshift-ingress |
replicaset-controller |
payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6 |
FailedCreate |
Error creating: pods "payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-4cd197: serviceaccount "payload-processing-e2e-ipp-cleanup-4cd197" not found |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2 |
Started |
Started container payload-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2 |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2 |
Created |
Created container: payload-pre-processing | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2 |
Started |
Started container payload-pre-processing | |
openshift-ingress |
multus |
payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2 |
AddedInterface |
Add eth0 [10.134.0.72/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2 |
Pulled |
Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2 |
Created |
Created container: payload-processing | |
openshift-ingress |
multus |
payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2 |
AddedInterface |
Add eth0 [10.134.0.71/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
e2e-ipp-cleanup-4cd197-openshift-default-8656db6f68-kcwmw |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": read tcp 10.132.0.2:37748->10.132.0.64:15021: read: connection reset by peer | |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-cleanup-4cd197-openshift-default-8656db6f68-kcwmw |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-cleanup-4cd197-openshift-default-8656db6f68-kcwmw |
Created |
Created container: istio-proxy |
| (x2) | openshift-ingress |
kubelet |
e2e-ipp-cleanup-4cd197-openshift-default-8656db6f68-kcwmw |
Started |
Started container istio-proxy |
openshift-ingress |
kubelet |
e2e-ipp-cleanup-4cd197-openshift-default-8656db6f68-kcwmw |
ProbeError |
Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": read tcp 10.132.0.2:37748->10.132.0.64:15021: read: connection reset by peer body: | |
| (x4) | openshift-ingress |
kubelet |
e2e-ipp-cleanup-4cd197-openshift-default-8656db6f68-kcwmw |
Unhealthy |
Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused |
| (x4) | openshift-ingress |
kubelet |
e2e-ipp-cleanup-4cd197-openshift-default-8656db6f68-kcwmw |
ProbeError |
Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body: |
openshift-ingress |
endpoint-controller |
payload-pre-processing-e2e-ipp-cleanup-4cd197 |
FailedToUpdateEndpoint |
Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-4cd197": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4cd197, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: feecd44d-0ddb-4a93-8217-d338f8295ecb, UID in object meta: | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-cleanup-4cd197-9fbb5d8b8-txvr2 |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-cleanup-4cd197-6c4bb5c8c6-mttb2 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
e2e-ipp-cleanup-4cd197-openshift-default-8656db6f68-kcwmw |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-a-c4dbeb-5ccb489cf6-scm45 |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-a-c4dbeb-75f5bcb6b-kttnk |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
e2e-ipp-a-c4dbeb-openshift-default-7b67fc547d-5nzx2 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-ipp-b-809b00-558b94856-qhxfc |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-ipp-b-809b00-5d5c5c774-xpfvj |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
e2e-ipp-b-809b00-openshift-default-78486bc4c8-p2l2m |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-ipp-b-809b00-openshift-default-78486bc4c8-p2l2m |
ProbeError |
Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body: | |
openshift-ingress |
kubelet |
e2e-ipp-b-809b00-openshift-default-78486bc4c8-p2l2m |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-a-f58a29-7f66684fd-f5n2m |
Killing |
Stopping container payload-processing | |
openshift-ingress |
endpoint-controller |
payload-pre-processing-e2e-shared-a-f58a29 |
FailedToUpdateEndpoint |
Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-f58a29": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-f58a29, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 10c26fe3-e5e0-4be4-8d73-e69006d5e0d6, UID in object meta: | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-a-f58a29-55fc5df844-lgfq8 |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
e2e-shared-a-f58a29-openshift-default-57456d4488-7fdlc |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
payload-pre-processing-e2e-shared-b-052d16-5f9fc667b-ld7xb |
Killing |
Stopping container payload-pre-processing | |
openshift-ingress |
kubelet |
payload-processing-e2e-shared-b-052d16-5b487fc986-6sdq7 |
Killing |
Stopping container payload-processing | |
openshift-ingress |
kubelet |
e2e-shared-b-052d16-openshift-default-66ff8fdd5b-gkzd5 |
Killing |
Stopping container istio-proxy | |
openshift-ingress |
kubelet |
e2e-shared-b-052d16-openshift-default-66ff8fdd5b-gkzd5 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
e2e-shared-b-052d16-openshift-default-66ff8fdd5b-gkzd5 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: |