=== events in openshift-ingress (2026-11-04T06:12:28Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 9m58s Normal Scheduled pod/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw to ip-10-0-133-0.us-west-1.compute.internal 9m50s Normal Scheduled pod/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg Successfully assigned openshift-ingress/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg to ip-10-0-133-0.us-west-1.compute.internal 9m47s Normal Scheduled pod/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t to ip-10-0-133-0.us-west-1.compute.internal 3m28s Normal Scheduled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd Successfully assigned openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd to ip-10-0-134-45.us-west-1.compute.internal 7m30s Normal Scheduled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx Successfully assigned openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx to ip-10-0-133-0.us-west-1.compute.internal 4m43s Normal Scheduled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb Successfully assigned openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb to ip-10-0-134-45.us-west-1.compute.internal 10m Normal Scheduled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w Successfully assigned openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w to ip-10-0-143-195.us-west-1.compute.internal 2m42s Normal Scheduled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m Successfully assigned openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m to ip-10-0-133-0.us-west-1.compute.internal 4m43s Normal Scheduled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt Successfully assigned openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt to ip-10-0-133-0.us-west-1.compute.internal 2m57s Normal Scheduled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz Successfully assigned openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz to ip-10-0-133-0.us-west-1.compute.internal 12m Normal Scheduled pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gk4kw to ip-10-0-133-0.us-west-1.compute.internal 4m11s Normal Scheduled pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr Successfully assigned openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr to ip-10-0-133-0.us-west-1.compute.internal 12m Normal Scheduled pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-l4lrf to ip-10-0-143-195.us-west-1.compute.internal 10m Normal Scheduled pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd Successfully assigned openshift-ingress/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd to ip-10-0-143-195.us-west-1.compute.internal 17m Normal Scheduled pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9lc9f to ip-10-0-133-0.us-west-1.compute.internal 11m Normal Scheduled pod/maas-default-gateway-openshift-default-6886b96f9-79hwm Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-79hwm to ip-10-0-134-45.us-west-1.compute.internal 5m42s Normal Scheduled pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 Successfully assigned openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 to ip-10-0-143-195.us-west-1.compute.internal 9m30s Normal Scheduled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 Successfully assigned openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 to ip-10-0-143-195.us-west-1.compute.internal 11m Normal Scheduled pod/maas-default-gateway-openshift-default-6886b96f9-6v285 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-6v285 to ip-10-0-143-195.us-west-1.compute.internal 2m11s Normal Scheduled pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb Successfully assigned openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb to ip-10-0-133-0.us-west-1.compute.internal 8m45s Normal Scheduled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q Successfully assigned openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q to ip-10-0-143-195.us-west-1.compute.internal 5m12s Normal Scheduled pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk Successfully assigned openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk to ip-10-0-133-0.us-west-1.compute.internal 16m Normal Scheduled pod/kube-auth-proxy-5c8546cb5f-crt7k Successfully assigned openshift-ingress/kube-auth-proxy-5c8546cb5f-crt7k to ip-10-0-143-195.us-west-1.compute.internal 2m10s Normal Scheduled pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc Successfully assigned openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc to ip-10-0-143-195.us-west-1.compute.internal 16m Normal Scheduled pod/kube-auth-proxy-5c8546cb5f-2lpkm Successfully assigned openshift-ingress/kube-auth-proxy-5c8546cb5f-2lpkm to ip-10-0-134-45.us-west-1.compute.internal 23m Normal Scheduled pod/router-default-5c558747f-x6r92 Successfully assigned openshift-ingress/router-default-5c558747f-x6r92 to ip-10-0-133-0.us-west-1.compute.internal 23m Warning FailedScheduling pod/router-default-5c558747f-x6r92 no nodes available to schedule pods 2m57s Normal Scheduled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 Successfully assigned openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 to ip-10-0-134-45.us-west-1.compute.internal 29m Warning FailedScheduling pod/router-default-5c558747f-x6r92 no nodes available to schedule pods 10m Normal Scheduled pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p Successfully assigned openshift-ingress/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p to ip-10-0-143-195.us-west-1.compute.internal 9m39s Normal Scheduled pod/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd to ip-10-0-133-0.us-west-1.compute.internal 9m41s Normal Scheduled pod/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg Successfully assigned openshift-ingress/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg to ip-10-0-143-195.us-west-1.compute.internal 10m Normal Scheduled pod/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5 Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5 to ip-10-0-133-0.us-west-1.compute.internal 9m58s Normal Scheduled pod/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct to ip-10-0-133-0.us-west-1.compute.internal 9m39s Normal Scheduled pod/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n Successfully assigned openshift-ingress/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n to ip-10-0-133-0.us-west-1.compute.internal 2m57s Normal Scheduled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m Successfully assigned openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m to ip-10-0-143-195.us-west-1.compute.internal 9m47s Normal Scheduled pod/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2 Successfully assigned openshift-ingress/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2 to ip-10-0-133-0.us-west-1.compute.internal 10m Normal Scheduled pod/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z to ip-10-0-143-195.us-west-1.compute.internal 2m42s Normal Scheduled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4 Successfully assigned openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4 to ip-10-0-143-195.us-west-1.compute.internal 2m42s Normal Scheduled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg Successfully assigned openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg to ip-10-0-133-0.us-west-1.compute.internal 3m28s Normal Scheduled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m Successfully assigned openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m to ip-10-0-143-195.us-west-1.compute.internal 3m56s Normal Scheduled pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb Successfully assigned openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb to ip-10-0-143-195.us-west-1.compute.internal 12m Normal Scheduled pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-gs6m9 to ip-10-0-134-45.us-west-1.compute.internal 2m57s Normal Scheduled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 Successfully assigned openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 to ip-10-0-134-45.us-west-1.compute.internal 10m Normal Scheduled pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 Successfully assigned openshift-ingress/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 to ip-10-0-133-0.us-west-1.compute.internal 17m Normal Scheduled pod/istiod-openshift-gateway-7876bfcb74-44k77 Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-44k77 to ip-10-0-143-195.us-west-1.compute.internal 11m Normal Scheduled pod/payload-processing-7bb9489676-246k6 Successfully assigned openshift-ingress/payload-processing-7bb9489676-246k6 to ip-10-0-133-0.us-west-1.compute.internal 10m Normal Scheduled pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h Successfully assigned openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h to ip-10-0-133-0.us-west-1.compute.internal 9m50s Normal Scheduled pod/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq to ip-10-0-133-0.us-west-1.compute.internal 9m42s Normal Scheduled pod/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv to ip-10-0-133-0.us-west-1.compute.internal 10m Normal Scheduled pod/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5 Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5 to ip-10-0-133-0.us-west-1.compute.internal 2m57s Normal Scheduled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk Successfully assigned openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk to ip-10-0-133-0.us-west-1.compute.internal 10m Normal Scheduled pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt Successfully assigned openshift-ingress/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt to ip-10-0-133-0.us-west-1.compute.internal 16m Normal Scheduled pod/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf to ip-10-0-133-0.us-west-1.compute.internal 2m42s Normal Scheduled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt Successfully assigned openshift-ingress/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt to ip-10-0-134-45.us-west-1.compute.internal 10m Normal Scheduled pod/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf to ip-10-0-143-195.us-west-1.compute.internal 4m12s Normal Scheduled pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj Successfully assigned openshift-ingress/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj to ip-10-0-134-45.us-west-1.compute.internal 14m Normal Scheduled pod/istiod-openshift-gateway-7ddd9cfdc8-x8ks7 Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-x8ks7 to ip-10-0-133-0.us-west-1.compute.internal 9m30s Normal Scheduled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq Successfully assigned openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq to ip-10-0-134-45.us-west-1.compute.internal 10m Normal Scheduled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt Successfully assigned openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt to ip-10-0-133-0.us-west-1.compute.internal 17m Normal Scheduled pod/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv to ip-10-0-133-0.us-west-1.compute.internal 9m30s Normal Scheduled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 Successfully assigned openshift-ingress/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 to ip-10-0-133-0.us-west-1.compute.internal 11m Normal Scheduled pod/payload-pre-processing-7b98bb678c-sdjbp Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-sdjbp to ip-10-0-133-0.us-west-1.compute.internal 30m Normal ScalingReplicaSet deployment/router-default Scaled up replica set router-default-5c558747f from 0 to 1 29m Normal EnsuringLoadBalancer service/router-default Ensuring load balancer 29m Warning UnAvailableLoadBalancer service/router-default There are no available nodes for LoadBalancer 29m Normal EnsuredLoadBalancer service/router-default Ensured load balancer 29m Normal SuccessfulCreate replicaset/router-default-5c558747f Created pod: router-default-5c558747f-x6r92 23m Normal UpdatedLoadBalancer service/router-default Updated load balancer with new hosts 23m Warning FailedMount pod/router-default-5c558747f-x6r92 MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 23m Warning FailedMount pod/router-default-5c558747f-x6r92 MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 23m Warning FailedMount pod/router-default-5c558747f-x6r92 MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt 23m Warning FailedMount pod/router-default-5c558747f-x6r92 MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found 23m Normal AddedInterface pod/router-default-5c558747f-x6r92 Add eth0 [10.132.0.12/23] from ovn-kubernetes 22m Normal Pulled pod/router-default-5c558747f-x6r92 Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod 22m Normal Created pod/router-default-5c558747f-x6r92 Container created 22m Normal Started pod/router-default-5c558747f-x6r92 Container started 18m Normal AddedLabel gateway/maas-default-gateway Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway 17m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1 17m Normal AddedInterface pod/istiod-openshift-gateway-7876bfcb74-44k77 Add eth0 [10.133.0.18/23] from ovn-kubernetes 17m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7876bfcb74 Created pod: istiod-openshift-gateway-7876bfcb74-44k77 17m Normal Pulling pod/istiod-openshift-gateway-7876bfcb74-44k77 Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 17m Normal Created pod/istiod-openshift-gateway-7876bfcb74-44k77 Container created 17m Normal Pulled pod/istiod-openshift-gateway-7876bfcb74-44k77 Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 4.796s (4.796s including waiting). Image size: 185476477 bytes. 17m Normal Started pod/istiod-openshift-gateway-7876bfcb74-44k77 Container started 17m Warning Unhealthy pod/istiod-openshift-gateway-7876bfcb74-44k77 Readiness probe failed: HTTP probe failed with statuscode: 503 17m Warning ProbeError pod/istiod-openshift-gateway-7876bfcb74-44k77 Readiness probe error: HTTP probe failed with statuscode: 503... 17m Normal SuccessfulCreate replicaset/openshift-ai-inference-openshift-ai-inference-55f56bc75f Created pod: openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv 17m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-6886b96f9 from 0 to 1 17m Normal ScalingReplicaSet deployment/openshift-ai-inference-openshift-ai-inference Scaled up replica set openshift-ai-inference-openshift-ai-inference-55f56bc75f from 0 to 1 17m Normal EnsuringLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensuring load balancer 17m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-6886b96f9 Created pod: maas-default-gateway-openshift-default-6886b96f9-9lc9f 17m Normal Pulling pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 17m Normal Pulling pod/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 17m Normal AddedInterface pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f Add eth0 [10.132.0.33/23] from ovn-kubernetes 17m Normal AddedInterface pod/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv Add eth0 [10.132.0.34/23] from ovn-kubernetes 17m Normal EnsuredLoadBalancer service/openshift-ai-inference-openshift-ai-inference Ensured load balancer 17m Normal Pulled pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 12.35s (12.35s including waiting). Image size: 183555333 bytes. 17m Normal Created pod/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv Container created 17m Normal Pulled pod/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 12.587s (12.587s including waiting). Image size: 183555333 bytes. 17m Normal Started pod/openshift-ai-inference-openshift-ai-inference-55f56bc75f-n8mnv Container started 17m Warning FailedGetResourceMetric horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 17m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/openshift-ai-inference-openshift-ai-inference invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 16m Normal ScalingReplicaSet deployment/kube-auth-proxy Scaled up replica set kube-auth-proxy-5c8546cb5f from 0 to 2 16m Normal SuccessfulCreate replicaset/kube-auth-proxy-5c8546cb5f Created pod: kube-auth-proxy-5c8546cb5f-2lpkm 16m Normal SuccessfulCreate replicaset/kube-auth-proxy-5c8546cb5f Created pod: kube-auth-proxy-5c8546cb5f-crt7k 16m Normal AddedInterface pod/kube-auth-proxy-5c8546cb5f-crt7k Add eth0 [10.133.0.20/23] from ovn-kubernetes 16m Normal ScalingReplicaSet deployment/data-science-gateway-data-science-gateway-class Scaled up replica set data-science-gateway-data-science-gateway-class-7845f94dd5 from 0 to 1 16m Normal Pulling pod/kube-auth-proxy-5c8546cb5f-crt7k Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 16m Normal SuccessfulCreate replicaset/data-science-gateway-data-science-gateway-class-7845f94dd5 Created pod: data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf 16m Normal Pulling pod/kube-auth-proxy-5c8546cb5f-2lpkm Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" 16m Normal AddedInterface pod/kube-auth-proxy-5c8546cb5f-2lpkm Add eth0 [10.134.0.27/23] from ovn-kubernetes 16m Normal Started pod/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf Container started 16m Normal Created pod/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf Container created 16m Normal Pulled pod/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 16m Normal AddedInterface pod/data-science-gateway-data-science-gateway-class-7845f94dd5xrzlf Add eth0 [10.132.0.46/23] from ovn-kubernetes 16m Normal Started pod/kube-auth-proxy-5c8546cb5f-2lpkm Container started 16m Normal Started pod/kube-auth-proxy-5c8546cb5f-crt7k Container started 16m Normal Pulled pod/kube-auth-proxy-5c8546cb5f-2lpkm Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.901s (2.901s including waiting). Image size: 188904677 bytes. 16m Normal Created pod/kube-auth-proxy-5c8546cb5f-2lpkm Container created 16m Normal Created pod/kube-auth-proxy-5c8546cb5f-crt7k Container created 16m Normal Pulled pod/kube-auth-proxy-5c8546cb5f-crt7k Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.713s (2.713s including waiting). Image size: 188904677 bytes. 16m Warning FailedGetResourceMetric horizontalpodautoscaler/kube-auth-proxy failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 16m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/kube-auth-proxy invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 15m Warning FailedGetResourceMetric horizontalpodautoscaler/data-science-gateway-data-science-gateway-class failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 15m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/data-science-gateway-data-science-gateway-class invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 14m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1 14m Normal SuccessfulCreate replicaset/istiod-openshift-gateway-7ddd9cfdc8 Created pod: istiod-openshift-gateway-7ddd9cfdc8-x8ks7 14m Normal Pulling pod/istiod-openshift-gateway-7ddd9cfdc8-x8ks7 Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" 14m Normal AddedInterface pod/istiod-openshift-gateway-7ddd9cfdc8-x8ks7 Add eth0 [10.132.0.51/23] from ovn-kubernetes 14m Normal Pulled pod/istiod-openshift-gateway-7ddd9cfdc8-x8ks7 Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.581s (3.581s including waiting). Image size: 185476477 bytes. 14m Normal Started pod/istiod-openshift-gateway-7ddd9cfdc8-x8ks7 Container started 14m Normal Created pod/istiod-openshift-gateway-7ddd9cfdc8-x8ks7 Container created 14m Warning ProbeError pod/istiod-openshift-gateway-7ddd9cfdc8-x8ks7 Readiness probe error: HTTP probe failed with statuscode: 503... 14m Warning Unhealthy pod/istiod-openshift-gateway-7ddd9cfdc8-x8ks7 Readiness probe failed: HTTP probe failed with statuscode: 503 14m Normal Killing pod/istiod-openshift-gateway-7876bfcb74-44k77 Stopping container discovery 14m Normal SuccessfulDelete replicaset/istiod-openshift-gateway-7876bfcb74 Deleted pod: istiod-openshift-gateway-7876bfcb74-44k77 14m Normal ScalingReplicaSet deployment/istiod-openshift-gateway Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0 14m Warning FailedGetResourceMetric horizontalpodautoscaler/istiod-openshift-gateway failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 14m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/istiod-openshift-gateway invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 14m Normal Created pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f Container created 14m Normal Started pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f Container started 14m Normal Pulled pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 14m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/istiod-openshift-gateway invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 14m Warning FailedGetResourceMetric horizontalpodautoscaler/istiod-openshift-gateway failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 14m Warning ProbeError pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused... 14m Warning Unhealthy pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused 14m Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 14m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 14m Warning FailedGetResourceMetric horizontalpodautoscaler/maas-default-gateway-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 14m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/maas-default-gateway-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 12m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-6886b96f9 Created pod: maas-default-gateway-openshift-default-6886b96f9-gs6m9 12m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-6886b96f9 Created pod: maas-default-gateway-openshift-default-6886b96f9-gk4kw 12m Normal AddedInterface pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw Add eth0 [10.132.0.54/23] from ovn-kubernetes 12m Normal AddedInterface pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf Add eth0 [10.133.0.33/23] from ovn-kubernetes 12m Normal Pulling pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 12m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-6886b96f9 from 1 to 4 12m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 12m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-6886b96f9 Created pod: maas-default-gateway-openshift-default-6886b96f9-l4lrf 12m Normal AddedInterface pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 Add eth0 [10.134.0.38/23] from ovn-kubernetes 12m Normal Created pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw Container created 12m Normal Pulling pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" 12m Normal Started pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw Container started 12m Normal Pulled pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 11m Normal Pulled pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 4.715s (4.715s including waiting). Image size: 183555333 bytes. 11m Normal Started pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 Container started 11m Normal Created pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 Container created 11m Warning Unhealthy pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused 11m Warning ProbeError pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused... 11m Warning ProbeError pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused... 11m Warning ProbeError pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 11m Warning Unhealthy pod/maas-default-gateway-openshift-default-6886b96f9-gk4kw Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 11m Warning Unhealthy pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused 11m Normal Started pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf Container started 11m Normal Created pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf Container created 11m Normal Pulled pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 13.461s (13.461s including waiting). Image size: 183555333 bytes. 11m Warning Unhealthy pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused 11m Warning ProbeError pod/maas-default-gateway-openshift-default-6886b96f9-l4lrf Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused... 11m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-6886b96f9 Created pod: maas-default-gateway-openshift-default-6886b96f9-79hwm 11m Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 6; reason: cpu resource utilization (percentage of request) above target 11m Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled up replica set maas-default-gateway-openshift-default-6886b96f9 from 4 to 6 11m Normal SuccessfulCreate replicaset/maas-default-gateway-openshift-default-6886b96f9 Created pod: maas-default-gateway-openshift-default-6886b96f9-6v285 11m Normal AddedInterface pod/maas-default-gateway-openshift-default-6886b96f9-79hwm Add eth0 [10.134.0.39/23] from ovn-kubernetes 11m Normal Created pod/maas-default-gateway-openshift-default-6886b96f9-79hwm Container created 11m Normal AddedInterface pod/maas-default-gateway-openshift-default-6886b96f9-6v285 Add eth0 [10.133.0.35/23] from ovn-kubernetes 11m Normal Started pod/maas-default-gateway-openshift-default-6886b96f9-79hwm Container started 11m Normal Pulled pod/maas-default-gateway-openshift-default-6886b96f9-6v285 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 11m Normal Created pod/maas-default-gateway-openshift-default-6886b96f9-6v285 Container created 11m Normal Started pod/maas-default-gateway-openshift-default-6886b96f9-6v285 Container started 11m Normal Pulled pod/maas-default-gateway-openshift-default-6886b96f9-79hwm Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 11m Warning Unhealthy pod/maas-default-gateway-openshift-default-6886b96f9-6v285 Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused 11m Warning ProbeError pod/maas-default-gateway-openshift-default-6886b96f9-6v285 Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused... 11m Warning Unhealthy pod/maas-default-gateway-openshift-default-6886b96f9-79hwm Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused 11m Warning ProbeError pod/maas-default-gateway-openshift-default-6886b96f9-79hwm Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused... 11m Normal ScalingReplicaSet deployment/payload-pre-processing Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1 11m Normal SuccessfulCreate replicaset/payload-pre-processing-7b98bb678c Created pod: payload-pre-processing-7b98bb678c-sdjbp 11m Warning FailedCreate replicaset/payload-processing-7bb9489676 Error creating: pods "payload-processing-7bb9489676-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found 11m Warning FailedCreate replicaset/payload-pre-processing-7b98bb678c Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found 11m Normal ScalingReplicaSet deployment/payload-processing Scaled up replica set payload-processing-7bb9489676 from 0 to 1 11m Normal SuccessfulCreate replicaset/payload-processing-7bb9489676 Created pod: payload-processing-7bb9489676-246k6 11m Normal Pulling pod/payload-processing-7bb9489676-246k6 Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 11m Normal AddedInterface pod/payload-processing-7bb9489676-246k6 Add eth0 [10.132.0.57/23] from ovn-kubernetes 11m Normal Pulling pod/payload-pre-processing-7b98bb678c-sdjbp Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 11m Normal AddedInterface pod/payload-pre-processing-7b98bb678c-sdjbp Add eth0 [10.132.0.56/23] from ovn-kubernetes 11m Normal Started pod/payload-processing-7bb9489676-246k6 Container started 11m Normal Created pod/payload-processing-7bb9489676-246k6 Container created 11m Normal Pulled pod/payload-processing-7bb9489676-246k6 Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.804s (2.804s including waiting). Image size: 125353963 bytes. 11m Normal Started pod/payload-pre-processing-7b98bb678c-sdjbp Container started 11m Normal Created pod/payload-pre-processing-7b98bb678c-sdjbp Container created 11m Normal Pulled pod/payload-pre-processing-7b98bb678c-sdjbp Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.781s (2.781s including waiting). Image size: 125353963 bytes. 10m Normal AddedLabel gateway/e2e-worker-w4-856c68 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-856c68 10m Normal AddedLabel gateway/e2e-worker-w2-db31ef Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w2-db31ef 10m Normal AddedLabel gateway/e2e-worker-w6-18990c Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w6-18990c 10m Normal AddedLabel gateway/e2e-worker-w5-6b62c0 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w5-6b62c0 10m Normal AddedLabel gateway/e2e-worker-w0-f38f69 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-f38f69 10m Normal AddedLabel gateway/e2e-worker-w3-32f7d6 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-32f7d6 10m Normal AddedLabel gateway/e2e-worker-w1-356418 Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w1-356418 10m Normal SuccessfulCreate replicaset/e2e-worker-w4-856c68-openshift-default-9478c7f8f Created pod: e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w 10m Normal ScalingReplicaSet deployment/e2e-worker-w4-856c68-openshift-default Scaled up replica set e2e-worker-w4-856c68-openshift-default-9478c7f8f from 0 to 1 10m Normal ScalingReplicaSet deployment/e2e-worker-w6-18990c-openshift-default Scaled up replica set e2e-worker-w6-18990c-openshift-default-9c9fd4749 from 0 to 1 10m Normal SuccessfulCreate replicaset/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7 Created pod: e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p 10m Normal ScalingReplicaSet deployment/e2e-worker-w0-f38f69-openshift-default Scaled up replica set e2e-worker-w0-f38f69-openshift-default-57c9476b85 from 0 to 1 10m Normal ScalingReplicaSet deployment/e2e-worker-w3-32f7d6-openshift-default Scaled up replica set e2e-worker-w3-32f7d6-openshift-default-5c969f77b7 from 0 to 1 10m Normal AddedInterface pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w Add eth0 [10.133.0.37/23] from ovn-kubernetes 10m Normal SuccessfulCreate replicaset/e2e-worker-w0-f38f69-openshift-default-57c9476b85 Created pod: e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt 10m Normal SuccessfulCreate replicaset/e2e-worker-w6-18990c-openshift-default-9c9fd4749 Created pod: e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 10m Normal AddedInterface pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 Add eth0 [10.132.0.60/23] from ovn-kubernetes 10m Normal ScalingReplicaSet deployment/e2e-worker-w5-6b62c0-openshift-default Scaled up replica set e2e-worker-w5-6b62c0-openshift-default-57f8677f85 from 0 to 1 10m Normal AddedInterface pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p Add eth0 [10.133.0.38/23] from ovn-kubernetes 10m Normal ScalingReplicaSet deployment/e2e-worker-w1-356418-openshift-default Scaled up replica set e2e-worker-w1-356418-openshift-default-584dc77f5c from 0 to 1 10m Normal AddedInterface pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt Add eth0 [10.132.0.59/23] from ovn-kubernetes 10m Normal AddedInterface pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h Add eth0 [10.132.0.61/23] from ovn-kubernetes 10m Normal SuccessfulCreate replicaset/e2e-worker-w1-356418-openshift-default-584dc77f5c Created pod: e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd 10m Normal SuccessfulCreate replicaset/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf Created pod: e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h 10m Normal ScalingReplicaSet deployment/e2e-worker-w2-db31ef-openshift-default Scaled up replica set e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf from 0 to 1 10m Normal SuccessfulCreate replicaset/e2e-worker-w5-6b62c0-openshift-default-57f8677f85 Created pod: e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt 10m Normal AddedInterface pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt Add eth0 [10.132.0.62/23] from ovn-kubernetes 10m Normal AddedInterface pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd Add eth0 [10.133.0.39/23] from ovn-kubernetes 10m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w4-856c68 Scaled up replica set payload-processing-e2e-worker-w4-856c68-766b6c566b from 0 to 1 10m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w4-856c68 Scaled up replica set payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55 from 0 to 1 10m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w4-856c68-766b6c566b Created pod: payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5 10m Warning FailedCreate replicaset/payload-processing-e2e-worker-w4-856c68-766b6c566b Error creating: pods "payload-processing-e2e-worker-w4-856c68-766b6c566b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-856c68: serviceaccount "payload-processing-e2e-worker-w4-856c68" not found 10m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55 Created pod: payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5 10m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55 Error creating: pods "payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-856c68: serviceaccount "payload-processing-e2e-worker-w4-856c68" not found 10m Normal Created pod/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5 Container created 10m Normal Started pod/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5 Container started 10m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5 Add eth0 [10.132.0.63/23] from ovn-kubernetes 10m Normal Pulled pod/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 10m Normal AddedInterface pod/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5 Add eth0 [10.132.0.64/23] from ovn-kubernetes 10m Normal Started pod/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5 Container started 10m Normal Created pod/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5 Container created 10m Normal Pulled pod/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 10m Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w0-f38f69 Scaled up replica set payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f from 0 to 1 10m Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w0-f38f69 Scaled up replica set payload-processing-e2e-worker-w0-f38f69-ff6644f46 from 0 to 1 10m Warning FailedCreate replicaset/payload-processing-e2e-worker-w0-f38f69-ff6644f46 Error creating: pods "payload-processing-e2e-worker-w0-f38f69-ff6644f46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f38f69: serviceaccount "payload-processing-e2e-worker-w0-f38f69" not found 10m Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f Error creating: pods "payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f38f69: serviceaccount "payload-processing-e2e-worker-w0-f38f69" not found 10m Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w0-f38f69-ff6644f46 Created pod: payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z 10m Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f Created pod: payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf 10m Normal Pulling pod/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 10m Normal AddedInterface pod/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf Add eth0 [10.133.0.40/23] from ovn-kubernetes 10m Normal AddedInterface pod/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z Add eth0 [10.133.0.41/23] from ovn-kubernetes 10m Normal Pulling pod/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" 9m59s Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w3-32f7d6 Scaled up replica set payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6 from 0 to 1 9m59s Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67 Error creating: pods "payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-32f7d6: serviceaccount "payload-processing-e2e-worker-w3-32f7d6" not found 9m59s Warning FailedCreate replicaset/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6 Error creating: pods "payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-32f7d6: serviceaccount "payload-processing-e2e-worker-w3-32f7d6" not found 9m59s Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w3-32f7d6 Scaled up replica set payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67 from 0 to 1 9m58s Normal Pulled pod/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 9m58s Normal AddedInterface pod/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct Add eth0 [10.132.0.66/23] from ovn-kubernetes 9m58s Normal Created pod/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw Container created 9m58s Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67 Created pod: payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw 9m58s Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6 Created pod: payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct 9m58s Normal AddedInterface pod/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw Add eth0 [10.132.0.65/23] from ovn-kubernetes 9m58s Normal Pulled pod/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 3.003s (3.003s including waiting). Image size: 125353963 bytes. 9m58s Normal Started pod/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct Container started 9m58s Normal Pulled pod/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.867s (2.867s including waiting). Image size: 125353963 bytes. 9m58s Normal Created pod/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct Container created 9m58s Normal Pulled pod/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 9m58s Normal Started pod/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw Container started 9m57s Normal Created pod/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf Container created 9m57s Normal Started pod/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z Container started 9m57s Normal Created pod/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z Container created 9m57s Normal Started pod/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf Container started 9m51s Warning FailedCreate replicaset/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d Error creating: pods "payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w6-18990c: serviceaccount "payload-processing-e2e-worker-w6-18990c" not found 9m51s Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff Error creating: pods "payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w6-18990c: serviceaccount "payload-processing-e2e-worker-w6-18990c" not found 9m51s Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w6-18990c Scaled up replica set payload-processing-e2e-worker-w6-18990c-65ddf9cb7d from 0 to 1 9m51s Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff Created pod: payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq 9m51s Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w6-18990c Scaled up replica set payload-pre-processing-e2e-worker-w6-18990c-697756f7ff from 0 to 1 9m50s Normal Created pod/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq Container created 9m50s Normal Pulled pod/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 9m50s Normal Started pod/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg Container started 9m50s Normal Started pod/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq Container started 9m50s Normal Created pod/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg Container created 9m50s Normal Pulled pod/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 9m50s Normal AddedInterface pod/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq Add eth0 [10.132.0.67/23] from ovn-kubernetes 9m50s Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d Created pod: payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg 9m50s Normal AddedInterface pod/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg Add eth0 [10.132.0.68/23] from ovn-kubernetes 9m48s Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95 Created pod: payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t 9m48s Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w1-356418-55c48df78b Created pod: payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2 9m48s Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w1-356418 Scaled up replica set payload-processing-e2e-worker-w1-356418-55c48df78b from 0 to 1 9m48s Warning FailedCreate replicaset/payload-processing-e2e-worker-w1-356418-55c48df78b Error creating: pods "payload-processing-e2e-worker-w1-356418-55c48df78b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-356418: serviceaccount "payload-processing-e2e-worker-w1-356418" not found 9m48s Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w1-356418 Scaled up replica set payload-pre-processing-e2e-worker-w1-356418-5bbd76db95 from 0 to 1 9m48s Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95 Error creating: pods "payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w1-356418: serviceaccount "payload-processing-e2e-worker-w1-356418" not found 9m47s Normal Pulled pod/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2 Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 9m47s Normal Started pod/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2 Container started 9m47s Normal Started pod/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t Container started 9m47s Normal Created pod/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2 Container created 9m47s Normal Created pod/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t Container created 9m47s Normal AddedInterface pod/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2 Add eth0 [10.132.0.70/23] from ovn-kubernetes 9m47s Normal Pulled pod/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 9m47s Normal AddedInterface pod/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t Add eth0 [10.132.0.69/23] from ovn-kubernetes 9m46s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w4-856c68-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 9m46s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w4-856c68-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 9m43s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w Readiness probe error: Get "http://10.133.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 9m43s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w Readiness probe failed: Get "http://10.133.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 9m43s Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w5-6b62c0 Scaled up replica set payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd from 0 to 1 9m43s Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w5-6b62c0 Scaled up replica set payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f from 0 to 1 9m42s Normal AddedInterface pod/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg Add eth0 [10.133.0.45/23] from ovn-kubernetes 9m42s Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f Error creating: pods "payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-6b62c0: serviceaccount "payload-processing-e2e-worker-w5-6b62c0" not found 9m42s Warning FailedCreate replicaset/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd Error creating: pods "payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-6b62c0: serviceaccount "payload-processing-e2e-worker-w5-6b62c0" not found 9m42s Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd Created pod: payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg 9m42s Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f Created pod: payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv 9m41s Normal Created pod/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg Container created 9m41s Normal Pulled pod/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 9m41s Normal Started pod/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv Container started 9m41s Normal Created pod/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv Container created 9m41s Normal Started pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w Container started 9m41s Normal Pulled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 9m41s Normal Created pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w Container created 9m41s Normal Pulled pod/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 9m41s Normal AddedInterface pod/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv Add eth0 [10.132.0.71/23] from ovn-kubernetes 9m41s Normal Started pod/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg Container started 9m40s Normal ScalingReplicaSet deployment/payload-pre-processing-e2e-worker-w2-db31ef Scaled up replica set payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c from 0 to 1 9m40s Normal ScalingReplicaSet deployment/payload-processing-e2e-worker-w2-db31ef Scaled up replica set payload-processing-e2e-worker-w2-db31ef-fb6945556 from 0 to 1 9m40s Warning FailedCreate replicaset/payload-processing-e2e-worker-w2-db31ef-fb6945556 Error creating: pods "payload-processing-e2e-worker-w2-db31ef-fb6945556-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-db31ef: serviceaccount "payload-processing-e2e-worker-w2-db31ef" not found 9m40s Warning FailedCreate replicaset/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c Error creating: pods "payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w2-db31ef: serviceaccount "payload-processing-e2e-worker-w2-db31ef" not found 9m39s Normal SuccessfulCreate replicaset/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c Created pod: payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd 9m39s Normal SuccessfulCreate replicaset/payload-processing-e2e-worker-w2-db31ef-fb6945556 Created pod: payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n 9m39s Normal AddedInterface pod/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd Add eth0 [10.132.0.72/23] from ovn-kubernetes 9m38s Normal Started pod/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n Container started 9m38s Normal Pulled pod/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 9m38s Normal Created pod/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd Container created 9m38s Normal Started pod/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd Container started 9m38s Normal AddedInterface pod/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n Add eth0 [10.132.0.73/23] from ovn-kubernetes 9m38s Normal Pulled pod/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n Container image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" already present on machine and can be accessed by the pod 9m38s Normal Created pod/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n Container created 9m35s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused... 9m35s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused 9m31s Normal Started pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt Container started 9m31s Normal Pulled pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 9m31s Normal Created pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt Container created 9m31s Normal ScalingReplicaSet deployment/e2e-worker-w0-f38f69-openshift-default Scaled up replica set e2e-worker-w0-f38f69-openshift-default-57c9476b85 from 1 to 4 9m31s Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-f38f69-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 9m31s Normal Pulled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 9m31s Normal Created pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h Container created 9m31s Normal SuccessfulCreate replicaset/e2e-worker-w0-f38f69-openshift-default-57c9476b85 Created pod: e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 9m31s Normal SuccessfulCreate replicaset/e2e-worker-w0-f38f69-openshift-default-57c9476b85 Created pod: e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq 9m31s Normal SuccessfulCreate replicaset/e2e-worker-w0-f38f69-openshift-default-57c9476b85 Created pod: e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 9m31s Normal Started pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h Container started 9m30s Normal Created pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 Container created 9m30s Normal AddedInterface pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 Add eth0 [10.133.0.47/23] from ovn-kubernetes 9m30s Normal Started pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq Container started 9m30s Normal Started pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 Container started 9m30s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w2-db31ef-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 9m30s Normal Pulled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 9m30s Normal AddedInterface pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq Add eth0 [10.134.0.41/23] from ovn-kubernetes 9m30s Normal Created pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 Container created 9m30s Normal AddedInterface pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 Add eth0 [10.132.0.74/23] from ovn-kubernetes 9m30s Normal Created pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq Container created 9m30s Normal Started pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 Container started 9m30s Normal Pulled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 9m30s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w2-db31ef-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 9m30s Normal Pulled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 9m25s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused... 9m25s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused 9m25s Warning Unhealthy pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused 9m25s Warning ProbeError pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused... 9m24s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused 9m24s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused... 9m24s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused... 9m24s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused 9m23s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused... 9m23s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused 9m19s Normal Created pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p Container created 9m19s Normal Pulled pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 9m19s Normal Started pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p Container started 9m16s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w4-856c68-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 9m16s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w0-f38f69-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 9m16s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w4-856c68-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 9m16s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w0-f38f69-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 9m15s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w3-32f7d6-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 9m15s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w3-32f7d6-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 9m13s Warning Unhealthy pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused 9m13s Warning ProbeError pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused... 9m7s Normal Pulled pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 9m7s Normal Created pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd Container created 9m7s Normal Started pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd Container started 9m7s Normal Started pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 Container started 9m7s Normal Created pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 Container created 9m7s Normal Pulled pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 9m1s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w0-f38f69-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 9m1s Warning Unhealthy pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused 9m1s Warning ProbeError pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused... 9m1s Warning Unhealthy pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused 9m1s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w0-f38f69-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 9m1s Warning ProbeError pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused... 9m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w6-18990c-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 9m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w2-db31ef-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 9m Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w2-db31ef-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 9m Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w6-18990c-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 8m56s Warning ProbeError pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)... 8m56s Warning Unhealthy pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 8m55s Normal Pulled pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 8m55s Normal Created pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt Container created 8m55s Normal Started pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt Container started 8m50s Warning Unhealthy pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused 8m50s Warning ProbeError pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused... 8m45s Normal Pulled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 8m45s Normal AddedInterface pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q Add eth0 [10.133.0.48/23] from ovn-kubernetes 8m45s Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-f38f69-openshift-default New size: 5; reason: All metrics below target 8m45s Normal Created pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q Container created 8m45s Normal Started pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q Container started 8m45s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w3-32f7d6-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 8m45s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w6-18990c-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 8m45s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w3-32f7d6-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 8m45s Normal ScalingReplicaSet deployment/e2e-worker-w0-f38f69-openshift-default Scaled up replica set e2e-worker-w0-f38f69-openshift-default-57c9476b85 from 4 to 5 8m45s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w6-18990c-openshift-default failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) 8m45s Normal SuccessfulCreate replicaset/e2e-worker-w0-f38f69-openshift-default-57c9476b85 Created pod: e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q 8m39s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused 8m39s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused... 8m29s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w5-6b62c0-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 8m29s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w5-6b62c0-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 8m29s Warning FailedComputeMetricsReplicas horizontalpodautoscaler/e2e-worker-w1-356418-openshift-default invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 8m29s Warning FailedGetResourceMetric horizontalpodautoscaler/e2e-worker-w1-356418-openshift-default failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API 7m30s Normal SuccessfulCreate replicaset/e2e-worker-w4-856c68-openshift-default-9478c7f8f Created pod: e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx 7m30s Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-856c68-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 7m30s Normal ScalingReplicaSet deployment/e2e-worker-w4-856c68-openshift-default Scaled up replica set e2e-worker-w4-856c68-openshift-default-9478c7f8f from 1 to 2 7m29s Normal Pulled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 7m29s Normal AddedInterface pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx Add eth0 [10.132.0.77/23] from ovn-kubernetes 7m29s Normal Created pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx Container created 7m29s Normal Started pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx Container started 7m23s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused... 7m23s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused 5m45s Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-6886b96f9 Deleted pod: maas-default-gateway-openshift-default-6886b96f9-9lc9f 5m45s Normal Killing pod/maas-default-gateway-openshift-default-6886b96f9-9lc9f Stopping container istio-proxy 5m45s Normal Killing pod/maas-default-gateway-openshift-default-6886b96f9-6v285 Stopping container istio-proxy 5m45s Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-6886b96f9 from 6 to 4 5m45s Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 4; reason: All metrics below target 5m45s Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-6886b96f9 Deleted pod: maas-default-gateway-openshift-default-6886b96f9-6v285 5m43s Normal SuccessfulCreate replicaset/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf Created pod: e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 5m43s Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-db31ef-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 5m43s Normal ScalingReplicaSet deployment/e2e-worker-w2-db31ef-openshift-default Scaled up replica set e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf from 1 to 2 5m42s Normal Started pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 Container started 5m42s Normal Created pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 Container created 5m42s Normal Pulled pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 5m42s Normal AddedInterface pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 Add eth0 [10.133.0.54/23] from ovn-kubernetes 5m37s Warning Unhealthy pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused 5m37s Warning ProbeError pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused... 5m13s Normal ScalingReplicaSet deployment/e2e-worker-w3-32f7d6-openshift-default Scaled up replica set e2e-worker-w3-32f7d6-openshift-default-5c969f77b7 from 1 to 2 5m13s Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w3-32f7d6-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 5m13s Normal SuccessfulCreate replicaset/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7 Created pod: e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk 5m12s Normal Started pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk Container started 5m12s Normal Created pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk Container created 5m12s Normal Pulled pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 5m12s Normal AddedInterface pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk Add eth0 [10.132.0.80/23] from ovn-kubernetes 5m6s Warning Unhealthy pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused 5m6s Warning ProbeError pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused... 4m44s Normal SuccessfulCreate replicaset/e2e-worker-w4-856c68-openshift-default-9478c7f8f Created pod: e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb 4m44s Normal SuccessfulCreate replicaset/e2e-worker-w4-856c68-openshift-default-9478c7f8f Created pod: e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt 4m44s Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-856c68-openshift-default New size: 4; reason: cpu resource utilization (percentage of request) above target 4m44s Normal ScalingReplicaSet deployment/e2e-worker-w4-856c68-openshift-default Scaled up replica set e2e-worker-w4-856c68-openshift-default-9478c7f8f from 2 to 4 4m43s Normal Pulled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 4m43s Normal AddedInterface pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt Add eth0 [10.132.0.85/23] from ovn-kubernetes 4m43s Normal Created pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb Container created 4m43s Normal Started pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb Container started 4m43s Normal Created pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt Container created 4m43s Normal Started pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt Container started 4m43s Normal AddedInterface pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb Add eth0 [10.134.0.52/23] from ovn-kubernetes 4m43s Normal Pulled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 4m37s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused... 4m37s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused 4m36s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused 4m36s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused... 4m32s Normal Killing pod/payload-pre-processing-e2e-worker-w3-32f7d6-779c499b67-rbpgw Stopping container payload-pre-processing 4m32s Normal Killing pod/payload-processing-e2e-worker-w3-32f7d6-6c4c586dc6-7hwct Stopping container payload-processing 4m29s Normal Killing pod/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq Stopping container payload-pre-processing 4m29s Normal Killing pod/payload-processing-e2e-worker-w6-18990c-65ddf9cb7d-59pcg Stopping container payload-processing 4m26s Normal Killing pod/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv Stopping container payload-pre-processing 4m26s Normal Killing pod/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg Stopping container payload-processing 4m23s Normal Killing pod/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2 Stopping container payload-processing 4m23s Normal Killing pod/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t Stopping container payload-pre-processing 4m15s Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 3; reason: All metrics below target 4m14s Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-6886b96f9 Deleted pod: maas-default-gateway-openshift-default-6886b96f9-79hwm 4m14s Normal Killing pod/maas-default-gateway-openshift-default-6886b96f9-79hwm Stopping container istio-proxy 4m14s Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-6886b96f9 from 4 to 3 4m12s Normal SuccessfulCreate replicaset/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf Created pod: e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj 4m12s Normal ScalingReplicaSet deployment/e2e-worker-w2-db31ef-openshift-default Scaled up replica set e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf from 2 to 3 4m12s Normal AddedInterface pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj Add eth0 [10.134.0.53/23] from ovn-kubernetes 4m12s Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-db31ef-openshift-default New size: 3; reason: cpu resource utilization (percentage of request) above target 4m11s Normal Started pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr Container started 4m11s Normal Created pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr Container created 4m11s Normal AddedInterface pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr Add eth0 [10.132.0.90/23] from ovn-kubernetes 4m11s Normal Started pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj Container started 4m11s Normal SuccessfulCreate replicaset/e2e-worker-w1-356418-openshift-default-584dc77f5c Created pod: e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr 4m11s Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w1-356418-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 4m11s Normal Created pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj Container created 4m11s Normal Pulled pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 4m11s Normal ScalingReplicaSet deployment/e2e-worker-w1-356418-openshift-default Scaled up replica set e2e-worker-w1-356418-openshift-default-584dc77f5c from 1 to 2 4m11s Normal Pulled pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 4m10s Warning Unhealthy pod/payload-processing-e2e-worker-w5-6b62c0-5dc77c55cd-72qtg Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 4m10s Warning Unhealthy pod/payload-pre-processing-e2e-worker-w5-6b62c0-67575c7d5f-wwgbv Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 4m8s Warning Unhealthy pod/payload-pre-processing-e2e-worker-w6-18990c-697756f7ff-h6xjq Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 4m5s Normal Killing pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-fsf4p Stopping container istio-proxy 4m5s Warning Unhealthy pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused 4m5s Normal Killing pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk Stopping container istio-proxy 4m5s Warning Unhealthy pod/payload-processing-e2e-worker-w1-356418-55c48df78b-ntmq2 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 4m5s Warning Unhealthy pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk Readiness probe failed: HTTP probe failed with statuscode: 503 4m5s Warning ProbeError pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused... 4m5s Warning ProbeError pod/e2e-worker-w3-32f7d6-openshift-default-5c969f77b7-lzrmk Readiness probe error: HTTP probe failed with statuscode: 503... 4m5s Warning Unhealthy pod/payload-pre-processing-e2e-worker-w1-356418-5bbd76db95-hdw6t Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 4m4s Warning ProbeError pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused... 4m4s Warning Unhealthy pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused 4m2s Normal Killing pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 Stopping container istio-proxy 4m Warning ProbeError pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 Readiness probe error: HTTP probe failed with statuscode: 503... 4m Warning Unhealthy pod/e2e-worker-w6-18990c-openshift-default-9c9fd4749-hw8v6 Readiness probe failed: HTTP probe failed with statuscode: 503 3m59s Normal Killing pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-dqkzr Stopping container istio-proxy 3m59s Normal Killing pod/e2e-worker-w1-356418-openshift-default-584dc77f5c-pmvnd Stopping container istio-proxy 3m57s Normal SuccessfulCreate replicaset/e2e-worker-w5-6b62c0-openshift-default-57f8677f85 Created pod: e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb 3m57s Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w5-6b62c0-openshift-default New size: 2; reason: cpu resource utilization (percentage of request) above target 3m57s Normal ScalingReplicaSet deployment/e2e-worker-w5-6b62c0-openshift-default Scaled up replica set e2e-worker-w5-6b62c0-openshift-default-57f8677f85 from 1 to 2 3m56s Normal Created pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb Container created 3m56s Normal AddedInterface pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb Add eth0 [10.133.0.58/23] from ovn-kubernetes 3m56s Normal Pulled pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 3m56s Normal Started pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb Container started 3m51s Normal Killing pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb Stopping container istio-proxy 3m51s Warning ProbeError pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused... 3m51s Normal Killing pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt Stopping container istio-proxy 3m51s Warning Unhealthy pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-9sbnb Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused 3m49s Warning ProbeError pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt Readiness probe error: HTTP probe failed with statuscode: 503... 3m49s Warning Unhealthy pod/e2e-worker-w5-6b62c0-openshift-default-57f8677f85-tvldt Readiness probe failed: HTTP probe failed with statuscode: 503 3m44s Normal SuccessfulRescale horizontalpodautoscaler/maas-default-gateway-openshift-default New size: 2; reason: All metrics below target 3m44s Normal SuccessfulDelete replicaset/maas-default-gateway-openshift-default-6886b96f9 Deleted pod: maas-default-gateway-openshift-default-6886b96f9-gs6m9 3m44s Normal Killing pod/maas-default-gateway-openshift-default-6886b96f9-gs6m9 Stopping container istio-proxy 3m44s Normal ScalingReplicaSet deployment/maas-default-gateway-openshift-default Scaled down replica set maas-default-gateway-openshift-default-6886b96f9 from 3 to 2 3m28s Normal SuccessfulCreate replicaset/e2e-worker-w4-856c68-openshift-default-9478c7f8f Created pod: e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m 3m28s Normal AddedInterface pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m Add eth0 [10.133.0.60/23] from ovn-kubernetes 3m28s Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-856c68-openshift-default New size: 6; reason: cpu resource utilization (percentage of request) above target 3m28s Normal ScalingReplicaSet deployment/e2e-worker-w4-856c68-openshift-default Scaled up replica set e2e-worker-w4-856c68-openshift-default-9478c7f8f from 4 to 6 3m28s Normal AddedInterface pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd Add eth0 [10.134.0.54/23] from ovn-kubernetes 3m28s Normal SuccessfulCreate replicaset/e2e-worker-w4-856c68-openshift-default-9478c7f8f Created pod: e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd 3m27s Normal Started pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m Container started 3m27s Normal Created pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd Container created 3m27s Normal Started pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd Container started 3m27s Normal Created pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m Container created 3m27s Normal Pulled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 3m27s Normal Pulled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 3m21s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused 3m21s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused... 3m21s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused... 3m21s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused 3m12s Normal Killing pod/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5 Stopping container payload-processing 3m12s Normal Killing pod/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5 Stopping container payload-pre-processing 2m58s Normal SuccessfulCreate replicaset/e2e-worker-w0-f38f69-openshift-default-57c9476b85 Created pod: e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz 2m58s Normal SuccessfulCreate replicaset/e2e-worker-w0-f38f69-openshift-default-57c9476b85 Created pod: e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 2m58s Normal SuccessfulCreate replicaset/e2e-worker-w0-f38f69-openshift-default-57c9476b85 Created pod: e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m 2m58s Normal SuccessfulCreate replicaset/e2e-worker-w0-f38f69-openshift-default-57c9476b85 Created pod: e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk 2m58s Normal SuccessfulCreate replicaset/e2e-worker-w0-f38f69-openshift-default-57c9476b85 (combined from similar events): Created pod: e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 2m58s Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w0-f38f69-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 2m58s Normal ScalingReplicaSet deployment/e2e-worker-w0-f38f69-openshift-default Scaled up replica set e2e-worker-w0-f38f69-openshift-default-57c9476b85 from 5 to 10 2m57s Normal Created pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz Container created 2m57s Normal Started pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 Container started 2m57s Normal Started pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz Container started 2m57s Normal Created pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 Container created 2m57s Normal AddedInterface pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk Add eth0 [10.132.0.96/23] from ovn-kubernetes 2m57s Normal Started pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk Container started 2m57s Normal Created pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk Container created 2m57s Normal AddedInterface pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 Add eth0 [10.134.0.56/23] from ovn-kubernetes 2m57s Normal Pulled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 2m57s Normal AddedInterface pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m Add eth0 [10.133.0.61/23] from ovn-kubernetes 2m57s Normal Pulled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 2m57s Normal Pulled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 2m57s Normal Pulled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 2m57s Normal Created pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m Container created 2m57s Normal Started pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m Container started 2m57s Normal AddedInterface pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz Add eth0 [10.132.0.95/23] from ovn-kubernetes 2m57s Normal Pulled pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 2m57s Normal AddedInterface pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 Add eth0 [10.134.0.55/23] from ovn-kubernetes 2m56s Normal Started pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 Container started 2m56s Normal Created pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 Container created 2m54s Warning Unhealthy pod/payload-processing-e2e-worker-w4-856c68-766b6c566b-m99c5 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 2m54s Warning Unhealthy pod/payload-pre-processing-e2e-worker-w4-856c68-58dd5c8d55-8p8x5 Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 2m50s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused 2m50s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused... 2m50s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused 2m50s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused 2m50s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused... 2m50s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused 2m50s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused 2m50s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused... 2m50s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused... 2m50s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused... 2m43s Normal SuccessfulCreate replicaset/e2e-worker-w4-856c68-openshift-default-9478c7f8f Created pod: e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4 2m43s Normal SuccessfulCreate replicaset/e2e-worker-w4-856c68-openshift-default-9478c7f8f Created pod: e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m 2m43s Normal SuccessfulCreate replicaset/e2e-worker-w4-856c68-openshift-default-9478c7f8f Created pod: e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt 2m43s Normal SuccessfulCreate replicaset/e2e-worker-w4-856c68-openshift-default-9478c7f8f (combined from similar events): Created pod: e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg 2m43s Normal ScalingReplicaSet deployment/e2e-worker-w4-856c68-openshift-default Scaled up replica set e2e-worker-w4-856c68-openshift-default-9478c7f8f from 6 to 10 2m43s Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w4-856c68-openshift-default New size: 10; reason: cpu resource utilization (percentage of request) above target 2m42s Normal AddedInterface pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4 Add eth0 [10.133.0.62/23] from ovn-kubernetes 2m42s Normal Started pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg Container started 2m42s Normal Created pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt Container created 2m42s Normal Created pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4 Container created 2m42s Normal Started pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4 Container started 2m42s Normal AddedInterface pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg Add eth0 [10.132.0.98/23] from ovn-kubernetes 2m42s Normal Pulled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 2m42s Normal Pulled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4 Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 2m42s Normal Created pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg Container created 2m42s Normal Started pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m Container started 2m42s Normal Created pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m Container created 2m42s Normal Pulled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 2m42s Normal AddedInterface pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m Add eth0 [10.132.0.97/23] from ovn-kubernetes 2m42s Normal Started pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt Container started 2m42s Normal AddedInterface pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt Add eth0 [10.134.0.57/23] from ovn-kubernetes 2m42s Normal Pulled pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 2m38s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4 Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused... 2m38s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4 Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused 2m38s Normal Killing pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m Stopping container istio-proxy 2m38s Normal Killing pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m Stopping container istio-proxy 2m38s Normal Killing pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb Stopping container istio-proxy 2m38s Normal Killing pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w Stopping container istio-proxy 2m38s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused 2m38s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused... 2m38s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused... 2m38s Normal Killing pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-twnq4 Stopping container istio-proxy 2m38s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused... 2m38s Normal Killing pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-82swt Stopping container istio-proxy 2m38s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused 2m38s Normal Killing pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-wlnsg Stopping container istio-proxy 2m38s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rnd6m Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused 2m38s Normal Killing pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt Stopping container istio-proxy 2m38s Normal Killing pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd Stopping container istio-proxy 2m38s Normal Killing pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx Stopping container istio-proxy 2m37s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx Readiness probe error: HTTP probe failed with statuscode: 503... 2m37s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-gfgpx Readiness probe failed: HTTP probe failed with statuscode: 503 2m36s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb Readiness probe error: HTTP probe failed with statuscode: 503... 2m36s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-jfmxb Readiness probe failed: HTTP probe failed with statuscode: 503 2m35s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd Readiness probe failed: HTTP probe failed with statuscode: 503 2m35s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m Readiness probe error: HTTP probe failed with statuscode: 503... 2m35s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-zn49m Readiness probe failed: HTTP probe failed with statuscode: 503 2m35s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-fbvfd Readiness probe error: HTTP probe failed with statuscode: 503... 2m35s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt Readiness probe error: HTTP probe failed with statuscode: 503... 2m35s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-sgwlt Readiness probe failed: HTTP probe failed with statuscode: 503 2m34s Warning ProbeError pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w Readiness probe error: HTTP probe failed with statuscode: 503... 2m34s Warning Unhealthy pod/e2e-worker-w4-856c68-openshift-default-9478c7f8f-rdz8w Readiness probe failed: HTTP probe failed with statuscode: 503 2m16s Normal Killing pod/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf Stopping container payload-pre-processing 2m16s Normal Killing pod/payload-processing-e2e-worker-w0-f38f69-ff6644f46-zx67z Stopping container payload-processing 2m13s Normal Killing pod/payload-pre-processing-e2e-worker-w2-db31ef-5749b7848c-gkqtd Stopping container payload-pre-processing 2m13s Normal Killing pod/payload-processing-e2e-worker-w2-db31ef-fb6945556-mcg2n Stopping container payload-processing 2m11s Normal SuccessfulCreate replicaset/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf Created pod: e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb 2m11s Normal SuccessfulCreate replicaset/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf Created pod: e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc 2m11s Normal SuccessfulRescale horizontalpodautoscaler/e2e-worker-w2-db31ef-openshift-default New size: 5; reason: cpu resource utilization (percentage of request) above target 2m11s Normal AddedInterface pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc Add eth0 [10.133.0.63/23] from ovn-kubernetes 2m11s Normal ScalingReplicaSet deployment/e2e-worker-w2-db31ef-openshift-default Scaled up replica set e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf from 3 to 5 2m10s Normal Pulled pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 2m10s Normal Created pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb Container created 2m10s Normal Created pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc Container created 2m10s Normal AddedInterface pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb Add eth0 [10.132.0.103/23] from ovn-kubernetes 2m10s Normal Pulled pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod 2m10s Normal Started pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb Container started 2m10s Normal Started pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc Container started 2m4s Warning ProbeError pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused... 2m4s Warning Unhealthy pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused 2m3s Warning Unhealthy pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb Startup probe failed: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused 2m3s Warning ProbeError pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb Startup probe error: Get "http://10.132.0.103:15021/healthz/ready": dial tcp 10.132.0.103:15021: connect: connection refused... 116s Warning Unhealthy pod/payload-pre-processing-e2e-worker-w0-f38f69-5df8d94c5f-72cpf Readiness probe failed: service unhealthy (responded with "NOT_SERVING") 115s Normal Killing pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-g5wj9 Stopping container istio-proxy 115s Normal Killing pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-4wgmz Stopping container istio-proxy 115s Normal Killing pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q Stopping container istio-proxy 115s Normal Killing pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq Stopping container istio-proxy 115s Normal Killing pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-9t88m Stopping container istio-proxy 115s Normal Killing pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 Stopping container istio-proxy 115s Normal Killing pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt Stopping container istio-proxy 115s Normal Killing pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-8nq47 Stopping container istio-proxy 115s Normal Killing pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-gtvfk Stopping container istio-proxy 115s Normal Killing pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 Stopping container istio-proxy 114s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt Readiness probe failed: HTTP probe failed with statuscode: 503 114s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-mp7vt Readiness probe error: HTTP probe failed with statuscode: 503... 113s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq Readiness probe error: HTTP probe failed with statuscode: 503... 113s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 Readiness probe error: HTTP probe failed with statuscode: 503... 113s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-87ft2 Readiness probe failed: HTTP probe failed with statuscode: 503 113s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q Readiness probe failed: HTTP probe failed with statuscode: 503 113s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-wwt8q Readiness probe error: HTTP probe failed with statuscode: 503... 113s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-v8bvq Readiness probe failed: HTTP probe failed with statuscode: 503 112s Warning Unhealthy pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 Readiness probe failed: HTTP probe failed with statuscode: 503 112s Warning ProbeError pod/e2e-worker-w0-f38f69-openshift-default-57c9476b85-nkcz6 Readiness probe error: HTTP probe failed with statuscode: 503... 106s Normal Killing pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-r9pfb Stopping container istio-proxy 106s Normal Killing pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-f96n2 Stopping container istio-proxy 106s Normal Killing pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-xwzqc Stopping container istio-proxy 106s Normal Killing pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zsk7h Stopping container istio-proxy 106s Normal Killing pod/e2e-worker-w2-db31ef-openshift-default-5fd5dc7bcf-zxdpj Stopping container istio-proxy