Events

Time	Namespace	Component	RelatedObject	Reason	Message
00:52:58	openshift-ingress		maas-default-gateway-openshift-default-9f5889779-2d4d4	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-2d4d4 to ip-10-0-140-36.ec2.internal
00:53:13	openshift-ingress		maas-default-gateway-openshift-default-9f5889779-dl6pw	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-dl6pw to ip-10-0-139-2.ec2.internal
00:49:08	openshift-ingress		data-science-gateway-data-science-gateway-class-7974757cbfz6tcg	Scheduled	Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-7974757cbfz6tcg to ip-10-0-138-215.ec2.internal
00:52:27	llm		echo-simulator-kserve-64b6f8f96c-7rfxq	Scheduled	Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-7rfxq to ip-10-0-140-36.ec2.internal
00:49:13	kuadrant-system		limitador-limitador-7c9b87d574-xg5gn	Scheduled	Successfully assigned kuadrant-system/limitador-limitador-7c9b87d574-xg5gn to ip-10-0-140-36.ec2.internal
00:49:02	kuadrant-system		kuadrant-operator-controller-manager-678d87766f-xdxfj	Scheduled	Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xdxfj to ip-10-0-138-215.ec2.internal
00:48:43	openshift-jobset-operator		jobset-operator-674cd59dc5-t9r44	Scheduled	Successfully assigned openshift-jobset-operator/jobset-operator-674cd59dc5-t9r44 to ip-10-0-140-36.ec2.internal
00:48:52	cert-manager		cert-manager-cainjector-5c57bbd4fc-gps6q	Scheduled	Successfully assigned cert-manager/cert-manager-cainjector-5c57bbd4fc-gps6q to ip-10-0-140-36.ec2.internal
00:52:26	llm		e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m87ct	Scheduled	Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m87ct to ip-10-0-139-2.ec2.internal
00:52:30	llm		facebook-opt-125m-simulated-kserve-84b4ff656c-hmwp9	Scheduled	Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-hmwp9 to ip-10-0-139-2.ec2.internal
00:49:09	kuadrant-system		limitador-operator-controller-manager-5778bb4449-wwgnp	Scheduled	Successfully assigned kuadrant-system/limitador-operator-controller-manager-5778bb4449-wwgnp to ip-10-0-138-215.ec2.internal
00:48:34	opendatahub-operator-system		opendatahub-operator-controller-manager-5cb755cd67-zmvfx	Scheduled	Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5cb755cd67-zmvfx to ip-10-0-138-215.ec2.internal
00:52:14	llm		e2e-distinct-2-simulated-kserve-cbd4f5586-xncfg	Scheduled	Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-xncfg to ip-10-0-140-36.ec2.internal
00:48:06	openshift-ingress		istiod-openshift-gateway-7876bfcb74-4b8kb	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-7876bfcb74-4b8kb to ip-10-0-139-2.ec2.internal
00:49:12	kuadrant-system		limitador-limitador-74dfcfb894-9s6jp	Scheduled	Successfully assigned kuadrant-system/limitador-limitador-74dfcfb894-9s6jp to ip-10-0-139-2.ec2.internal
00:48:34	opendatahub-operator-system		opendatahub-operator-controller-manager-5cb755cd67-xxm2q	Scheduled	Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5cb755cd67-xxm2q to ip-10-0-139-2.ec2.internal
00:48:51	cert-manager		cert-manager-webhook-5dbbbf75cc-dz8bc	Scheduled	Successfully assigned cert-manager/cert-manager-webhook-5dbbbf75cc-dz8bc to ip-10-0-140-36.ec2.internal
00:49:05	kuadrant-system		dns-operator-controller-manager-8557cbdb84-d2f5f	Scheduled	Successfully assigned kuadrant-system/dns-operator-controller-manager-8557cbdb84-d2f5f to ip-10-0-139-2.ec2.internal
00:50:12	openshift-ingress		istiod-openshift-gateway-7ddd9cfdc8-k8pcv	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k8pcv to ip-10-0-139-2.ec2.internal
00:52:22	llm		e2e-trlp-test-simulated-kserve-69b588897d-9chq6	Scheduled	Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-9chq6 to ip-10-0-140-36.ec2.internal
00:49:07	openshift-ingress		kube-auth-proxy-55b669d8cd-n2fht	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-55b669d8cd-n2fht to ip-10-0-139-2.ec2.internal
00:52:19	llm		e2e-distinct-simulated-kserve-7b998b79d9-m5ct6	Scheduled	Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-m5ct6 to ip-10-0-140-36.ec2.internal
00:44:56	openshift-ingress		router-default-d6f88c97f-qsxvw	Scheduled	Successfully assigned openshift-ingress/router-default-d6f88c97f-qsxvw to ip-10-0-138-215.ec2.internal
00:39:17	openshift-ingress		router-default-d6f88c97f-qsxvw	FailedScheduling	no nodes available to schedule pods
00:39:15	openshift-ingress		router-default-d6f88c97f-qsxvw	FailedScheduling	no nodes available to schedule pods
00:48:34	opendatahub-operator-system		opendatahub-operator-controller-manager-5cb755cd67-hqgkr	Scheduled	Successfully assigned opendatahub-operator-system/opendatahub-operator-controller-manager-5cb755cd67-hqgkr to ip-10-0-140-36.ec2.internal
00:50:00	opendatahub		usage-logs-tenancy-proxy-9c5d49bcd-jv5l8	Scheduled	Successfully assigned opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-jv5l8 to ip-10-0-140-36.ec2.internal
00:52:32	llm		premium-simulated-simulated-premium-kserve-5f5c4b459f-g6qgc	Scheduled	Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-g6qgc to ip-10-0-140-36.ec2.internal
00:49:13	kuadrant-system		authorino-56c6c9ddd5-6t8v7	Scheduled	Successfully assigned kuadrant-system/authorino-56c6c9ddd5-6t8v7 to ip-10-0-138-215.ec2.internal
00:50:13	opendatahub		odh-model-controller-769875db56-lf7kc	Scheduled	Successfully assigned opendatahub/odh-model-controller-769875db56-lf7kc to ip-10-0-140-36.ec2.internal
00:48:12	openshift-ingress		maas-default-gateway-openshift-default-9f5889779-cc9wb	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-cc9wb to ip-10-0-140-36.ec2.internal
00:50:42	kuadrant-system		authorino-6f6944bcdd-dhh88	Scheduled	Successfully assigned kuadrant-system/authorino-6f6944bcdd-dhh88 to ip-10-0-140-36.ec2.internal
00:52:58	openshift-ingress		maas-default-gateway-openshift-default-9f5889779-fx5lx	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-fx5lx to ip-10-0-139-2.ec2.internal
00:52:43	openshift-ingress		maas-default-gateway-openshift-default-9f5889779-nr6rk	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-nr6rk to ip-10-0-139-2.ec2.internal
00:52:58	openshift-ingress		maas-default-gateway-openshift-default-9f5889779-r7mwn	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-r7mwn to ip-10-0-138-215.ec2.internal
00:52:58	openshift-ingress		maas-default-gateway-openshift-default-9f5889779-s98m2	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-s98m2 to ip-10-0-138-215.ec2.internal
00:53:13	openshift-ingress		maas-default-gateway-openshift-default-9f5889779-wqw48	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-wqw48 to ip-10-0-140-36.ec2.internal
00:49:12	kuadrant-system		authorino-57f7f8659f-7sfqk	Scheduled	Successfully assigned kuadrant-system/authorino-57f7f8659f-7sfqk to ip-10-0-140-36.ec2.internal
00:50:13	opendatahub		model-serving-api-75bd89fdfc-bqkpw	Scheduled	Successfully assigned opendatahub/model-serving-api-75bd89fdfc-bqkpw to ip-10-0-138-215.ec2.internal
00:52:43	openshift-ingress		maas-default-gateway-openshift-default-9f5889779-7b2vr	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-7b2vr to ip-10-0-140-36.ec2.internal
00:49:54	opendatahub		maas-controller-789c8d9ddd-w9pkz	Scheduled	Successfully assigned opendatahub/maas-controller-789c8d9ddd-w9pkz to ip-10-0-139-2.ec2.internal
00:51:43	openshift-ingress		payload-processing-5f78687d5b-f66cv	Scheduled	Successfully assigned openshift-ingress/payload-processing-5f78687d5b-f66cv to ip-10-0-140-36.ec2.internal
00:51:43	openshift-ingress		payload-pre-processing-7b98bb678c-r44xg	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-7b98bb678c-r44xg to ip-10-0-140-36.ec2.internal
00:49:55	opendatahub		maas-controller-585657d964-pmxn8	Scheduled	Successfully assigned opendatahub/maas-controller-585657d964-pmxn8 to ip-10-0-139-2.ec2.internal
00:48:12	openshift-ingress		openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm	Scheduled	Successfully assigned openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm to ip-10-0-138-215.ec2.internal
00:52:43	openshift-ingress		maas-default-gateway-openshift-default-9f5889779-2s7rm	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-9f5889779-2s7rm to ip-10-0-138-215.ec2.internal
00:50:42	kuadrant-system		authorino-5bf5444bb8-jhbtp	Scheduled	Successfully assigned kuadrant-system/authorino-5bf5444bb8-jhbtp to ip-10-0-138-215.ec2.internal
00:50:13	opendatahub		llmisvc-controller-manager-869d5dcc5d-j6vt5	Scheduled	Successfully assigned opendatahub/llmisvc-controller-manager-869d5dcc5d-j6vt5 to ip-10-0-138-215.ec2.internal
00:51:05	opendatahub		llmisvc-controller-manager-6466c554d8-4hcnc	Scheduled	Successfully assigned opendatahub/llmisvc-controller-manager-6466c554d8-4hcnc to ip-10-0-138-215.ec2.internal
00:49:17	opendatahub		kserve-module-controller-manager-7566cf5fc8-mkdjj	Scheduled	Successfully assigned opendatahub/kserve-module-controller-manager-7566cf5fc8-mkdjj to ip-10-0-138-215.ec2.internal
00:48:54	kuadrant-system		authorino-operator-7b7bb4bc77-rjwxn	Scheduled	Successfully assigned kuadrant-system/authorino-operator-7b7bb4bc77-rjwxn to ip-10-0-138-215.ec2.internal
00:50:13	opendatahub		kserve-controller-manager-776cc66d47-854p6	Scheduled	Successfully assigned opendatahub/kserve-controller-manager-776cc66d47-854p6 to ip-10-0-140-36.ec2.internal
00:49:07	openshift-ingress		kube-auth-proxy-55b669d8cd-r4r4s	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-55b669d8cd-r4r4s to ip-10-0-140-36.ec2.internal
00:50:42	kuadrant-system		authorino-6889cbd8c4-4dd5x	Scheduled	Successfully assigned kuadrant-system/authorino-6889cbd8c4-4dd5x to ip-10-0-138-215.ec2.internal
00:50:31	openshift-jobset-operator		jobset-controller-manager-77c8d68c5b-99dcw	Scheduled	Successfully assigned openshift-jobset-operator/jobset-controller-manager-77c8d68c5b-99dcw to ip-10-0-139-2.ec2.internal
00:49:00	cert-manager		cert-manager-597b95cb84-bnjcd	Scheduled	Successfully assigned cert-manager/cert-manager-597b95cb84-bnjcd to ip-10-0-140-36.ec2.internal
00:51:40	opendatahub		ai-gateway-controller-7d85675f98-q5z9m	Scheduled	Successfully assigned opendatahub/ai-gateway-controller-7d85675f98-q5z9m to ip-10-0-140-36.ec2.internal
00:51:54	opendatahub		ai-gateway-controller-7c7f5657cd-bl5c9	Scheduled	Successfully assigned opendatahub/ai-gateway-controller-7c7f5657cd-bl5c9 to ip-10-0-140-36.ec2.internal
00:52:21	llm		e2e-embedding-simulated-kserve-67bf594cd6-kxbzp	Scheduled	Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-kxbzp to ip-10-0-139-2.ec2.internal
00:38:17	openshift-ingress	deployment-controller	router-default	ScalingReplicaSet	Scaled up replica set router-default-d6f88c97f from 0 to 1
00:38:20	openshift-ingress	service-controller	router-default	UnAvailableLoadBalancer	There are no available nodes for LoadBalancer
00:38:20	openshift-ingress	service-controller	router-default	EnsuringLoadBalancer	Ensuring load balancer
00:38:24	openshift-ingress	service-controller	router-default	EnsuredLoadBalancer	Ensured load balancer
00:39:06 (x2)	openshift-ingress	replicaset-controller	router-default-d6f88c97f	FailedCreate	Error creating: pods "router-default-d6f88c97f-" is forbidden: error fetching namespace "openshift-ingress": unable to find annotation openshift.io/sa.scc.uid-range
00:39:15	openshift-ingress	replicaset-controller	router-default-d6f88c97f	SuccessfulCreate	Created pod: router-default-d6f88c97f-qsxvw
00:44:40 (x3)	openshift-ingress	service-controller	router-default	UpdatedLoadBalancer	Updated load balancer with new hosts
00:45:04 (x5)	openshift-ingress	kubelet	router-default-d6f88c97f-qsxvw	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
00:45:04 (x5)	openshift-ingress	kubelet	router-default-d6f88c97f-qsxvw	FailedMount	MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
00:45:10 (x2)	openshift-ingress	kubelet	router-default-d6f88c97f-qsxvw	FailedMount	MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
00:45:12	openshift-ingress	multus	router-default-d6f88c97f-qsxvw	AddedInterface	Add eth0 [10.132.0.9/23] from ovn-kubernetes
00:45:12	openshift-ingress	kubelet	router-default-d6f88c97f-qsxvw	Started	Container started
00:45:12	openshift-ingress	kubelet	router-default-d6f88c97f-qsxvw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3a679d80eb36ca7db888d4fbd1fdf16b0997a7c7a107936396b7a57d8b199f4e" already present on machine and can be accessed by the pod
00:45:12	openshift-ingress	kubelet	router-default-d6f88c97f-qsxvw	Created	Container created
00:48:04	openshift-ingress	gateway_labeler_controller	maas-default-gateway	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway
00:48:06	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-7876bfcb74 from 0 to 1
00:48:06	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7876bfcb74	SuccessfulCreate	Created pod: istiod-openshift-gateway-7876bfcb74-4b8kb
00:48:07	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-4b8kb	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8"
00:48:07	openshift-ingress	multus	istiod-openshift-gateway-7876bfcb74-4b8kb	AddedInterface	Add eth0 [10.133.0.18/23] from ovn-kubernetes
00:48:10	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-4b8kb	Started	Container started
00:48:10	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-4b8kb	Created	Container created
00:48:10	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-4b8kb	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" in 3.14s (3.14s including waiting). Image size: 185476477 bytes.
00:48:12 (x2)	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-4b8kb	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
00:48:12 (x2)	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-4b8kb	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
00:48:12	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-cc9wb	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"
00:48:12	openshift-ingress	multus	maas-default-gateway-openshift-default-9f5889779-cc9wb	AddedInterface	Add eth0 [10.134.0.22/23] from ovn-kubernetes
00:48:12	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-9f5889779-cc9wb
00:48:12	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-9f5889779 from 0 to 1
00:48:12	openshift-ingress	service-controller	openshift-ai-inference-openshift-ai-inference	EnsuringLoadBalancer	Ensuring load balancer
00:48:12	openshift-ingress	replicaset-controller	openshift-ai-inference-openshift-ai-inference-6dcfc679d7	SuccessfulCreate	Created pod: openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm
00:48:12	openshift-ingress	deployment-controller	openshift-ai-inference-openshift-ai-inference	ScalingReplicaSet	Scaled up replica set openshift-ai-inference-openshift-ai-inference-6dcfc679d7 from 0 to 1
00:48:13	openshift-ingress	multus	openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm	AddedInterface	Add eth0 [10.132.0.33/23] from ovn-kubernetes
00:48:13	openshift-ingress	kubelet	openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"
00:48:15	openshift-ingress	service-controller	openshift-ai-inference-openshift-ai-inference	EnsuredLoadBalancer	Ensured load balancer
00:48:16	openshift-ingress	kubelet	openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm	Started	Container started
00:48:16	openshift-ingress	kubelet	openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm	Created	Container created
00:48:16	openshift-ingress	kubelet	openshift-ai-inference-openshift-ai-inference-6dcfc679d7-976mm	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.117s (3.117s including waiting). Image size: 183555333 bytes.
00:48:18	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-cc9wb	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 5.346s (5.346s including waiting). Image size: 183555333 bytes.
00:48:33 (x2)	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	RequirementsNotMet	one or more requirements couldn't be found
00:48:33 (x2)	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	RequirementsUnknown	requirements not yet checked
00:48:34	opendatahub-operator-system	replicaset-controller	opendatahub-operator-controller-manager-5cb755cd67	SuccessfulCreate	Created pod: opendatahub-operator-controller-manager-5cb755cd67-xxm2q
00:48:34	opendatahub-operator-system	replicaset-controller	opendatahub-operator-controller-manager-5cb755cd67	SuccessfulCreate	Created pod: opendatahub-operator-controller-manager-5cb755cd67-zmvfx
00:48:34	opendatahub-operator-system	deployment-controller	opendatahub-operator-controller-manager	ScalingReplicaSet	Scaled up replica set opendatahub-operator-controller-manager-5cb755cd67 from 0 to 3
00:48:34	opendatahub-operator-system	replicaset-controller	opendatahub-operator-controller-manager-5cb755cd67	SuccessfulCreate	Created pod: opendatahub-operator-controller-manager-5cb755cd67-hqgkr
00:48:34	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	AllRequirementsMet	all requirements found, attempting install
00:48:35	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-xxm2q	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
00:48:35	opendatahub-operator-system	multus	opendatahub-operator-controller-manager-5cb755cd67-hqgkr	AddedInterface	Add eth0 [10.134.0.23/23] from ovn-kubernetes
00:48:35	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-zmvfx	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
00:48:35	opendatahub-operator-system	multus	opendatahub-operator-controller-manager-5cb755cd67-zmvfx	AddedInterface	Add eth0 [10.132.0.35/23] from ovn-kubernetes
00:48:35	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-hqgkr	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
00:48:35	opendatahub-operator-system	multus	opendatahub-operator-controller-manager-5cb755cd67-xxm2q	AddedInterface	Add eth0 [10.133.0.19/23] from ovn-kubernetes
00:48:36 (x2)	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	InstallWaiting	Webhook install failed: conversionWebhook not ready
00:48:37 (x2)	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	InstallWaiting	installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
00:48:37 (x2)	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	InstallSucceeded	waiting for install components to report healthy
00:48:37	opendatahub-operator-system	operator-lifecycle-manager	install-dd8zf	AppliedWithWarnings	1 warning(s) generated during installation of operator "opendatahub-operator.v3.6.0-ea.2" (CustomResourceDefinition "hardwareprofiles.infrastructure.opendatahub.io"): infrastructure.opendatahub.io/v1alpha1 is deprecated; please use infrastructure.opendatahub.io/v1
00:48:38	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-hqgkr	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 3.325s (3.325s including waiting). Image size: 273709574 bytes.
00:48:38	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-zmvfx	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.661s (2.661s including waiting). Image size: 273709574 bytes.
00:48:38	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-zmvfx	Created	Container created
00:48:38	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-zmvfx	Started	Container started
00:48:38	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-xxm2q	Started	Container started
00:48:38	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-xxm2q	Created	Container created
00:48:38	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-xxm2q	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 2.805s (2.805s including waiting). Image size: 273709574 bytes.
00:48:39	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-xxm2q	Started	Container started
00:48:39	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-zmvfx	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 264ms (264ms including waiting). Image size: 273709574 bytes.
00:48:39	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-hqgkr	Created	Container created
00:48:39	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-hqgkr	Started	Container started
00:48:39	opendatahub-operator-system	opendatahub-operator-controller-manager-5cb755cd67-zmvfx_3533b3ad-726c-48eb-a1d1-5a10115354e3	07ed84f7.opendatahub.io	LeaderElection	opendatahub-operator-controller-manager-5cb755cd67-zmvfx_3533b3ad-726c-48eb-a1d1-5a10115354e3 became leader
00:48:39	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-xxm2q	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
00:48:39	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-xxm2q	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 302ms (302ms including waiting). Image size: 273709574 bytes.
00:48:39	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-xxm2q	Created	Container created
00:48:39	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-zmvfx	Started	Container started
00:48:39	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-zmvfx	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
00:48:39	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-zmvfx	Created	Container created
00:48:40	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-hqgkr	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2"
00:48:40	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-hqgkr	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.6.0-ea.2" in 652ms (652ms including waiting). Image size: 273709574 bytes.
00:48:40	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-hqgkr	Created	Container created
00:48:40	opendatahub-operator-system	kubelet	opendatahub-operator-controller-manager-5cb755cd67-hqgkr	Started	Container started
00:48:41	openshift-jobset-operator	operator-lifecycle-manager	jobset-operator.v1.0.1	RequirementsUnknown	requirements not yet checked
00:48:41	openshift-jobset-operator	operator-lifecycle-manager	jobset-operator.v1.0.1	RequirementsNotMet	one or more requirements couldn't be found
00:48:42	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:48:42 (x2)	openshift-ingress	horizontal-pod-autoscaler	openshift-ai-inference-openshift-ai-inference	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:48:42	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:48:42 (x2)	openshift-ingress	horizontal-pod-autoscaler	openshift-ai-inference-openshift-ai-inference	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:48:43	openshift-jobset-operator	replicaset-controller	jobset-operator-674cd59dc5	SuccessfulCreate	Created pod: jobset-operator-674cd59dc5-t9r44
00:48:43	openshift-jobset-operator	operator-lifecycle-manager	jobset-operator.v1.0.1	AllRequirementsMet	all requirements found, attempting install
00:48:43	openshift-jobset-operator	deployment-controller	jobset-operator	ScalingReplicaSet	Scaled up replica set jobset-operator-674cd59dc5 from 0 to 1
00:48:43	openshift-jobset-operator	operator-lifecycle-manager	jobset-operator.v1.0.1	InstallSucceeded	waiting for install components to report healthy
00:48:44	openshift-jobset-operator	operator-lifecycle-manager	jobset-operator.v1.0.1	InstallWaiting	installing: waiting for deployment jobset-operator to become ready: deployment "jobset-operator" not available: Deployment does not have minimum availability.
00:48:44	openshift-jobset-operator	multus	jobset-operator-674cd59dc5-t9r44	AddedInterface	Add eth0 [10.134.0.25/23] from ovn-kubernetes
00:48:44	openshift-jobset-operator	kubelet	jobset-operator-674cd59dc5-t9r44	Pulling	Pulling image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e"
00:48:46	openshift-jobset-operator	kubelet	jobset-operator-674cd59dc5-t9r44	Pulled	Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9-operator@sha256:a258511e57b511c5d2a54fae2b8165669d677fb3a69796aa1c78d224a499033e" in 2.05s (2.05s including waiting). Image size: 224874686 bytes.
00:48:46	openshift-jobset-operator	kubelet	jobset-operator-674cd59dc5-t9r44	Created	Container created
00:48:46	openshift-jobset-operator	kubelet	jobset-operator-674cd59dc5-t9r44	Started	Container started
00:48:47	openshift-jobset-operator	openshift-jobset-operator	openshift-jobset-operator-lock	LeaderElection	jobset-operator-674cd59dc5-t9r44_5a10ebb5-b9e0-46e9-98de-ac61e6c96c24 became leader
00:48:47	openshift-jobset-operator	operator-lifecycle-manager	jobset-operator.v1.0.1	InstallSucceeded	install strategy completed with no errors
00:48:48	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	RequirementsNotMet	one or more requirements couldn't be found
00:48:48	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	RequirementsUnknown	requirements not yet checked
00:48:50	cert-manager	deployment-controller	cert-manager-cainjector	ScalingReplicaSet	Scaled up replica set cert-manager-cainjector-5c57bbd4fc from 0 to 1
00:48:51	cert-manager	deployment-controller	cert-manager-webhook	ScalingReplicaSet	Scaled up replica set cert-manager-webhook-5dbbbf75cc from 0 to 1
00:48:51	cert-manager	replicaset-controller	cert-manager-webhook-5dbbbf75cc	SuccessfulCreate	Created pod: cert-manager-webhook-5dbbbf75cc-dz8bc
00:48:51 (x9)	cert-manager	replicaset-controller	cert-manager-cainjector-5c57bbd4fc	FailedCreate	Error creating: pods "cert-manager-cainjector-5c57bbd4fc-" is forbidden: error looking up service account cert-manager/cert-manager-cainjector: serviceaccount "cert-manager-cainjector" not found
00:48:51	cert-manager	multus	cert-manager-webhook-5dbbbf75cc-dz8bc	AddedInterface	Add eth0 [10.134.0.26/23] from ovn-kubernetes
00:48:51	cert-manager	kubelet	cert-manager-webhook-5dbbbf75cc-dz8bc	Pulling	Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"
00:48:52	opendatahub-operator-system	operator-lifecycle-manager	opendatahub-operator.v3.6.0-ea.2	InstallSucceeded	install strategy completed with no errors
00:48:52	cert-manager	replicaset-controller	cert-manager-cainjector-5c57bbd4fc	SuccessfulCreate	Created pod: cert-manager-cainjector-5c57bbd4fc-gps6q
00:48:53	cert-manager	multus	cert-manager-cainjector-5c57bbd4fc-gps6q	AddedInterface	Add eth0 [10.134.0.27/23] from ovn-kubernetes
00:48:53	cert-manager	kubelet	cert-manager-cainjector-5c57bbd4fc-gps6q	Pulling	Pulling image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d"
00:48:54	kuadrant-system	deployment-controller	authorino-operator	ScalingReplicaSet	Scaled up replica set authorino-operator-7b7bb4bc77 from 0 to 1
00:48:54	kuadrant-system	replicaset-controller	authorino-operator-7b7bb4bc77	SuccessfulCreate	Created pod: authorino-operator-7b7bb4bc77-rjwxn
00:48:54	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	InstallSucceeded	waiting for install components to report healthy
00:48:54	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	AllRequirementsMet	all requirements found, attempting install
00:48:54	cert-manager	kubelet	cert-manager-webhook-5dbbbf75cc-dz8bc	Started	Container started
00:48:54	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	InstallWaiting	installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.
00:48:54	cert-manager	kubelet	cert-manager-webhook-5dbbbf75cc-dz8bc	Created	Container created
00:48:54	cert-manager	kubelet	cert-manager-webhook-5dbbbf75cc-dz8bc	Pulled	Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 2.818s (2.818s including waiting). Image size: 309650901 bytes.
00:48:55	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	RequirementsNotMet	one or more requirements couldn't be found
00:48:55	cert-manager	kubelet	cert-manager-cainjector-5c57bbd4fc-gps6q	Pulled	Successfully pulled image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" in 1.748s (1.748s including waiting). Image size: 309650901 bytes.
00:48:55	kuadrant-system	kubelet	authorino-operator-7b7bb4bc77-rjwxn	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"
00:48:55	kuadrant-system	multus	authorino-operator-7b7bb4bc77-rjwxn	AddedInterface	Add eth0 [10.132.0.36/23] from ovn-kubernetes
00:48:55	cert-manager	kubelet	cert-manager-cainjector-5c57bbd4fc-gps6q	Created	Container created
00:48:55	cert-manager	kubelet	cert-manager-cainjector-5c57bbd4fc-gps6q	Started	Container started
00:48:55	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	RequirementsUnknown	requirements not yet checked
00:48:58	kuadrant-system	kubelet	authorino-operator-7b7bb4bc77-rjwxn	Started	Container started
00:48:58	kuadrant-system	kubelet	authorino-operator-7b7bb4bc77-rjwxn	Created	Container created
00:48:58	kuadrant-system	kubelet	authorino-operator-7b7bb4bc77-rjwxn	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 3.183s (3.183s including waiting). Image size: 167738465 bytes.
00:48:58	cert-manager	deployment-controller	cert-manager	ScalingReplicaSet	Scaled up replica set cert-manager-597b95cb84 from 0 to 1
00:48:59	kuadrant-system	authorino-operator-7b7bb4bc77-rjwxn_772d4884-b3df-4e76-9e00-75e8e3467499	aac3a15d.authorino.kuadrant.io	LeaderElection	authorino-operator-7b7bb4bc77-rjwxn_772d4884-b3df-4e76-9e00-75e8e3467499 became leader
00:48:59 (x9)	cert-manager	replicaset-controller	cert-manager-597b95cb84	FailedCreate	Error creating: pods "cert-manager-597b95cb84-" is forbidden: error looking up service account cert-manager/cert-manager: serviceaccount "cert-manager" not found
00:49:00	cert-manager	replicaset-controller	cert-manager-597b95cb84	SuccessfulCreate	Created pod: cert-manager-597b95cb84-bnjcd
00:49:01	cert-manager	kubelet	cert-manager-597b95cb84-bnjcd	Created	Container created
00:49:01	cert-manager	multus	cert-manager-597b95cb84-bnjcd	AddedInterface	Add eth0 [10.134.0.28/23] from ovn-kubernetes
00:49:01	cert-manager	kubelet	cert-manager-597b95cb84-bnjcd	Started	Container started
00:49:01	cert-manager	kubelet	cert-manager-597b95cb84-bnjcd	Pulled	Container image "registry.redhat.io/cert-manager/jetstack-cert-manager-rhel9@sha256:b3305a06bff4a344ba1b19c8142d7e605fc723841981c97aab2310ff8a82c66d" already present on machine and can be accessed by the pod
00:49:02	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	InstallSucceeded	waiting for install components to report healthy
00:49:02	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	AllRequirementsMet	all requirements found, attempting install
00:49:02	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	InstallWaiting	installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
00:49:02	kuadrant-system	replicaset-controller	kuadrant-operator-controller-manager-678d87766f	SuccessfulCreate	Created pod: kuadrant-operator-controller-manager-678d87766f-xdxfj
00:49:02	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	RequirementsUnknown	requirements not yet checked
00:49:02	kuadrant-system	deployment-controller	kuadrant-operator-controller-manager	ScalingReplicaSet	Scaled up replica set kuadrant-operator-controller-manager-678d87766f from 0 to 1
00:49:02	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	RequirementsNotMet	one or more requirements couldn't be found
00:49:03	kuadrant-system	kubelet	kuadrant-operator-controller-manager-678d87766f-xdxfj	Pulling	Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"
00:49:03	kuadrant-system	multus	kuadrant-operator-controller-manager-678d87766f-xdxfj	AddedInterface	Add eth0 [10.132.0.37/23] from ovn-kubernetes
00:49:05	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	RequirementsUnknown	requirements not yet checked
00:49:05	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	AllRequirementsMet	all requirements found, attempting install
00:49:05	kuadrant-system	deployment-controller	dns-operator-controller-manager	ScalingReplicaSet	Scaled up replica set dns-operator-controller-manager-8557cbdb84 from 0 to 1
00:49:05	kuadrant-system	replicaset-controller	dns-operator-controller-manager-8557cbdb84	SuccessfulCreate	Created pod: dns-operator-controller-manager-8557cbdb84-d2f5f
00:49:05	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	InstallSucceeded	waiting for install components to report healthy
00:49:05	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	InstallWaiting	installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.
00:49:06	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	RequirementsNotMet	one or more requirements couldn't be found
00:49:06	kuadrant-system	kubelet	dns-operator-controller-manager-8557cbdb84-d2f5f	Pulling	Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"
00:49:06	kuadrant-system	multus	dns-operator-controller-manager-8557cbdb84-d2f5f	AddedInterface	Add eth0 [10.133.0.20/23] from ovn-kubernetes
00:49:07	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-manager-rolebinding because it was missing
00:49:07	openshift-ingress	replicaset-controller	kube-auth-proxy-55b669d8cd	SuccessfulCreate	Created pod: kube-auth-proxy-55b669d8cd-n2fht
00:49:07	kuadrant-system	kuadrant-operator-controller-manager-678d87766f-xdxfj_a2ab6d1b-d5d6-43fe-985a-c265a027f0c8	f139389e.kuadrant.io	LeaderElection	kuadrant-operator-controller-manager-678d87766f-xdxfj_a2ab6d1b-d5d6-43fe-985a-c265a027f0c8 became leader
00:49:07	openshift-ingress	replicaset-controller	kube-auth-proxy-55b669d8cd	SuccessfulCreate	Created pod: kube-auth-proxy-55b669d8cd-r4r4s
00:49:07	kuadrant-system	kubelet	kuadrant-operator-controller-manager-678d87766f-xdxfj	Started	Container started
00:49:07	kuadrant-system	kubelet	kuadrant-operator-controller-manager-678d87766f-xdxfj	Created	Container created
00:49:07	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-metrics-reader-rolebinding because it was missing
00:49:07	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ServiceAccountCreated	Created ServiceAccount/jobset-controller-manager -n openshift-jobset-operator because it was missing
00:49:07	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/jobset-proxy-role because it was missing
00:49:07	openshift-ingress	deployment-controller	kube-auth-proxy	ScalingReplicaSet	Scaled up replica set kube-auth-proxy-55b669d8cd from 0 to 2
00:49:07	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/jobset-metrics-reader because it was missing
00:49:07	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/jobset-manager-role because it was missing
00:49:07	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	ServiceCreated	Created Service/jobset-webhook-service -n openshift-jobset-operator because it was missing
00:49:07	kuadrant-system	kubelet	kuadrant-operator-controller-manager-678d87766f-xdxfj	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 4.063s (4.063s including waiting). Image size: 424244516 bytes.
00:49:08	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	AllRequirementsMet	all requirements found, attempting install
00:49:08	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/jobset-proxy-rolebinding because it was missing
00:49:08	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/jobset-leader-election-role -n openshift-jobset-operator because it was missing
00:49:08	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/jobset-manager-secrets-role -n openshift-jobset-operator because it was missing
00:49:08	openshift-ingress	replicaset-controller	data-science-gateway-data-science-gateway-class-7974757cbf	SuccessfulCreate	Created pod: data-science-gateway-data-science-gateway-class-7974757cbfz6tcg
00:49:08	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-7974757cbfz6tcg	Started	Container started
00:49:08	openshift-ingress	multus	data-science-gateway-data-science-gateway-class-7974757cbfz6tcg	AddedInterface	Add eth0 [10.132.0.38/23] from ovn-kubernetes
00:49:08	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-7974757cbfz6tcg	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:49:08	openshift-ingress	kubelet	kube-auth-proxy-55b669d8cd-r4r4s	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"
00:49:08	openshift-ingress	multus	kube-auth-proxy-55b669d8cd-r4r4s	AddedInterface	Add eth0 [10.134.0.29/23] from ovn-kubernetes
00:49:08	openshift-ingress	kubelet	kube-auth-proxy-55b669d8cd-n2fht	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035"
00:49:08	openshift-ingress	multus	kube-auth-proxy-55b669d8cd-n2fht	AddedInterface	Add eth0 [10.133.0.21/23] from ovn-kubernetes
00:49:08	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-7974757cbfz6tcg	Created	Container created
00:49:08	openshift-ingress	deployment-controller	data-science-gateway-data-science-gateway-class	ScalingReplicaSet	Scaled up replica set data-science-gateway-data-science-gateway-class-7974757cbf from 0 to 1
00:49:09	kuadrant-system	multus	limitador-operator-controller-manager-5778bb4449-wwgnp	AddedInterface	Add eth0 [10.132.0.39/23] from ovn-kubernetes
00:49:09	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/jobset-leader-election-rolebinding -n openshift-jobset-operator because it was missing
00:49:09	kuadrant-system	deployment-controller	limitador-operator-controller-manager	ScalingReplicaSet	Scaled up replica set limitador-operator-controller-manager-5778bb4449 from 0 to 1
00:49:09	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	InstallSucceeded	waiting for install components to report healthy
00:49:09	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	InstallWaiting	installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.
00:49:09	kuadrant-system	replicaset-controller	limitador-operator-controller-manager-5778bb4449	SuccessfulCreate	Created pod: limitador-operator-controller-manager-5778bb4449-wwgnp
00:49:09	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	ServiceCreated	Created Service/jobset-controller-manager-metrics-service -n openshift-jobset-operator because it was missing
00:49:09	openshift-jobset-operator	openshift-jobset-operator-jobsetoperatorstaticresources-jobsetoperatorstaticresources-staticresources	jobset-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/jobset-manager-secrets-rolebinding -n openshift-jobset-operator because it was missing
00:49:10	kuadrant-system	kubelet	limitador-operator-controller-manager-5778bb4449-wwgnp	Pulling	Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"
00:49:10	openshift-ingress	kubelet	kube-auth-proxy-55b669d8cd-r4r4s	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.26s (2.26s including waiting). Image size: 188904677 bytes.
00:49:10	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	InstallSucceeded	install strategy completed with no errors
00:49:10	openshift-ingress	kubelet	kube-auth-proxy-55b669d8cd-r4r4s	Started	Container started
00:49:10	openshift-ingress	kubelet	kube-auth-proxy-55b669d8cd-r4r4s	Created	Container created
00:49:11	openshift-ingress	kubelet	kube-auth-proxy-55b669d8cd-n2fht	Created	Container created
00:49:11	openshift-ingress	kubelet	kube-auth-proxy-55b669d8cd-n2fht	Started	Container started
00:49:11	kuadrant-system	kubelet	limitador-operator-controller-manager-5778bb4449-wwgnp	Created	Container created
00:49:11	kuadrant-system	kubelet	dns-operator-controller-manager-8557cbdb84-d2f5f	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 5.357s (5.357s including waiting). Image size: 190804149 bytes.
00:49:11	kuadrant-system	kubelet	dns-operator-controller-manager-8557cbdb84-d2f5f	Created	Container created
00:49:11	kuadrant-system	kubelet	dns-operator-controller-manager-8557cbdb84-d2f5f	Started	Container started
00:49:11	openshift-ingress	kubelet	kube-auth-proxy-55b669d8cd-n2fht	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:d90930380151490d5516eeb95840eecc743e9005fc02733dec6fe79e1a00e035" in 2.548s (2.548s including waiting). Image size: 188904677 bytes.
00:49:11 (x4)	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	IssuerCreateFailed	Failed to create Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator: Internal error occurred: failed calling webhook "webhook.cert-manager.io": failed to call webhook: Post "https://cert-manager-webhook.cert-manager.svc:443/validate?timeout=30s": tls: failed to verify certificate: x509: certificate signed by unknown authority
00:49:11	kuadrant-system	kubelet	limitador-operator-controller-manager-5778bb4449-wwgnp	Started	Container started
00:49:11	kuadrant-system	kubelet	limitador-operator-controller-manager-5778bb4449-wwgnp	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 1.841s (1.842s including waiting). Image size: 177967631 bytes.
00:49:12	kuadrant-system	limitador-operator-controller-manager-5778bb4449-wwgnp_e08658ef-a65b-42b5-a371-a19bdcc68660	3745a16e.kuadrant.io	LeaderElection	limitador-operator-controller-manager-5778bb4449-wwgnp_e08658ef-a65b-42b5-a371-a19bdcc68660 became leader
00:49:12	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-57f7f8659f from 0 to 1
00:49:12	kuadrant-system	replicaset-controller	authorino-57f7f8659f	SuccessfulCreate	Created pod: authorino-57f7f8659f-7sfqk
00:49:12	kuadrant-system	multus	limitador-limitador-74dfcfb894-9s6jp	AddedInterface	Add eth0 [10.133.0.22/23] from ovn-kubernetes
00:49:12	kuadrant-system	dns-operator-controller-manager-8557cbdb84-d2f5f_256e3e4f-6e94-4695-bf57-9dcf93a35a11	a3f98d6c.kuadrant.io	LeaderElection	dns-operator-controller-manager-8557cbdb84-d2f5f_256e3e4f-6e94-4695-bf57-9dcf93a35a11 became leader
00:49:12	kuadrant-system	replicaset-controller	limitador-limitador-74dfcfb894	SuccessfulCreate	Created pod: limitador-limitador-74dfcfb894-9s6jp
00:49:12	kuadrant-system	deployment-controller	limitador-limitador	ScalingReplicaSet	Scaled up replica set limitador-limitador-74dfcfb894 from 0 to 1
00:49:13	kuadrant-system	replicaset-controller	limitador-limitador-7c9b87d574	SuccessfulCreate	Created pod: limitador-limitador-7c9b87d574-xg5gn
00:49:13	kuadrant-system	multus	authorino-57f7f8659f-7sfqk	AddedInterface	Add eth0 [10.134.0.30/23] from ovn-kubernetes
00:49:13	kuadrant-system	kubelet	limitador-limitador-74dfcfb894-9s6jp	Pulling	Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"
00:49:13	kuadrant-system	kubelet	limitador-limitador-74dfcfb894-9s6jp	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 986ms (986ms including waiting). Image size: 133379307 bytes.
00:49:13	kuadrant-system	deployment-controller	limitador-limitador	ScalingReplicaSet	Scaled up replica set limitador-limitador-7c9b87d574 from 0 to 1
00:49:13	kuadrant-system	replicaset-controller	authorino-56c6c9ddd5	SuccessfulCreate	Created pod: authorino-56c6c9ddd5-6t8v7
00:49:13	kuadrant-system	multus	authorino-56c6c9ddd5-6t8v7	AddedInterface	Add eth0 [10.132.0.40/23] from ovn-kubernetes
00:49:13	kuadrant-system	kubelet	authorino-56c6c9ddd5-6t8v7	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
00:49:13	kuadrant-system	multus	limitador-limitador-7c9b87d574-xg5gn	AddedInterface	Add eth0 [10.134.0.31/23] from ovn-kubernetes
00:49:13	kuadrant-system	kubelet	limitador-limitador-7c9b87d574-xg5gn	Pulling	Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"
00:49:13	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-56c6c9ddd5 from 0 to 1
00:49:13	kuadrant-system	kubelet	authorino-57f7f8659f-7sfqk	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
00:49:14	kuadrant-system	kubelet	limitador-limitador-74dfcfb894-9s6jp	Started	Container started
00:49:14	kuadrant-system	kubelet	limitador-limitador-74dfcfb894-9s6jp	Created	Container created
00:49:15	kuadrant-system	kubelet	authorino-56c6c9ddd5-6t8v7	Created	Container created
00:49:15	kuadrant-system	kubelet	authorino-56c6c9ddd5-6t8v7	Started	Container started
00:49:15	kuadrant-system	kubelet	authorino-56c6c9ddd5-6t8v7	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.523s (1.523s including waiting). Image size: 204096810 bytes.
00:49:16	kuadrant-system	kubelet	authorino-57f7f8659f-7sfqk	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 3.028s (3.028s including waiting). Image size: 204096810 bytes.
00:49:16	kuadrant-system	kubelet	authorino-57f7f8659f-7sfqk	Created	Container created
00:49:16	kuadrant-system	kubelet	authorino-57f7f8659f-7sfqk	Started	Container started
00:49:16	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled down replica set authorino-57f7f8659f from 1 to 0
00:49:16	kuadrant-system	replicaset-controller	authorino-57f7f8659f	SuccessfulDelete	Deleted pod: authorino-57f7f8659f-7sfqk
00:49:16	kuadrant-system	kubelet	limitador-limitador-7c9b87d574-xg5gn	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 2.803s (2.803s including waiting). Image size: 133379307 bytes.
00:49:16	kuadrant-system	kubelet	limitador-limitador-7c9b87d574-xg5gn	Created	Container created
00:49:16	kuadrant-system	kubelet	limitador-limitador-7c9b87d574-xg5gn	Started	Container started
00:49:17	opendatahub	deployment-controller	kserve-module-controller-manager	ScalingReplicaSet	Scaled up replica set kserve-module-controller-manager-7566cf5fc8 from 0 to 1
00:49:17	kuadrant-system	kubelet	authorino-57f7f8659f-7sfqk	Killing	Stopping container authorino
00:49:17	opendatahub	multus	kserve-module-controller-manager-7566cf5fc8-mkdjj	AddedInterface	Add eth0 [10.132.0.41/23] from ovn-kubernetes
00:49:17	opendatahub	replicaset-controller	kserve-module-controller-manager-7566cf5fc8	SuccessfulCreate	Created pod: kserve-module-controller-manager-7566cf5fc8-mkdjj
00:49:17	opendatahub	kubelet	kserve-module-controller-manager-7566cf5fc8-mkdjj	Pulling	Pulling image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189"
00:49:19	opendatahub	kubelet	kserve-module-controller-manager-7566cf5fc8-mkdjj	Started	Container started
00:49:19	opendatahub	kubelet	kserve-module-controller-manager-7566cf5fc8-mkdjj	Created	Container created
00:49:19	opendatahub	kubelet	kserve-module-controller-manager-7566cf5fc8-mkdjj	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kserve-module-operator@sha256:b8becaa017a2a2ec9af002989e8f14a8a2f96ffad292f37a61569343b1101189" in 2.177s (2.177s including waiting). Image size: 195729000 bytes.
00:49:19	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	InstallSucceeded	install strategy completed with no errors
00:49:22	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:49:22	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:49:23	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	InstallSucceeded	install strategy completed with no errors
00:49:24	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	InstallSucceeded	install strategy completed with no errors
00:49:28	kuadrant-system	kubelet	limitador-limitador-74dfcfb894-9s6jp	Killing	Stopping container limitador
00:49:28	kuadrant-system	replicaset-controller	limitador-limitador-74dfcfb894	SuccessfulDelete	Deleted pod: limitador-limitador-74dfcfb894-9s6jp
00:49:28	kuadrant-system	deployment-controller	limitador-limitador	ScalingReplicaSet	Scaled down replica set limitador-limitador-74dfcfb894 from 1 to 0
00:49:36	opendatahub	kserve-module-controller-manager-7566cf5fc8-mkdjj_3badc4ba-4bc0-4299-8d5c-9248e7a0bde6	kserve-module-controller-manager	LeaderElection	kserve-module-controller-manager-7566cf5fc8-mkdjj_3badc4ba-4bc0-4299-8d5c-9248e7a0bde6 became leader
00:49:37	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:49:37	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:49:40 (x2)	openshift-ingress	horizontal-pod-autoscaler	data-science-gateway-data-science-gateway-class	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:49:40 (x2)	openshift-ingress	horizontal-pod-autoscaler	data-science-gateway-data-science-gateway-class	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:49:54	opendatahub	kubelet	maas-controller-789c8d9ddd-w9pkz	FailedMount	MountVolume.SetUp failed for volume "webhook-cert" : secret "maas-controller-webhook-cert" not found
00:49:54	opendatahub	replicaset-controller	maas-controller-789c8d9ddd	SuccessfulCreate	Created pod: maas-controller-789c8d9ddd-w9pkz
00:49:54	opendatahub	deployment-controller	maas-controller	ScalingReplicaSet	Scaled up replica set maas-controller-789c8d9ddd from 0 to 1
00:49:55	opendatahub	multus	maas-controller-585657d964-pmxn8	AddedInterface	Add eth0 [10.133.0.25/23] from ovn-kubernetes
00:49:55	opendatahub	kubelet	maas-controller-585657d964-pmxn8	Pulling	Pulling image "quay.io/opendatahub/maas-controller@sha256:436b97a396fd922aceda1198d48cad8dba6131be859514597b4a8623d8725dfb"
00:49:55	opendatahub	replicaset-controller	maas-controller-585657d964	SuccessfulCreate	Created pod: maas-controller-585657d964-pmxn8
00:49:55	opendatahub	multus	maas-controller-789c8d9ddd-w9pkz	AddedInterface	Add eth0 [10.133.0.24/23] from ovn-kubernetes
00:49:55	opendatahub	kubelet	maas-controller-789c8d9ddd-w9pkz	Pulling	Pulling image "quay.io/opendatahub/maas-controller@sha256:436b97a396fd922aceda1198d48cad8dba6131be859514597b4a8623d8725dfb"
00:49:55	opendatahub	deployment-controller	maas-controller	ScalingReplicaSet	Scaled up replica set maas-controller-585657d964 from 0 to 1
00:49:58	opendatahub	kubelet	maas-controller-585657d964-pmxn8	Created	Container created
00:49:58	opendatahub	kubelet	maas-controller-585657d964-pmxn8	Pulled	Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:436b97a396fd922aceda1198d48cad8dba6131be859514597b4a8623d8725dfb" in 2.801s (2.802s including waiting). Image size: 200057363 bytes.
00:49:58	opendatahub	kubelet	maas-controller-789c8d9ddd-w9pkz	Started	Container started
00:49:58	opendatahub	kubelet	maas-controller-789c8d9ddd-w9pkz	Created	Container created
00:49:58	opendatahub	kubelet	maas-controller-789c8d9ddd-w9pkz	Pulled	Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:436b97a396fd922aceda1198d48cad8dba6131be859514597b4a8623d8725dfb" in 2.653s (2.653s including waiting). Image size: 200057363 bytes.
00:49:58	opendatahub	kubelet	maas-controller-585657d964-pmxn8	Started	Container started
00:49:59	opendatahub	maas-controller-585657d964-pmxn8_86999780-c0a7-4735-a6dd-d2c30e7dda16	maas-controller.models-as-a-service.opendatahub.io	LeaderElection	maas-controller-585657d964-pmxn8_86999780-c0a7-4735-a6dd-d2c30e7dda16 became leader
00:50:00	opendatahub	deployment-controller	usage-logs-tenancy-proxy	ScalingReplicaSet	Scaled up replica set usage-logs-tenancy-proxy-9c5d49bcd from 0 to 1
00:50:00	opendatahub	replicaset-controller	usage-logs-tenancy-proxy-9c5d49bcd	SuccessfulCreate	Created pod: usage-logs-tenancy-proxy-9c5d49bcd-jv5l8
00:50:00	opendatahub	kubelet	usage-logs-tenancy-proxy-9c5d49bcd-jv5l8	Pulling	Pulling image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172"
00:50:00	opendatahub	multus	usage-logs-tenancy-proxy-9c5d49bcd-jv5l8	AddedInterface	Add eth0 [10.134.0.32/23] from ovn-kubernetes
00:50:09	opendatahub	deployment-controller	maas-controller	ScalingReplicaSet	Scaled down replica set maas-controller-789c8d9ddd from 1 to 0
00:50:09	opendatahub	replicaset-controller	maas-controller-789c8d9ddd	SuccessfulDelete	Deleted pod: maas-controller-789c8d9ddd-w9pkz
00:50:09	opendatahub	kubelet	maas-controller-789c8d9ddd-w9pkz	Killing	Stopping container manager
00:50:12	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-7ddd9cfdc8 from 0 to 1
00:50:12	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7ddd9cfdc8	SuccessfulCreate	Created pod: istiod-openshift-gateway-7ddd9cfdc8-k8pcv
00:50:13	opendatahub	replicaset-controller	kserve-controller-manager-776cc66d47	SuccessfulCreate	Created pod: kserve-controller-manager-776cc66d47-854p6
00:50:13	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-k8pcv	Started	Container started
00:50:13	opendatahub	replicaset-controller	odh-model-controller-769875db56	SuccessfulCreate	Created pod: odh-model-controller-769875db56-lf7kc
00:50:13	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-k8pcv	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:d5adf3101d4e14c710cd05afb3fa53498e3c5fb31a120f1bb007fba2e3b376f8" already present on machine and can be accessed by the pod
00:50:13	opendatahub	deployment-controller	odh-model-controller	ScalingReplicaSet	Scaled up replica set odh-model-controller-769875db56 from 0 to 1
00:50:13	opendatahub	deployment-controller	kserve-controller-manager	ScalingReplicaSet	Scaled up replica set kserve-controller-manager-776cc66d47 from 0 to 1
00:50:13	opendatahub	deployment-controller	llmisvc-controller-manager	ScalingReplicaSet	Scaled up replica set llmisvc-controller-manager-869d5dcc5d from 0 to 1
00:50:13	opendatahub	replicaset-controller	model-serving-api-75bd89fdfc	SuccessfulCreate	Created pod: model-serving-api-75bd89fdfc-bqkpw
00:50:13	openshift-ingress	multus	istiod-openshift-gateway-7ddd9cfdc8-k8pcv	AddedInterface	Add eth0 [10.133.0.26/23] from ovn-kubernetes
00:50:13	opendatahub	deployment-controller	model-serving-api	ScalingReplicaSet	Scaled up replica set model-serving-api-75bd89fdfc from 0 to 1
00:50:13	opendatahub	replicaset-controller	llmisvc-controller-manager-869d5dcc5d	SuccessfulCreate	Created pod: llmisvc-controller-manager-869d5dcc5d-j6vt5
00:50:13	openshift-ingress	kubelet	istiod-openshift-gateway-7ddd9cfdc8-k8pcv	Created	Container created
00:50:14	opendatahub	multus	model-serving-api-75bd89fdfc-bqkpw	AddedInterface	Add eth0 [10.132.0.43/23] from ovn-kubernetes
00:50:14	opendatahub	multus	odh-model-controller-769875db56-lf7kc	AddedInterface	Add eth0 [10.134.0.34/23] from ovn-kubernetes
00:50:14	opendatahub	kubelet	kserve-controller-manager-776cc66d47-854p6	Pulling	Pulling image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d"
00:50:14	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7876bfcb74	SuccessfulDelete	Deleted pod: istiod-openshift-gateway-7876bfcb74-4b8kb
00:50:14	opendatahub	kubelet	model-serving-api-75bd89fdfc-bqkpw	Pulling	Pulling image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8"
00:50:14	opendatahub	kubelet	llmisvc-controller-manager-869d5dcc5d-j6vt5	Pulling	Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"
00:50:14	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled down replica set istiod-openshift-gateway-7876bfcb74 from 1 to 0
00:50:14	opendatahub	multus	llmisvc-controller-manager-869d5dcc5d-j6vt5	AddedInterface	Add eth0 [10.132.0.42/23] from ovn-kubernetes
00:50:14	openshift-ingress	kubelet	istiod-openshift-gateway-7876bfcb74-4b8kb	Killing	Stopping container discovery
00:50:14	opendatahub	multus	kserve-controller-manager-776cc66d47-854p6	AddedInterface	Add eth0 [10.134.0.33/23] from ovn-kubernetes
00:50:14	opendatahub	kubelet	odh-model-controller-769875db56-lf7kc	Pulling	Pulling image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775"
00:50:16	opendatahub	kubelet	llmisvc-controller-manager-869d5dcc5d-j6vt5	Created	Container created
00:50:16	opendatahub	kubelet	llmisvc-controller-manager-869d5dcc5d-j6vt5	Started	Container started
00:50:16	opendatahub	kubelet	model-serving-api-75bd89fdfc-bqkpw	Created	Container created
00:50:16	opendatahub	kubelet	model-serving-api-75bd89fdfc-bqkpw	Pulled	Successfully pulled image "quay.io/opendatahub/odh-model-serving-api@sha256:dc6ced7ac752d3770e31e3e83f4f9a6c793de5b9b04dde0d194d021020cef8e8" in 1.764s (1.764s including waiting). Image size: 184925761 bytes.
00:50:16	opendatahub	kubelet	model-serving-api-75bd89fdfc-bqkpw	Started	Container started
00:50:16	opendatahub	kubelet	llmisvc-controller-manager-869d5dcc5d-j6vt5	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 1.933s (1.933s including waiting). Image size: 235100981 bytes.
00:50:17	opendatahub	kubelet	kserve-controller-manager-776cc66d47-854p6	Pulled	Successfully pulled image "quay.io/opendatahub/kserve-controller@sha256:6e72a4ac896e998acf222204e10868106932adfbfd0dafdc0a9c1e4d58d0627d" in 2.921s (2.921s including waiting). Image size: 247676581 bytes.
00:50:17	opendatahub	kubelet	kserve-controller-manager-776cc66d47-854p6	Started	Container started
00:50:17	opendatahub	kubelet	kserve-controller-manager-776cc66d47-854p6	Created	Container created
00:50:17	opendatahub	kserve-controller-manager-776cc66d47-854p6_8c86c3bd-bf64-462c-a1dd-cc988bea1397	kserve-controller-manager-leader-lock	LeaderElection	kserve-controller-manager-776cc66d47-854p6_8c86c3bd-bf64-462c-a1dd-cc988bea1397 became leader
00:50:18	opendatahub	odh-model-controller-769875db56-lf7kc_68864d6e-5f70-4357-b6a2-77a641c4d1b2	odh-model-controller.opendatahub.io	LeaderElection	odh-model-controller-769875db56-lf7kc_68864d6e-5f70-4357-b6a2-77a641c4d1b2 became leader
00:50:18	opendatahub	kubelet	odh-model-controller-769875db56-lf7kc	Pulled	Successfully pulled image "quay.io/opendatahub/odh-model-controller@sha256:94f7f4383ef91d10d60d82c0858a60158a02915fdd3000d507210139faaac775" in 3.749s (3.749s including waiting). Image size: 236755567 bytes.
00:50:18	opendatahub	kubelet	odh-model-controller-769875db56-lf7kc	Started	Container started
00:50:18	opendatahub	kubelet	odh-model-controller-769875db56-lf7kc	Created	Container created
00:50:19	opendatahub	llmisvc-controller-manager-869d5dcc5d-j6vt5_44f5943b-bee4-4ef5-bb09-6a978579cfa7	llminferenceservice-kserve-controller-manager	LeaderElection	llmisvc-controller-manager-869d5dcc5d-j6vt5_44f5943b-bee4-4ef5-bb09-6a978579cfa7 became leader
00:50:28	opendatahub	kubelet	usage-logs-tenancy-proxy-9c5d49bcd-jv5l8	Pulled	Successfully pulled image "registry.redhat.io/ubi9/python-312@sha256:f6713d327d37e654a443752e6654b5aab88f31690e1161eed9c34dd837870172" in 27.419s (27.419s including waiting). Image size: 1089502687 bytes.
00:50:28	opendatahub	kubelet	usage-logs-tenancy-proxy-9c5d49bcd-jv5l8	Created	Container created
00:50:28	opendatahub	kubelet	usage-logs-tenancy-proxy-9c5d49bcd-jv5l8	Started	Container started
00:50:29	openshift-jobset-operator	cert-manager-certificates-key-manager	jobset-serving-cert	Generated	Stored new private key in temporary Secret resource "jobset-serving-cert-l7hs8"
00:50:29	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	IssuerCreated	Created Issuer.cert-manager.io/jobset-selfsigned-issuer -n openshift-jobset-operator because it was missing
00:50:29	openshift-jobset-operator	cert-manager-certificates-trigger	jobset-metrics-cert	Issuing	Issuing certificate as Secret does not exist
00:50:29	openshift-jobset-operator	cert-manager-certificates-key-manager	jobset-metrics-cert	Generated	Stored new private key in temporary Secret resource "jobset-metrics-cert-tv69d"
00:50:29	openshift-jobset-operator	cert-manager-certificates-trigger	jobset-serving-cert	Issuing	Issuing certificate as Secret does not exist
00:50:29	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	CertificateCreated	Created Certificate.cert-manager.io/jobset-metrics-cert -n openshift-jobset-operator because it was missing
00:50:29	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	CertificateCreated	Created Certificate.cert-manager.io/jobset-serving-cert -n openshift-jobset-operator because it was missing
00:50:30	openshift-jobset-operator	cert-manager-certificates-request-manager	jobset-serving-cert	Requested	Created new CertificateRequest resource "jobset-serving-cert-1"
00:50:30	openshift-jobset-operator	cert-manager-certificaterequests-issuer-selfsigned	jobset-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:50:30	openshift-jobset-operator	cert-manager-certificaterequests-approver	jobset-metrics-cert-1	cert-manager.io	Certificate request has been approved by cert-manager.io
00:50:30	openshift-jobset-operator	cert-manager-certificaterequests-issuer-venafi	jobset-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:50:30	openshift-jobset-operator	cert-manager-certificaterequests-issuer-vault	jobset-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:50:30	openshift-jobset-operator	cert-manager-certificaterequests-approver	jobset-serving-cert-1	cert-manager.io	Certificate request has been approved by cert-manager.io
00:50:30	openshift-jobset-operator	cert-manager-certificaterequests-issuer-selfsigned	jobset-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:50:30	openshift-jobset-operator	cert-manager-certificaterequests-issuer-ca	jobset-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:50:30	openshift-jobset-operator	cert-manager-certificaterequests-issuer-vault	jobset-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:50:30	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	ValidatingWebhookConfigurationCreated	Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it was missing
00:50:30	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	MutatingWebhookConfigurationCreated	Created MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it was missing
00:50:30	openshift-jobset-operator	cert-manager-certificaterequests-issuer-ca	jobset-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:50:30	openshift-jobset-operator	cert-manager-certificaterequests-issuer-venafi	jobset-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:50:30	openshift-jobset-operator	cert-manager-certificaterequests-issuer-selfsigned	jobset-serving-cert-1	CertificateIssued	Certificate fetched from issuer successfully
00:50:30	openshift-jobset-operator	cert-manager-certificaterequests-issuer-acme	jobset-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:50:30	openshift-jobset-operator	cert-manager-certificaterequests-issuer-acme	jobset-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
00:50:30	openshift-jobset-operator	cert-manager-certificates-request-manager	jobset-metrics-cert	Requested	Created new CertificateRequest resource "jobset-metrics-cert-1"
00:50:30	openshift-jobset-operator	cert-manager-certificates-issuing	jobset-serving-cert	Issuing	The certificate has been successfully issued
00:50:30	openshift-jobset-operator	cert-manager-certificaterequests-issuer-selfsigned	jobset-metrics-cert-1	CertificateIssued	Certificate fetched from issuer successfully
00:50:30	openshift-jobset-operator	cert-manager-certificates-issuing	jobset-metrics-cert	Issuing	The certificate has been successfully issued
00:50:31	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	CustomResourceDefinitionCreated	Created CustomResourceDefinition.apiextensions.k8s.io/jobsets.jobset.x-k8s.io because it was missing
00:50:31	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	ServiceMonitorCreated	Created ServiceMonitor.monitoring.coreos.com/jobset-controller-manager-metrics-monitor -n openshift-jobset-operator because it was missing
00:50:31	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	MutatingWebhookConfigurationUpdated	Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/jobset-mutating-webhook-configuration because it changed
00:50:31	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	ConfigMapCreated	Created ConfigMap/jobset-manager-config -n openshift-jobset-operator because it was missing
00:50:31	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing
00:50:31	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/jobset-prometheus-k8s -n openshift-jobset-operator because it was missing
00:50:31	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	ValidatingWebhookConfigurationUpdated	Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/jobset-validating-webhook-configuration because it changed
00:50:31	openshift-jobset-operator	openshift-jobset-operator	jobset-operator	DeploymentCreated	Created Deployment.apps/jobset-controller-manager -n openshift-jobset-operator because it was missing
00:50:31	openshift-jobset-operator	replicaset-controller	jobset-controller-manager-77c8d68c5b	SuccessfulCreate	Created pod: jobset-controller-manager-77c8d68c5b-99dcw
00:50:31	openshift-jobset-operator	deployment-controller	jobset-controller-manager	ScalingReplicaSet	Scaled up replica set jobset-controller-manager-77c8d68c5b from 0 to 1
00:50:32	openshift-jobset-operator	kubelet	jobset-controller-manager-77c8d68c5b-99dcw	Pulling	Pulling image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987"
00:50:32	openshift-jobset-operator	multus	jobset-controller-manager-77c8d68c5b-99dcw	AddedInterface	Add eth0 [10.133.0.27/23] from ovn-kubernetes
00:50:35	openshift-jobset-operator	jobset-controller-manager-77c8d68c5b-99dcw_659766c6-56c6-422e-abfe-3be8aec29e72	6d4f6a47.jobset.x-k8s.io	LeaderElection	jobset-controller-manager-77c8d68c5b-99dcw_659766c6-56c6-422e-abfe-3be8aec29e72 became leader
00:50:35	openshift-jobset-operator	kubelet	jobset-controller-manager-77c8d68c5b-99dcw	Started	Container started
00:50:35	openshift-jobset-operator	kubelet	jobset-controller-manager-77c8d68c5b-99dcw	Created	Container created
00:50:35	openshift-jobset-operator	kubelet	jobset-controller-manager-77c8d68c5b-99dcw	Pulled	Successfully pulled image "registry.redhat.io/job-set/jobset-rhel9@sha256:8d2a70fe90b2414cdb269d217703b7e5b3409f9276acf671721b1abc67a0b987" in 3.057s (3.057s including waiting). Image size: 182184678 bytes.
00:50:36 (x5)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:50:36 (x5)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:50:42	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled down replica set authorino-6889cbd8c4 from 1 to 0
00:50:42	kuadrant-system	replicaset-controller	authorino-6f6944bcdd	SuccessfulCreate	Created pod: authorino-6f6944bcdd-dhh88
00:50:42	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-5bf5444bb8 from 0 to 1
00:50:42	kuadrant-system	kubelet	authorino-6f6944bcdd-dhh88	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
00:50:42	kuadrant-system	multus	authorino-6f6944bcdd-dhh88	AddedInterface	Add eth0 [10.134.0.36/23] from ovn-kubernetes
00:50:42	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-6889cbd8c4 from 0 to 1
00:50:42	kuadrant-system	replicaset-controller	authorino-6889cbd8c4	SuccessfulDelete	Deleted pod: authorino-6889cbd8c4-4dd5x
00:50:42	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled down replica set authorino-6f6944bcdd from 1 to 0
00:50:42	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-6f6944bcdd from 0 to 1
00:50:42	kuadrant-system	replicaset-controller	authorino-6889cbd8c4	SuccessfulCreate	Created pod: authorino-6889cbd8c4-4dd5x
00:50:42	kuadrant-system	replicaset-controller	authorino-5bf5444bb8	SuccessfulCreate	Created pod: authorino-5bf5444bb8-jhbtp
00:50:42	kuadrant-system	replicaset-controller	authorino-6f6944bcdd	SuccessfulDelete	Deleted pod: authorino-6f6944bcdd-dhh88
00:50:43	kuadrant-system	multus	authorino-5bf5444bb8-jhbtp	AddedInterface	Add eth0 [10.132.0.46/23] from ovn-kubernetes
00:50:43	kuadrant-system	kubelet	authorino-6f6944bcdd-dhh88	Started	Container started
00:50:43	kuadrant-system	kubelet	authorino-5bf5444bb8-jhbtp	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
00:50:43	kuadrant-system	kubelet	authorino-6f6944bcdd-dhh88	Created	Container created
00:50:43 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-cc9wb	Created	Container created
00:50:43 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-cc9wb	Started	Container started
00:50:43	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-cc9wb	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:50:43	kuadrant-system	kubelet	authorino-6f6944bcdd-dhh88	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 761ms (761ms including waiting). Image size: 204096810 bytes.
00:50:44	kuadrant-system	replicaset-controller	authorino-56c6c9ddd5	SuccessfulDelete	Deleted pod: authorino-56c6c9ddd5-6t8v7
00:50:44	kuadrant-system	kubelet	authorino-5bf5444bb8-jhbtp	Started	Container started
00:50:44	kuadrant-system	kubelet	authorino-6f6944bcdd-dhh88	Killing	Stopping container authorino
00:50:44	kuadrant-system	kubelet	authorino-5bf5444bb8-jhbtp	Created	Container created
00:50:44	kuadrant-system	kubelet	authorino-5bf5444bb8-jhbtp	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 829ms (829ms including waiting). Image size: 204096810 bytes.
00:50:44	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled down replica set authorino-56c6c9ddd5 from 1 to 0
00:50:44	kuadrant-system	kubelet	authorino-56c6c9ddd5-6t8v7	Killing	Stopping container authorino
00:50:49 (x5)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-cc9wb	Unhealthy	Startup probe failed: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused
00:50:49 (x5)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-cc9wb	ProbeError	Startup probe error: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused body:
00:50:51	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:50:51	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
00:51:05	opendatahub	deployment-controller	llmisvc-controller-manager	ScalingReplicaSet	Scaled up replica set llmisvc-controller-manager-6466c554d8 from 0 to 1
00:51:05	opendatahub	replicaset-controller	llmisvc-controller-manager-6466c554d8	SuccessfulCreate	Created pod: llmisvc-controller-manager-6466c554d8-4hcnc
00:51:06	opendatahub	kubelet	llmisvc-controller-manager-6466c554d8-4hcnc	Pulling	Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321"
00:51:06	opendatahub	multus	llmisvc-controller-manager-6466c554d8-4hcnc	AddedInterface	Add eth0 [10.132.0.47/23] from ovn-kubernetes
00:51:06	opendatahub	kubelet	llmisvc-controller-manager-6466c554d8-4hcnc	Created	Container created
00:51:06	opendatahub	kubelet	llmisvc-controller-manager-6466c554d8-4hcnc	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller@sha256:be3760deb2e1570f182db0819a98b4cebd1de04de25b8c9bdd0b38396f0be321" in 340ms (340ms including waiting). Image size: 235100981 bytes.
00:51:07	opendatahub	kubelet	llmisvc-controller-manager-6466c554d8-4hcnc	Started	Container started
00:51:12 (x3)	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:51:12 (x3)	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
00:51:38	opendatahub	deployment-controller	llmisvc-controller-manager	ScalingReplicaSet	Scaled down replica set llmisvc-controller-manager-869d5dcc5d from 1 to 0
00:51:38	opendatahub	replicaset-controller	llmisvc-controller-manager-869d5dcc5d	SuccessfulDelete	Deleted pod: llmisvc-controller-manager-869d5dcc5d-j6vt5
00:51:38	opendatahub	kubelet	llmisvc-controller-manager-869d5dcc5d-j6vt5	Killing	Stopping container manager
00:51:40	opendatahub	replicaset-controller	ai-gateway-controller-7d85675f98	SuccessfulCreate	Created pod: ai-gateway-controller-7d85675f98-q5z9m
00:51:40	opendatahub	multus	ai-gateway-controller-7d85675f98-q5z9m	AddedInterface	Add eth0 [10.134.0.37/23] from ovn-kubernetes
00:51:40	opendatahub	deployment-controller	ai-gateway-controller	ScalingReplicaSet	Scaled up replica set ai-gateway-controller-7d85675f98 from 0 to 1
00:51:40	opendatahub	kubelet	ai-gateway-controller-7d85675f98-q5z9m	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"
00:51:42	opendatahub	kubelet	ai-gateway-controller-7d85675f98-q5z9m	Started	Container started
00:51:42	opendatahub	ai-gateway-controller-7d85675f98-q5z9m_5cd72253-2f5f-42b2-9b1c-13c605a660df	ai-gateway-controller-leader.opendatahub.io	LeaderElection	ai-gateway-controller-7d85675f98-q5z9m_5cd72253-2f5f-42b2-9b1c-13c605a660df became leader
00:51:42	opendatahub	kubelet	ai-gateway-controller-7d85675f98-q5z9m	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 1.467s (1.467s including waiting). Image size: 183888297 bytes.
00:51:42	opendatahub	kubelet	ai-gateway-controller-7d85675f98-q5z9m	Created	Container created
00:51:43	openshift-ingress	deployment-controller	payload-pre-processing	ScalingReplicaSet	Scaled up replica set payload-pre-processing-7b98bb678c from 0 to 1
00:51:43	openshift-ingress	replicaset-controller	payload-processing-5f78687d5b	SuccessfulCreate	Created pod: payload-processing-5f78687d5b-f66cv
00:51:43	openshift-ingress	deployment-controller	payload-processing	ScalingReplicaSet	Scaled up replica set payload-processing-5f78687d5b from 0 to 1
00:51:43 (x5)	openshift-ingress	replicaset-controller	payload-pre-processing-7b98bb678c	FailedCreate	Error creating: pods "payload-pre-processing-7b98bb678c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
00:51:43 (x5)	openshift-ingress	replicaset-controller	payload-processing-5f78687d5b	FailedCreate	Error creating: pods "payload-processing-5f78687d5b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
00:51:43	openshift-ingress	replicaset-controller	payload-pre-processing-7b98bb678c	SuccessfulCreate	Created pod: payload-pre-processing-7b98bb678c-r44xg
00:51:44	openshift-ingress	multus	payload-pre-processing-7b98bb678c-r44xg	AddedInterface	Add eth0 [10.134.0.39/23] from ovn-kubernetes
00:51:44	openshift-ingress	kubelet	payload-pre-processing-7b98bb678c-r44xg	Pulling	Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
00:51:44	openshift-ingress	multus	payload-processing-5f78687d5b-f66cv	AddedInterface	Add eth0 [10.134.0.38/23] from ovn-kubernetes
00:51:44	openshift-ingress	kubelet	payload-processing-5f78687d5b-f66cv	Pulling	Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"
00:51:46	openshift-ingress	kubelet	payload-processing-5f78687d5b-f66cv	Pulled	Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.083s (2.083s including waiting). Image size: 125317101 bytes.
00:51:46	openshift-ingress	kubelet	payload-pre-processing-7b98bb678c-r44xg	Started	Container started
00:51:46	openshift-ingress	kubelet	payload-processing-5f78687d5b-f66cv	Created	Container created
00:51:46	openshift-ingress	kubelet	payload-processing-5f78687d5b-f66cv	Started	Container started
00:51:46	openshift-ingress	kubelet	payload-pre-processing-7b98bb678c-r44xg	Pulled	Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.031s (2.031s including waiting). Image size: 125317101 bytes.
00:51:46	openshift-ingress	kubelet	payload-pre-processing-7b98bb678c-r44xg	Created	Container created
00:51:54	opendatahub	replicaset-controller	ai-gateway-controller-7c7f5657cd	SuccessfulCreate	Created pod: ai-gateway-controller-7c7f5657cd-bl5c9
00:51:54	opendatahub	deployment-controller	ai-gateway-controller	ScalingReplicaSet	Scaled up replica set ai-gateway-controller-7c7f5657cd from 0 to 1
00:51:54	opendatahub	kubelet	ai-gateway-controller-7c7f5657cd-bl5c9	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-controller:latest"
00:51:54	opendatahub	multus	ai-gateway-controller-7c7f5657cd-bl5c9	AddedInterface	Add eth0 [10.134.0.40/23] from ovn-kubernetes
00:51:54	opendatahub	llmisvc-controller-manager-6466c554d8-4hcnc_7cc324cd-9e19-4ba4-9cb5-f80ed601d942	llminferenceservice-kserve-controller-manager	LeaderElection	llmisvc-controller-manager-6466c554d8-4hcnc_7cc324cd-9e19-4ba4-9cb5-f80ed601d942 became leader
00:51:55	opendatahub	kubelet	ai-gateway-controller-7c7f5657cd-bl5c9	Created	Container created
00:51:55	opendatahub	kubelet	ai-gateway-controller-7c7f5657cd-bl5c9	Started	Container started
00:51:55	opendatahub	kubelet	ai-gateway-controller-7c7f5657cd-bl5c9	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-controller:latest" in 357ms (357ms including waiting). Image size: 183888297 bytes.
00:52:07	opendatahub	kubelet	ai-gateway-controller-7d85675f98-q5z9m	Killing	Stopping container manager
00:52:07	opendatahub	replicaset-controller	ai-gateway-controller-7d85675f98	SuccessfulDelete	Deleted pod: ai-gateway-controller-7d85675f98-q5z9m
00:52:07	opendatahub	deployment-controller	ai-gateway-controller	ScalingReplicaSet	Scaled down replica set ai-gateway-controller-7d85675f98 from 1 to 0
00:52:14	llm	deployment-controller	e2e-distinct-2-simulated-kserve	ScalingReplicaSet	Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1
00:52:14	llm	LLMInferenceServiceController	e2e-distinct-2-simulated	Created	Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs
00:52:14	llm	LLMInferenceServiceController	e2e-distinct-2-simulated	Created	Created v1.Deployment llm/e2e-distinct-2-simulated-kserve
00:52:14	llm	LLMInferenceServiceController	e2e-distinct-2-simulated	Created	Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc
00:52:14	llm	LLMInferenceServiceController	e2e-distinct-2-simulated	Created	Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route
00:52:14	llm	LLMInferenceServiceController	e2e-distinct-2-simulated	Created	Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc
00:52:14	llm	replicaset-controller	e2e-distinct-2-simulated-kserve-cbd4f5586	SuccessfulCreate	Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-xncfg
00:52:15	llm	LLMInferenceServiceController	e2e-distinct-2-simulated	Created	Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine
00:52:15	llm	LLMInferenceServiceController	e2e-distinct-2-simulated	Created	Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping
00:52:15	llm	kubelet	e2e-distinct-2-simulated-kserve-cbd4f5586-xncfg	Pulling	Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"
00:52:15	llm	LLMInferenceServiceController	e2e-distinct-2-simulated	Created	Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default
00:52:15	llm	multus	e2e-distinct-2-simulated-kserve-cbd4f5586-xncfg	AddedInterface	Add eth0 [10.134.0.41/23] from ovn-kubernetes
00:52:16	llm	kubelet	e2e-distinct-2-simulated-kserve-cbd4f5586-xncfg	Started	Container started
00:52:16	llm	kubelet	e2e-distinct-2-simulated-kserve-cbd4f5586-xncfg	Created	Container created
00:52:16	llm	kubelet	e2e-distinct-2-simulated-kserve-cbd4f5586-xncfg	Pulled	Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.044s (1.044s including waiting). Image size: 98346788 bytes.
00:52:19	llm	replicaset-controller	e2e-distinct-simulated-kserve-7b998b79d9	SuccessfulCreate	Created pod: e2e-distinct-simulated-kserve-7b998b79d9-m5ct6
00:52:19	llm	deployment-controller	e2e-distinct-simulated-kserve	ScalingReplicaSet	Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1
00:52:19	llm	LLMInferenceServiceController	e2e-distinct-simulated	Created	Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs
00:52:19	llm	LLMInferenceServiceController	e2e-distinct-simulated	Created	Created v1.Deployment llm/e2e-distinct-simulated-kserve
00:52:19	llm	LLMInferenceServiceController	e2e-distinct-simulated	Created	Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc
00:52:19	llm	LLMInferenceServiceController	e2e-distinct-simulated	Created	Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default
00:52:19	llm	LLMInferenceServiceController	e2e-distinct-simulated	Created	Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine
00:52:19	llm	LLMInferenceServiceController	e2e-distinct-simulated	Created	Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc
00:52:19	llm	LLMInferenceServiceController	e2e-distinct-simulated	Created	Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route
00:52:20	llm	LLMInferenceServiceController	e2e-distinct-simulated	Created	Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping
00:52:20	llm	multus	e2e-distinct-simulated-kserve-7b998b79d9-m5ct6	AddedInterface	Add eth0 [10.134.0.42/23] from ovn-kubernetes
00:52:20	llm	kubelet	e2e-distinct-simulated-kserve-7b998b79d9-m5ct6	Pulling	Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"
00:52:20	llm	kubelet	e2e-distinct-simulated-kserve-7b998b79d9-m5ct6	Pulled	Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 191ms (191ms including waiting). Image size: 98346788 bytes.
00:52:20	llm	kubelet	e2e-distinct-simulated-kserve-7b998b79d9-m5ct6	Created	Container created
00:52:20	llm	kubelet	e2e-distinct-simulated-kserve-7b998b79d9-m5ct6	Started	Container started
00:52:21	llm	LLMInferenceServiceController	e2e-embedding-simulated	Created	Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping
00:52:21	llm	kubelet	e2e-embedding-simulated-kserve-67bf594cd6-kxbzp	Pulling	Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"
00:52:21	llm	replicaset-controller	e2e-embedding-simulated-kserve-67bf594cd6	SuccessfulCreate	Created pod: e2e-embedding-simulated-kserve-67bf594cd6-kxbzp
00:52:21	llm	deployment-controller	e2e-embedding-simulated-kserve	ScalingReplicaSet	Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1
00:52:21	llm	LLMInferenceServiceController	e2e-embedding-simulated	Created	Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs
00:52:21	llm	LLMInferenceServiceController	e2e-embedding-simulated	Created	Created v1.Deployment llm/e2e-embedding-simulated-kserve
00:52:21	llm	LLMInferenceServiceController	e2e-embedding-simulated	Created	Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc
00:52:21	llm	LLMInferenceServiceController	e2e-embedding-simulated	Created	Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route
00:52:21	llm	LLMInferenceServiceController	e2e-embedding-simulated	Created	Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc
00:52:21	llm	LLMInferenceServiceController	e2e-embedding-simulated	Created	Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default
00:52:21	llm	LLMInferenceServiceController	e2e-embedding-simulated	Created	Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine
00:52:21	llm	multus	e2e-embedding-simulated-kserve-67bf594cd6-kxbzp	AddedInterface	Add eth0 [10.133.0.28/23] from ovn-kubernetes
00:52:22	llm	replicaset-controller	e2e-trlp-test-simulated-kserve-69b588897d	SuccessfulCreate	Created pod: e2e-trlp-test-simulated-kserve-69b588897d-9chq6
00:52:22	llm	LLMInferenceServiceController	e2e-trlp-test-simulated	Created	Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc
00:52:22	llm	kubelet	e2e-embedding-simulated-kserve-67bf594cd6-kxbzp	Started	Container started
00:52:22	llm	kubelet	e2e-embedding-simulated-kserve-67bf594cd6-kxbzp	Pulled	Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.042s (1.042s including waiting). Image size: 98346788 bytes.
00:52:22	llm	kubelet	e2e-embedding-simulated-kserve-67bf594cd6-kxbzp	Created	Container created
00:52:22	llm	LLMInferenceServiceController	e2e-trlp-test-simulated	Created	Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route
00:52:22	llm	LLMInferenceServiceController	e2e-trlp-test-simulated	Created	Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc
00:52:22	llm	LLMInferenceServiceController	e2e-trlp-test-simulated	Created	Created v1.Deployment llm/e2e-trlp-test-simulated-kserve
00:52:22	llm	deployment-controller	e2e-trlp-test-simulated-kserve	ScalingReplicaSet	Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1
00:52:22	llm	LLMInferenceServiceController	e2e-trlp-test-simulated	Created	Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs
00:52:23	llm	kubelet	e2e-trlp-test-simulated-kserve-69b588897d-9chq6	Created	Container created
00:52:23	llm	kubelet	e2e-trlp-test-simulated-kserve-69b588897d-9chq6	Pulled	Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 176ms (176ms including waiting). Image size: 98346788 bytes.
00:52:23	llm	kubelet	e2e-trlp-test-simulated-kserve-69b588897d-9chq6	Pulling	Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"
00:52:23	llm	multus	e2e-trlp-test-simulated-kserve-69b588897d-9chq6	AddedInterface	Add eth0 [10.134.0.43/23] from ovn-kubernetes
00:52:23	llm	kubelet	e2e-trlp-test-simulated-kserve-69b588897d-9chq6	Started	Container started
00:52:23	llm	LLMInferenceServiceController	e2e-trlp-test-simulated	Created	Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default
00:52:23	llm	LLMInferenceServiceController	e2e-trlp-test-simulated	Created	Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine
00:52:23	llm	LLMInferenceServiceController	e2e-trlp-test-simulated	Created	Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping
00:52:26	llm	kubelet	e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m87ct	Started	Container started
00:52:26	llm	multus	e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m87ct	AddedInterface	Add eth0 [10.133.0.29/23] from ovn-kubernetes
00:52:26	llm	kubelet	e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m87ct	Pulling	Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"
00:52:26	llm	kubelet	e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m87ct	Pulled	Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 192ms (192ms including waiting). Image size: 98346788 bytes.
00:52:26	llm	kubelet	e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m87ct	Created	Container created
00:52:26	llm	replicaset-controller	e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc	SuccessfulCreate	Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8m87ct
00:52:26	llm	deployment-controller	e2e-unconfigured-facebook-opt-125m-simulated-kserve	ScalingReplicaSet	Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1
00:52:26	llm	LLMInferenceServiceController	e2e-unconfigured-facebook-opt-125m-simulated	Created	Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs
00:52:26	llm	LLMInferenceServiceController	e2e-unconfigured-facebook-opt-125m-simulated	Created	Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve
00:52:26	llm	LLMInferenceServiceController	e2e-unconfigured-facebook-opt-125m-simulated	Created	Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc
00:52:26	llm	LLMInferenceServiceController	e2e-unconfigured-facebook-opt-125m-simulated	Created	Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route
00:52:26	llm	LLMInferenceServiceController	e2e-unconfigured-facebook-opt-125m-simulated	Created	Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc
00:52:26	llm	LLMInferenceServiceController	e2e-unconfigured-facebook-opt-125m-simulated	Created	Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default
00:52:26	llm	LLMInferenceServiceController	e2e-unconfigured-facebook-opt-125m-simulated	Created	Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine
00:52:26	llm	LLMInferenceServiceController	e2e-unconfigured-facebook-opt-125m-simulated	Created	Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping
00:52:27	llm	LLMInferenceServiceController	echo-simulator	Created	Created v1.Secret llm/echo-simulator-kserve-self-signed-certs
00:52:27	llm	LLMInferenceServiceController	echo-simulator	Created	Created v1.Deployment llm/echo-simulator-kserve
00:52:27	llm	LLMInferenceServiceController	echo-simulator	Created	Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine
00:52:27	llm	LLMInferenceServiceController	echo-simulator	Created	Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default
00:52:27	llm	LLMInferenceServiceController	echo-simulator	Created	Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc
00:52:27	llm	LLMInferenceServiceController	echo-simulator	Created	Created v1.HTTPRoute llm/echo-simulator-kserve-route
00:52:27	llm	replicaset-controller	echo-simulator-kserve-64b6f8f96c	SuccessfulCreate	Created pod: echo-simulator-kserve-64b6f8f96c-7rfxq
00:52:27	llm	deployment-controller	echo-simulator-kserve	ScalingReplicaSet	Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1
00:52:27	llm	LLMInferenceServiceController	echo-simulator	Created	Created v1.Service llm/echo-simulator-kserve-workload-svc
00:52:28	llm	LLMInferenceServiceController	echo-simulator	Created	Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping
00:52:28	opendatahub	ai-gateway-controller-7c7f5657cd-bl5c9_884acb03-865a-431d-8ea2-0c310e50c98d	ai-gateway-controller-leader.opendatahub.io	LeaderElection	ai-gateway-controller-7c7f5657cd-bl5c9_884acb03-865a-431d-8ea2-0c310e50c98d became leader
00:52:28	llm	kubelet	echo-simulator-kserve-64b6f8f96c-7rfxq	Pulling	Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0"
00:52:28	llm	multus	echo-simulator-kserve-64b6f8f96c-7rfxq	AddedInterface	Add eth0 [10.134.0.44/23] from ovn-kubernetes
00:52:29	llm	kubelet	echo-simulator-kserve-64b6f8f96c-7rfxq	Started	Container started
00:52:29	llm	kubelet	echo-simulator-kserve-64b6f8f96c-7rfxq	Created	Container created
00:52:29	llm	kubelet	echo-simulator-kserve-64b6f8f96c-7rfxq	Pulled	Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.637s (1.637s including waiting). Image size: 78208878 bytes.
00:52:30	llm	LLMInferenceServiceController	facebook-opt-125m-simulated	Created	Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc
00:52:30	llm	LLMInferenceServiceController	facebook-opt-125m-simulated	Created	Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route
00:52:30	llm	LLMInferenceServiceController	facebook-opt-125m-simulated	Created	Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc
00:52:30	llm	LLMInferenceServiceController	facebook-opt-125m-simulated	Created	Created v1.Deployment llm/facebook-opt-125m-simulated-kserve
00:52:30	llm	LLMInferenceServiceController	facebook-opt-125m-simulated	Created	Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs
00:52:30	llm	replicaset-controller	facebook-opt-125m-simulated-kserve-84b4ff656c	SuccessfulCreate	Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-hmwp9
00:52:30	llm	deployment-controller	facebook-opt-125m-simulated-kserve	ScalingReplicaSet	Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1
00:52:31	llm	kubelet	facebook-opt-125m-simulated-kserve-84b4ff656c-hmwp9	Started	Container started
00:52:31	llm	kubelet	facebook-opt-125m-simulated-kserve-84b4ff656c-hmwp9	Created	Container created
00:52:31	llm	multus	facebook-opt-125m-simulated-kserve-84b4ff656c-hmwp9	AddedInterface	Add eth0 [10.133.0.30/23] from ovn-kubernetes
00:52:31	llm	kubelet	facebook-opt-125m-simulated-kserve-84b4ff656c-hmwp9	Pulling	Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"
00:52:31	llm	kubelet	facebook-opt-125m-simulated-kserve-84b4ff656c-hmwp9	Pulled	Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 201ms (201ms including waiting). Image size: 98346788 bytes.
00:52:31	llm	LLMInferenceServiceController	facebook-opt-125m-simulated	Created	Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default
00:52:31	llm	LLMInferenceServiceController	facebook-opt-125m-simulated	Created	Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine
00:52:31	llm	LLMInferenceServiceController	facebook-opt-125m-simulated	Created	Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping
00:52:32	llm	LLMInferenceServiceController	premium-simulated-simulated-premium	Created	Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc
00:52:32	llm	LLMInferenceServiceController	premium-simulated-simulated-premium	Created	Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs
00:52:32	llm	LLMInferenceServiceController	premium-simulated-simulated-premium	Created	Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default
00:52:32	llm	LLMInferenceServiceController	premium-simulated-simulated-premium	Created	Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine
00:52:32	llm	multus	premium-simulated-simulated-premium-kserve-5f5c4b459f-g6qgc	AddedInterface	Add eth0 [10.134.0.45/23] from ovn-kubernetes
00:52:32	llm	kubelet	premium-simulated-simulated-premium-kserve-5f5c4b459f-g6qgc	Pulling	Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"
00:52:32	llm	LLMInferenceServiceController	premium-simulated-simulated-premium	Created	Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping
00:52:32	llm	LLMInferenceServiceController	premium-simulated-simulated-premium	Created	Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route
00:52:32	llm	LLMInferenceServiceController	premium-simulated-simulated-premium	Created	Created v1.Deployment llm/premium-simulated-simulated-premium-kserve
00:52:32	llm	LLMInferenceServiceController	premium-simulated-simulated-premium	Created	Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc
00:52:32	llm	deployment-controller	premium-simulated-simulated-premium-kserve	ScalingReplicaSet	Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1
00:52:32	llm	replicaset-controller	premium-simulated-simulated-premium-kserve-5f5c4b459f	SuccessfulCreate	Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-g6qgc
00:52:33	llm	kubelet	premium-simulated-simulated-premium-kserve-5f5c4b459f-g6qgc	Started	Container started
00:52:33	llm	kubelet	premium-simulated-simulated-premium-kserve-5f5c4b459f-g6qgc	Created	Container created
00:52:33	llm	kubelet	premium-simulated-simulated-premium-kserve-5f5c4b459f-g6qgc	Pulled	Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 207ms (207ms including waiting). Image size: 98346788 bytes.
00:52:40	llm	LLMInferenceServiceController	e2e-distinct-2-simulated	LLMInferenceServiceReady	LLMInferenceService [e2e-distinct-2-simulated] is Ready
00:52:40 (x2)	llm	LLMInferenceServiceController	e2e-distinct-2-simulated	Updated	Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs
00:52:41	llm	LLMInferenceServiceController	e2e-distinct-simulated	Updated	Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs
00:52:42	llm	LLMInferenceServiceController	e2e-distinct-simulated	LLMInferenceServiceReady	LLMInferenceService [e2e-distinct-simulated] is Ready
00:52:43	llm	LLMInferenceServiceController	e2e-embedding-simulated	Updated	Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs
00:52:43	openshift-ingress	multus	maas-default-gateway-openshift-default-9f5889779-nr6rk	AddedInterface	Add eth0 [10.133.0.31/23] from ovn-kubernetes
00:52:43	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-7b2vr	Created	Container created
00:52:43	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-9f5889779-nr6rk
00:52:43	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-9f5889779-2s7rm
00:52:43	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-2s7rm	Started	Container started
00:52:43	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-2s7rm	Created	Container created
00:52:43	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 4; reason: cpu resource utilization (percentage of request) above target
00:52:43	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-nr6rk	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55"
00:52:43	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-9f5889779-7b2vr
00:52:43	openshift-ingress	multus	maas-default-gateway-openshift-default-9f5889779-2s7rm	AddedInterface	Add eth0 [10.132.0.48/23] from ovn-kubernetes
00:52:43	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-2s7rm	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:52:43	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-9f5889779 from 1 to 4
00:52:43	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-7b2vr	Started	Container started
00:52:43	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-7b2vr	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:52:43	openshift-ingress	multus	maas-default-gateway-openshift-default-9f5889779-7b2vr	AddedInterface	Add eth0 [10.134.0.46/23] from ovn-kubernetes
00:52:44	llm	LLMInferenceServiceController	e2e-embedding-simulated	LLMInferenceServiceReady	LLMInferenceService [e2e-embedding-simulated] is Ready
00:52:45	llm	LLMInferenceServiceController	e2e-trlp-test-simulated	LLMInferenceServiceReady	LLMInferenceService [e2e-trlp-test-simulated] is Ready
00:52:45	llm	LLMInferenceServiceController	e2e-trlp-test-simulated	Updated	Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs
00:52:46	llm	LLMInferenceServiceController	e2e-unconfigured-facebook-opt-125m-simulated	LLMInferenceServiceReady	LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready
00:52:46	llm	LLMInferenceServiceController	e2e-unconfigured-facebook-opt-125m-simulated	Updated	Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs
00:52:47	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-nr6rk	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" in 3.875s (3.875s including waiting). Image size: 183555333 bytes.
00:52:47	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-nr6rk	Created	Container created
00:52:47	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-nr6rk	Started	Container started
00:52:48	llm	LLMInferenceServiceController	echo-simulator	LLMInferenceServiceReady	LLMInferenceService [echo-simulator] is Ready
00:52:48	llm	LLMInferenceServiceController	echo-simulator	Updated	Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs
00:52:50	llm	LLMInferenceServiceController	facebook-opt-125m-simulated	Updated	Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs
00:52:50 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-2s7rm	ProbeError	Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
00:52:50 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-7b2vr	Unhealthy	Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
00:52:50 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-7b2vr	ProbeError	Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
00:52:50 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-2s7rm	Unhealthy	Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
00:52:50	llm	LLMInferenceServiceController	facebook-opt-125m-simulated	LLMInferenceServiceReady	LLMInferenceService [facebook-opt-125m-simulated] is Ready
00:52:52	llm	LLMInferenceServiceController	premium-simulated-simulated-premium	LLMInferenceServiceReady	LLMInferenceService [premium-simulated-simulated-premium] is Ready
00:52:52	llm	LLMInferenceServiceController	premium-simulated-simulated-premium	Updated	Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs
00:52:54 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-nr6rk	ProbeError	Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused body:
00:52:54 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-nr6rk	Unhealthy	Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused
00:52:58	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-s98m2	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:52:58	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-s98m2	Started	Container started
00:52:58	openshift-ingress	multus	maas-default-gateway-openshift-default-9f5889779-fx5lx	AddedInterface	Add eth0 [10.133.0.32/23] from ovn-kubernetes
00:52:58	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-fx5lx	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:52:58	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-9f5889779-r7mwn
00:52:58	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-9f5889779-2d4d4
00:52:58	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-9f5889779-fx5lx
00:52:58	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-9f5889779-s98m2
00:52:58	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-fx5lx	Created	Container created
00:52:58	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 8; reason:
00:52:58	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-9f5889779 from 4 to 8
00:52:58	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-fx5lx	Started	Container started
00:52:58	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-2d4d4	Started	Container started
00:52:58	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-2d4d4	Created	Container created
00:52:58	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-2d4d4	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:52:58	openshift-ingress	multus	maas-default-gateway-openshift-default-9f5889779-2d4d4	AddedInterface	Add eth0 [10.134.0.47/23] from ovn-kubernetes
00:52:58	openshift-ingress	multus	maas-default-gateway-openshift-default-9f5889779-r7mwn	AddedInterface	Add eth0 [10.132.0.50/23] from ovn-kubernetes
00:52:58	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-r7mwn	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:52:58	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-r7mwn	Created	Container created
00:52:58	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-r7mwn	Started	Container started
00:52:58	openshift-ingress	multus	maas-default-gateway-openshift-default-9f5889779-s98m2	AddedInterface	Add eth0 [10.132.0.49/23] from ovn-kubernetes
00:52:58	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-s98m2	Created	Container created
00:53:05 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-fx5lx	ProbeError	Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
00:53:05 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-r7mwn	Unhealthy	Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
00:53:05 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-s98m2	ProbeError	Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
00:53:05 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-2d4d4	Unhealthy	Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
00:53:05 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-s98m2	Unhealthy	Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
00:53:05 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-fx5lx	Unhealthy	Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
00:53:05 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-2d4d4	ProbeError	Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
00:53:05 (x7)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-r7mwn	ProbeError	Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
00:53:13	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-9f5889779-dl6pw
00:53:13	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulCreate	(combined from similar events): Created pod: maas-default-gateway-openshift-default-9f5889779-wqw48
00:53:13	openshift-ingress	multus	maas-default-gateway-openshift-default-9f5889779-dl6pw	AddedInterface	Add eth0 [10.133.0.33/23] from ovn-kubernetes
00:53:13	openshift-ingress	multus	maas-default-gateway-openshift-default-9f5889779-wqw48	AddedInterface	Add eth0 [10.134.0.48/23] from ovn-kubernetes
00:53:13	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-dl6pw	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:53:13	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-wqw48	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:1fc05d17a76d31503f68c5bde3057750a2c575981535756112c06589f88c8c55" already present on machine and can be accessed by the pod
00:53:13	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-wqw48	Created	Container created
00:53:13	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-wqw48	Started	Container started
00:53:13	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 10; reason:
00:53:13	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-dl6pw	Created	Container created
00:53:13	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-dl6pw	Started	Container started
00:53:13	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-9f5889779 from 8 to 10
00:53:20 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-dl6pw	ProbeError	Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
00:53:20 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-dl6pw	Unhealthy	Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
00:53:20 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-wqw48	Unhealthy	Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
00:53:20 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-wqw48	ProbeError	Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
00:57:43	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-2d4d4	Killing	Stopping container istio-proxy
00:57:43	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-wqw48	Killing	Stopping container istio-proxy
00:57:43	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 8; reason: All metrics below target
00:57:43	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-9f5889779-2d4d4
00:57:43	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled down replica set maas-default-gateway-openshift-default-9f5889779 from 10 to 8
00:57:43	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-9f5889779-wqw48
00:58:28	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-9f5889779-nr6rk
00:58:28	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-s98m2	Killing	Stopping container istio-proxy
00:58:28	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-fx5lx	Killing	Stopping container istio-proxy
00:58:28	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-2s7rm	Killing	Stopping container istio-proxy
00:58:28	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-r7mwn	Killing	Stopping container istio-proxy
00:58:28	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 2; reason: All metrics below target
00:58:28	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-9f5889779-s98m2
00:58:28	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-dl6pw	Killing	Stopping container istio-proxy
00:58:28	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-9f5889779-fx5lx
00:58:28	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled down replica set maas-default-gateway-openshift-default-9f5889779 from 8 to 2
00:58:28	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-9f5889779-2s7rm
00:58:28	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-9f5889779-dl6pw
00:58:28	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-nr6rk	Killing	Stopping container istio-proxy
00:58:28	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-9f5889779-r7mwn
00:58:43	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-9f5889779	SuccessfulDelete	Deleted pod: maas-default-gateway-openshift-default-9f5889779-7b2vr
00:58:43	openshift-ingress	kubelet	maas-default-gateway-openshift-default-9f5889779-7b2vr	Killing	Stopping container istio-proxy
00:58:43	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled down replica set maas-default-gateway-openshift-default-9f5889779 from 2 to 1
00:58:43	openshift-ingress	horizontal-pod-autoscaler	maas-default-gateway-openshift-default	SuccessfulRescale	New size: 1; reason: All metrics below target