Events

Time	Namespace	Component	RelatedObject	Reason	Message
23:25:26	opendatahub		test-curl-7850-9dba10	Scheduled	Successfully assigned opendatahub/test-curl-7850-9dba10 to ip-10-0-133-222.ec2.internal
23:06:44	kube-system		konnectivity-agent-5xj9x	Scheduled	Successfully assigned kube-system/konnectivity-agent-5xj9x to ip-10-0-140-44.ec2.internal
23:11:28	openshift-ingress		kube-auth-proxy-65f4688f79-k7p9x	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-65f4688f79-k7p9x to ip-10-0-140-44.ec2.internal
23:11:28	openshift-ingress		kube-auth-proxy-65f4688f79-d4v4q	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-65f4688f79-d4v4q to ip-10-0-133-222.ec2.internal
23:11:30	openshift-ingress		istiod-openshift-gateway-7b7995d5cd-vtckc	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vtckc to ip-10-0-133-222.ec2.internal
23:11:46	openshift-ingress		istiod-openshift-gateway-5677ccb49b-lvldr	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr to ip-10-0-141-215.ec2.internal
23:13:52	openshift-ingress		maas-default-gateway-openshift-default-5ccb968c66-dxbq6	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6 to ip-10-0-141-215.ec2.internal
23:18:34	openshift-ingress		e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z to ip-10-0-141-215.ec2.internal
23:15:21	openshift-ingress		payload-pre-processing-59fbc47bf8-4gbbx	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx to ip-10-0-141-215.ec2.internal
23:18:43	openshift-ingress		e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Scheduled	Successfully assigned openshift-ingress/e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r to ip-10-0-133-222.ec2.internal
23:18:55	openshift-ingress		payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp to ip-10-0-133-222.ec2.internal
23:07:30	openshift-console		console-fd479bccb-8dszg	Scheduled	Successfully assigned openshift-console/console-fd479bccb-8dszg to ip-10-0-140-44.ec2.internal
23:07:21	openshift-console		downloads-6594f4c75-kzt9c	Scheduled	Successfully assigned openshift-console/downloads-6594f4c75-kzt9c to ip-10-0-133-222.ec2.internal
23:09:22	openshift-console		console-8649477db9-p4q7n	Scheduled	Successfully assigned openshift-console/console-8649477db9-p4q7n to ip-10-0-141-215.ec2.internal
23:44:56	kuadrant-system		kuadrant-operator-controller-manager-5769f99d9f-z9m8r	Scheduled	Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-z9m8r to ip-10-0-133-222.ec2.internal
23:18:34	openshift-ingress		e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	Scheduled	Successfully assigned openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq to ip-10-0-141-215.ec2.internal
23:13:36	kuadrant-system		kuadrant-operator-controller-manager-5769f99d9f-brvgh	Scheduled	Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-brvgh to ip-10-0-133-222.ec2.internal
23:13:23	kuadrant-system		kuadrant-operator-controller-manager-5f685c496f-gk89g	Scheduled	Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-gk89g to ip-10-0-140-44.ec2.internal
23:13:13	kuadrant-system		kuadrant-console-plugin-fbdd4f445-9rnfc	Scheduled	Successfully assigned kuadrant-system/kuadrant-console-plugin-fbdd4f445-9rnfc to ip-10-0-140-44.ec2.internal
23:22:05	openshift-ingress		e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	Scheduled	Successfully assigned openshift-ingress/e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz to ip-10-0-133-222.ec2.internal
23:19:02	openshift-ingress		e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	Scheduled	Successfully assigned openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4 to ip-10-0-141-215.ec2.internal
23:13:24	kuadrant-system		kuadrant-operator-controller-manager-5f685c496f-kbllb	Scheduled	Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-kbllb to ip-10-0-133-222.ec2.internal
23:07:26	openshift-insights		insights-runtime-extractor-wcn4x	Scheduled	Successfully assigned openshift-insights/insights-runtime-extractor-wcn4x to ip-10-0-140-44.ec2.internal
23:36:16	openshift-ingress		e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	Scheduled	Successfully assigned openshift-ingress/e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq to ip-10-0-133-222.ec2.internal
23:20:07	openshift-ingress		e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	Scheduled	Successfully assigned openshift-ingress/e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh to ip-10-0-133-222.ec2.internal
23:20:44	openshift-ingress		e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	Scheduled	Successfully assigned openshift-ingress/e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m to ip-10-0-133-222.ec2.internal
23:13:24	kuadrant-system		kuadrant-operator-controller-manager-76f8f686bf-4wjc9	Scheduled	Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4wjc9 to ip-10-0-133-222.ec2.internal
23:12:57	kuadrant-system		dns-operator-controller-manager-7b84cd7c9c-pvmfp	Scheduled	Successfully assigned kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-pvmfp to ip-10-0-133-222.ec2.internal
23:07:45	openshift-monitoring		alertmanager-main-0	Scheduled	Successfully assigned openshift-monitoring/alertmanager-main-0 to ip-10-0-141-215.ec2.internal
23:36:45	openshift-ingress		e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	Scheduled	Successfully assigned openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2 to ip-10-0-141-215.ec2.internal
23:13:06	kuadrant-system		kuadrant-operator-controller-manager-76f8f686bf-jqrmq	Scheduled	Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jqrmq to ip-10-0-133-222.ec2.internal
23:20:13	openshift-ingress		payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg to ip-10-0-133-222.ec2.internal
23:06:59	openshift-insights		insights-runtime-extractor-vhnn4	Scheduled	Successfully assigned openshift-insights/insights-runtime-extractor-vhnn4 to ip-10-0-133-222.ec2.internal
23:18:43	openshift-ingress		e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	Scheduled	Successfully assigned openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd to ip-10-0-141-215.ec2.internal
23:37:55	openshift-ingress		e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	Scheduled	Successfully assigned openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv to ip-10-0-141-215.ec2.internal
23:30:18	openshift-ingress		e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz to ip-10-0-133-222.ec2.internal
23:07:22	openshift-insights		insights-runtime-extractor-2knf6	Scheduled	Successfully assigned openshift-insights/insights-runtime-extractor-2knf6 to ip-10-0-141-215.ec2.internal
23:30:27	openshift-ingress		payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk to ip-10-0-141-215.ec2.internal
23:31:02	openshift-ingress		payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88 to ip-10-0-141-215.ec2.internal
23:18:51	openshift-ingress		payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl to ip-10-0-141-215.ec2.internal
23:13:02	kuadrant-system		authorino-operator-76b478bd78-7jns7	Scheduled	Successfully assigned kuadrant-system/authorino-operator-76b478bd78-7jns7 to ip-10-0-133-222.ec2.internal
23:30:51	openshift-ingress		e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	Scheduled	Successfully assigned openshift-ingress/e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv to ip-10-0-133-222.ec2.internal
23:14:07	kuadrant-system		limitador-limitador-84994f7ffc-rn8c6	Scheduled	Successfully assigned kuadrant-system/limitador-limitador-84994f7ffc-rn8c6 to ip-10-0-133-222.ec2.internal
23:06:49	openshift-service-ca-operator		service-ca-operator-57cdc4b768-g6ngg	Scheduled	Successfully assigned openshift-service-ca-operator/service-ca-operator-57cdc4b768-g6ngg to ip-10-0-133-222.ec2.internal
23:14:38	kuadrant-system		authorino-ff99c8464-cnmqr	Scheduled	Successfully assigned kuadrant-system/authorino-ff99c8464-cnmqr to ip-10-0-140-44.ec2.internal
23:19:31	openshift-ingress		e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	Scheduled	Successfully assigned openshift-ingress/e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs to ip-10-0-133-222.ec2.internal
23:30:51	openshift-ingress		e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	Scheduled	Successfully assigned openshift-ingress/e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv to ip-10-0-133-222.ec2.internal
23:06:49	openshift-insights		insights-operator-6f9c644dd9-gw259	Scheduled	Successfully assigned openshift-insights/insights-operator-6f9c644dd9-gw259 to ip-10-0-133-222.ec2.internal
23:14:08	kuadrant-system		authorino-7bcfd8f9cd-mqd2t	Scheduled	Successfully assigned kuadrant-system/authorino-7bcfd8f9cd-mqd2t to ip-10-0-140-44.ec2.internal
23:14:07	kuadrant-system		limitador-limitador-8588749977-7ddsw	Scheduled	Successfully assigned kuadrant-system/limitador-limitador-8588749977-7ddsw to ip-10-0-140-44.ec2.internal
23:14:40	kuadrant-system		authorino-6f8f6d7d6b-rlqdj	Scheduled	Successfully assigned kuadrant-system/authorino-6f8f6d7d6b-rlqdj to ip-10-0-140-44.ec2.internal
23:30:18	openshift-ingress		e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	Scheduled	Successfully assigned openshift-ingress/e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz to ip-10-0-133-222.ec2.internal
23:07:01	openshift-service-ca		service-ca-55f6fc7b86-glczx	Scheduled	Successfully assigned openshift-service-ca/service-ca-55f6fc7b86-glczx to ip-10-0-133-222.ec2.internal
23:18:15	kuadrant-system		authorino-69c94896d7-d4tm6	Scheduled	Successfully assigned kuadrant-system/authorino-69c94896d7-d4tm6 to ip-10-0-141-215.ec2.internal
23:25:35	openshift-ingress		e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	Scheduled	Successfully assigned openshift-ingress/e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762 to ip-10-0-133-222.ec2.internal
23:12:59	kuadrant-system		limitador-operator-controller-manager-74495c69f8-8llhd	Scheduled	Successfully assigned kuadrant-system/limitador-operator-controller-manager-74495c69f8-8llhd to ip-10-0-133-222.ec2.internal
23:09:11	openshift-console		console-7c6f7b5ddb-jjlhc	Scheduled	Successfully assigned openshift-console/console-7c6f7b5ddb-jjlhc to ip-10-0-141-215.ec2.internal
23:18:43	openshift-ingress		e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	Scheduled	Successfully assigned openshift-ingress/e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd to ip-10-0-141-215.ec2.internal
23:06:49	openshift-console-operator		console-operator-fd4bb46c-kfrv8	Scheduled	Successfully assigned openshift-console-operator/console-operator-fd4bb46c-kfrv8 to ip-10-0-133-222.ec2.internal
23:14:08	kuadrant-system		authorino-59c974bd48-2mr8d	Scheduled	Successfully assigned kuadrant-system/authorino-59c974bd48-2mr8d to ip-10-0-141-215.ec2.internal
23:07:48	openshift-console		console-695bd4fb54-cktj7	Scheduled	Successfully assigned openshift-console/console-695bd4fb54-cktj7 to ip-10-0-140-44.ec2.internal
23:07:24	openshift-console		console-674fc5764c-4ztgh	Scheduled	Successfully assigned openshift-console/console-674fc5764c-4ztgh to ip-10-0-141-215.ec2.internal
23:14:38	kuadrant-system		authorino-557f876f69-5dcqj	Scheduled	Successfully assigned kuadrant-system/authorino-557f876f69-5dcqj to ip-10-0-140-44.ec2.internal
23:11:05	openshift-lws-operator		lws-controller-manager-858688bfcc-fznkh	Scheduled	Successfully assigned openshift-lws-operator/lws-controller-manager-858688bfcc-fznkh to ip-10-0-141-215.ec2.internal
23:12:28	openshift-console		console-5f8d85b594-78bzs	Scheduled	Successfully assigned openshift-console/console-5f8d85b594-78bzs to ip-10-0-140-44.ec2.internal
23:23:04	openshift-ingress		e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	Scheduled	Successfully assigned openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq to ip-10-0-141-215.ec2.internal
23:30:27	openshift-ingress		payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk to ip-10-0-141-215.ec2.internal
23:06:14	openshift-multus		multus-additional-cni-plugins-lx2wl	Scheduled	Successfully assigned openshift-multus/multus-additional-cni-plugins-lx2wl to ip-10-0-133-222.ec2.internal
23:20:44	openshift-ingress		e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	Scheduled	Successfully assigned openshift-ingress/e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m to ip-10-0-133-222.ec2.internal
23:31:02	openshift-ingress		payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88 to ip-10-0-141-215.ec2.internal
23:18:55	openshift-ingress		payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp to ip-10-0-133-222.ec2.internal
23:18:51	openshift-ingress		payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl to ip-10-0-141-215.ec2.internal
23:08:17	default	apiserver	kube-system	TerminationGracefulTerminationFinished	All pending requests processed
23:07:17	default	apiserver	kube-system	TerminationPreShutdownHooksFinished	All pre-shutdown hooks have been finished
23:07:17	default	apiserver	kube-system	TerminationStoppedServing	Server has stopped listening
23:07:17	default	apiserver	kube-system	TerminationMinimalShutdownDurationFinished	The minimal shutdown duration of 15s finished
23:07:02	default	apiserver	kube-system	TerminationStart	Received signal to terminate, becoming unready, but keeping serving
23:13:24	kuadrant-system		limitador-operator-controller-manager-74495c69f8-v6tp5	Scheduled	Successfully assigned kuadrant-system/limitador-operator-controller-manager-74495c69f8-v6tp5 to ip-10-0-133-222.ec2.internal
23:11:28	default		default-monitoring	ProvisioningError	error fetching list of deployments: unable to list: opendatahub-monitoring because of unknown namespace for the cache
23:22:05	openshift-ingress		e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	Scheduled	Successfully assigned openshift-ingress/e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz to ip-10-0-133-222.ec2.internal
23:11:28	default		default-monitoring	ProvisioningError	error fetching list of deployments: unable to list: opendatahub-monitoring because of unknown namespace for the cache
23:11:57	default		default-kserve	ProvisioningError	failure deploying resource opendatahub/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig opendatahub/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook "llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service"
23:11:57	default		default-kserve	ProvisioningError	failure deploying resource opendatahub/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig opendatahub/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook "llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service"
23:11:52	default		default-kserve	ProvisioningError	failure deploying resource opendatahub/v3-5-0-ea-2-kserve-config-llm-decode-template: apply failed serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig: unable to patch serving.kserve.io/v1alpha2, Kind=LLMInferenceServiceConfig opendatahub/v3-5-0-ea-2-kserve-config-llm-decode-template: Internal error occurred: failed calling webhook "llminferenceserviceconfig.kserve-webhook-server.v1alpha2.validator": failed to call webhook: Post "https://llmisvc-webhook-server-service.opendatahub.svc:443/validate-serving-kserve-io-v1alpha2-llminferenceserviceconfig?timeout=10s": no endpoints available for service "llmisvc-webhook-server-service"
23:06:44	openshift-ovn-kubernetes		ovnkube-node-zlpxj	Scheduled	Successfully assigned openshift-ovn-kubernetes/ovnkube-node-zlpxj to ip-10-0-140-44.ec2.internal
23:11:35	default		default-gateway	ProvisioningError	failure deploying resource openshift-ingress/data-science-tls-rule: apply failed networking.istio.io/v1, Kind=DestinationRule: unable to patch networking.istio.io/v1, Kind=DestinationRule openshift-ingress/data-science-tls-rule: Internal error occurred: failed calling webhook "rev.validation.istio.io": failed to call webhook: Post "https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s": no endpoints available for service "istiod-openshift-gateway"
23:11:31	default		default-gateway	ProvisioningError	failure deploying resource openshift-ingress/data-science-authn-filter: apply failed networking.istio.io/v1alpha3, Kind=EnvoyFilter: unable to patch networking.istio.io/v1alpha3, Kind=EnvoyFilter openshift-ingress/data-science-authn-filter: Internal error occurred: failed calling webhook "rev.validation.istio.io": failed to call webhook: Post "https://istiod-openshift-gateway.openshift-ingress.svc:443/validate?timeout=10s": no endpoints available for service "istiod-openshift-gateway"
23:11:28	default		default-gateway	ProvisioningError	failed to lookup object openshift-ingress/data-science-tls-rule: no matches for kind "DestinationRule" in version "networking.istio.io/v1"
23:11:28	default		default-gateway	ProvisioningError	failed to create OAuth client: failed to get auth proxy secret openshift-ingress/kube-auth-proxy-creds: Secret "kube-auth-proxy-creds" not found
23:06:59	openshift-kube-storage-version-migrator		migrator-76794cbd6c-r8t9z	Scheduled	Successfully assigned openshift-kube-storage-version-migrator/migrator-76794cbd6c-r8t9z to ip-10-0-133-222.ec2.internal
23:06:49	openshift-ingress		router-default-5cd8bf6458-jhsss	Scheduled	Successfully assigned openshift-ingress/router-default-5cd8bf6458-jhsss to ip-10-0-133-222.ec2.internal
23:18:43	openshift-ingress		e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Scheduled	Successfully assigned openshift-ingress/e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r to ip-10-0-133-222.ec2.internal
23:18:34	openshift-ingress		e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	Scheduled	Successfully assigned openshift-ingress/e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq to ip-10-0-141-215.ec2.internal
23:11:35	openshift-ingress		data-science-gateway-data-science-gateway-class-68cf4d799cfh66k	Scheduled	Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k to ip-10-0-141-215.ec2.internal
23:06:30	openshift-multus		multus-lkdzw	Scheduled	Successfully assigned openshift-multus/multus-lkdzw to ip-10-0-141-215.ec2.internal
23:06:49	openshift-monitoring		cluster-monitoring-operator-847b8bd8d7-r2vwj	Scheduled	Successfully assigned openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-r2vwj to ip-10-0-133-222.ec2.internal
23:15:21	openshift-ingress		payload-pre-processing-59fbc47bf8-4gbbx	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-4gbbx to ip-10-0-141-215.ec2.internal
23:18:39	openshift-ingress		payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc to ip-10-0-133-222.ec2.internal
23:18:42	openshift-ingress		payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs to ip-10-0-141-215.ec2.internal
23:06:30	openshift-image-registry		node-ca-skqrh	Scheduled	Successfully assigned openshift-image-registry/node-ca-skqrh to ip-10-0-141-215.ec2.internal
23:06:14	kube-system		global-pull-secret-syncer-92l5f	Scheduled	Successfully assigned kube-system/global-pull-secret-syncer-92l5f to ip-10-0-133-222.ec2.internal
23:27:18	openshift-ingress		payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc to ip-10-0-141-215.ec2.internal
23:06:30	kube-system		global-pull-secret-syncer-fvjmj	Scheduled	Successfully assigned kube-system/global-pull-secret-syncer-fvjmj to ip-10-0-141-215.ec2.internal
23:06:44	kube-system		global-pull-secret-syncer-rw5hp	Scheduled	Successfully assigned kube-system/global-pull-secret-syncer-rw5hp to ip-10-0-140-44.ec2.internal
23:07:48	openshift-monitoring		monitoring-plugin-5984459ff8-trd7x	Scheduled	Successfully assigned openshift-monitoring/monitoring-plugin-5984459ff8-trd7x to ip-10-0-141-215.ec2.internal
23:19:02	openshift-ingress		e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	Scheduled	Successfully assigned openshift-ingress/e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4 to ip-10-0-141-215.ec2.internal
23:25:01	openshift-ingress		payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484 to ip-10-0-141-215.ec2.internal
23:06:14	kube-system		konnectivity-agent-9vswh	Scheduled	Successfully assigned kube-system/konnectivity-agent-9vswh to ip-10-0-133-222.ec2.internal
23:26:50	openshift-ingress		payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6 to ip-10-0-141-215.ec2.internal
23:06:30	kube-system		konnectivity-agent-qw68s	Scheduled	Successfully assigned kube-system/konnectivity-agent-qw68s to ip-10-0-141-215.ec2.internal
23:24:27	openshift-ingress		payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv to ip-10-0-133-222.ec2.internal
23:23:15	openshift-ingress		payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8 to ip-10-0-141-215.ec2.internal
23:06:14	openshift-ovn-kubernetes		ovnkube-node-ljnfz	Scheduled	Successfully assigned openshift-ovn-kubernetes/ovnkube-node-ljnfz to ip-10-0-133-222.ec2.internal
23:06:49	openshift-ingress		router-default-5cd8bf6458-jhsss	Scheduled	Successfully assigned openshift-ingress/router-default-5cd8bf6458-jhsss to ip-10-0-133-222.ec2.internal
23:20:52	openshift-ingress		payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9 to ip-10-0-133-222.ec2.internal
23:25:42	openshift-ingress		payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg to ip-10-0-141-215.ec2.internal
23:36:16	openshift-ingress		e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	Scheduled	Successfully assigned openshift-ingress/e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq to ip-10-0-133-222.ec2.internal
23:11:48	opendatahub		kserve-controller-manager-d6f4b65b8-z7jjw	Scheduled	Successfully assigned opendatahub/kserve-controller-manager-d6f4b65b8-z7jjw to ip-10-0-133-222.ec2.internal
23:06:14	openshift-image-registry		node-ca-l5s9l	Scheduled	Successfully assigned openshift-image-registry/node-ca-l5s9l to ip-10-0-133-222.ec2.internal
23:06:44	openshift-image-registry		node-ca-dghj8	Scheduled	Successfully assigned openshift-image-registry/node-ca-dghj8 to ip-10-0-140-44.ec2.internal
23:19:36	openshift-ingress		payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc to ip-10-0-133-222.ec2.internal
23:11:48	opendatahub		llmisvc-controller-manager-777c6bd7d5-t7ncm	Scheduled	Successfully assigned opendatahub/llmisvc-controller-manager-777c6bd7d5-t7ncm to ip-10-0-133-222.ec2.internal
23:14:44	opendatahub		maas-controller-654fc8f547-p7t67	Scheduled	Successfully assigned opendatahub/maas-controller-654fc8f547-p7t67 to ip-10-0-141-215.ec2.internal
23:38:02	openshift-ingress		payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7 to ip-10-0-141-215.ec2.internal
23:06:47	openshift-image-registry		image-registry-7f64f764df-gtws9	Scheduled	Successfully assigned openshift-image-registry/image-registry-7f64f764df-gtws9 to ip-10-0-133-222.ec2.internal
23:14:45	opendatahub		maas-controller-947db468d-2qdk6	Scheduled	Successfully assigned opendatahub/maas-controller-947db468d-2qdk6 to ip-10-0-141-215.ec2.internal
23:10:50	openshift-lws-operator		openshift-lws-operator-fd8ccff4c-8w9cg	Scheduled	Successfully assigned openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8w9cg to ip-10-0-140-44.ec2.internal
23:36:45	openshift-ingress		e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	Scheduled	Successfully assigned openshift-ingress/e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2 to ip-10-0-141-215.ec2.internal
23:06:14	openshift-image-registry		image-registry-7f64f764df-gtws9	FailedScheduling	0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.
23:42:21	opendatahub		maas-controller-947db468d-2z9k2	Scheduled	Successfully assigned opendatahub/maas-controller-947db468d-2z9k2 to ip-10-0-141-215.ec2.internal
23:07:22	openshift-image-registry		image-registry-68999896c6-2gpfj	Scheduled	Successfully assigned openshift-image-registry/image-registry-68999896c6-2gpfj to ip-10-0-141-215.ec2.internal
23:07:21	openshift-image-registry		image-registry-68999896c6-2gpfj	FailedScheduling	0/3 nodes are available: 1 node(s) didn't match pod topology spread constraints, 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 1 node(s) didn't match pod topology spread constraints, 2 Preemption is not helpful for scheduling.
23:07:21	openshift-image-registry		image-registry-68999896c6-2gpfj	FailedScheduling	0/3 nodes are available: 1 node(s) didn't match pod topology spread constraints, 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 1 node(s) didn't match pod topology spread constraints, 2 Preemption is not helpful for scheduling.
23:36:51	openshift-ingress		payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7 to ip-10-0-133-222.ec2.internal
23:41:58	opendatahub		maas-controller-947db468d-hqknz	Scheduled	Successfully assigned opendatahub/maas-controller-947db468d-hqknz to ip-10-0-141-215.ec2.internal
23:07:01	openshift-image-registry		image-registry-65c9d8846b-wq7k9	FailedScheduling	0/3 nodes are available: 1 node(s) didn't match pod topology spread constraints, 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 1 node(s) didn't match pod topology spread constraints, 2 Preemption is not helpful for scheduling.
23:06:49	openshift-image-registry		image-registry-65c9d8846b-wq7k9	FailedScheduling	0/3 nodes are available: 1 node(s) didn't match pod topology spread constraints, 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 1 node(s) didn't match pod topology spread constraints, 2 Preemption is not helpful for scheduling.
23:36:21	openshift-ingress		payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj to ip-10-0-141-215.ec2.internal
23:06:30	openshift-dns		node-resolver-wzlbb	Scheduled	Successfully assigned openshift-dns/node-resolver-wzlbb to ip-10-0-141-215.ec2.internal
23:07:26	openshift-ingress-canary		ingress-canary-wkjrp	Scheduled	Successfully assigned openshift-ingress-canary/ingress-canary-wkjrp to ip-10-0-140-44.ec2.internal
23:37:55	openshift-ingress		e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	Scheduled	Successfully assigned openshift-ingress/e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv to ip-10-0-141-215.ec2.internal
23:06:30	openshift-ovn-kubernetes		ovnkube-node-2nzwr	Scheduled	Successfully assigned openshift-ovn-kubernetes/ovnkube-node-2nzwr to ip-10-0-141-215.ec2.internal
23:19:09	openshift-ingress		payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv to ip-10-0-133-222.ec2.internal
23:06:44	openshift-dns		node-resolver-qkccv	Scheduled	Successfully assigned openshift-dns/node-resolver-qkccv to ip-10-0-140-44.ec2.internal
23:06:30	openshift-multus		multus-additional-cni-plugins-h42tf	Scheduled	Successfully assigned openshift-multus/multus-additional-cni-plugins-h42tf to ip-10-0-141-215.ec2.internal
23:07:22	openshift-ingress-canary		ingress-canary-n6wf4	Scheduled	Successfully assigned openshift-ingress-canary/ingress-canary-n6wf4 to ip-10-0-141-215.ec2.internal
23:07:44	openshift-monitoring		kube-state-metrics-84c885658c-tg8gr	Scheduled	Successfully assigned openshift-monitoring/kube-state-metrics-84c885658c-tg8gr to ip-10-0-140-44.ec2.internal
23:18:40	openshift-ingress		payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j to ip-10-0-133-222.ec2.internal
23:11:39	opendatahub		model-serving-api-54d89bd5fc-b8k4c	Scheduled	Successfully assigned opendatahub/model-serving-api-54d89bd5fc-b8k4c to ip-10-0-141-215.ec2.internal
23:06:14	openshift-dns		node-resolver-fxvl4	Scheduled	Successfully assigned openshift-dns/node-resolver-fxvl4 to ip-10-0-133-222.ec2.internal
23:11:39	opendatahub		odh-model-controller-7998c67dc4-ck4x6	Scheduled	Successfully assigned opendatahub/odh-model-controller-7998c67dc4-ck4x6 to ip-10-0-141-215.ec2.internal
23:19:31	openshift-ingress		e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	Scheduled	Successfully assigned openshift-ingress/e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs to ip-10-0-133-222.ec2.internal
23:07:22	openshift-dns		dns-default-kc4rm	Scheduled	Successfully assigned openshift-dns/dns-default-kc4rm to ip-10-0-141-215.ec2.internal
23:22:12	openshift-ingress		payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4 to ip-10-0-133-222.ec2.internal
23:11:09	opendatahub		opendatahub-operator-controller-manager-697bb5576d-484bm	Scheduled	Successfully assigned opendatahub/opendatahub-operator-controller-manager-697bb5576d-484bm to ip-10-0-140-44.ec2.internal
23:06:44	openshift-network-operator		iptables-alerter-xzrtv	Scheduled	Successfully assigned openshift-network-operator/iptables-alerter-xzrtv to ip-10-0-140-44.ec2.internal
23:07:26	openshift-dns		dns-default-4sv94	Scheduled	Successfully assigned openshift-dns/dns-default-4sv94 to ip-10-0-140-44.ec2.internal
23:11:09	opendatahub		opendatahub-operator-controller-manager-697bb5576d-qg2sc	Scheduled	Successfully assigned opendatahub/opendatahub-operator-controller-manager-697bb5576d-qg2sc to ip-10-0-141-215.ec2.internal
23:07:48	openshift-monitoring		metrics-server-5f799df98b-zs8dn	Scheduled	Successfully assigned openshift-monitoring/metrics-server-5f799df98b-zs8dn to ip-10-0-141-215.ec2.internal
23:06:47	openshift-dns		dns-default-2fdkb	Scheduled	Successfully assigned openshift-dns/dns-default-2fdkb to ip-10-0-133-222.ec2.internal
23:06:30	openshift-network-operator		iptables-alerter-mrkhc	Scheduled	Successfully assigned openshift-network-operator/iptables-alerter-mrkhc to ip-10-0-141-215.ec2.internal
23:11:09	opendatahub		opendatahub-operator-controller-manager-697bb5576d-qqc9p	Scheduled	Successfully assigned opendatahub/opendatahub-operator-controller-manager-697bb5576d-qqc9p to ip-10-0-133-222.ec2.internal
23:25:35	openshift-ingress		e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	Scheduled	Successfully assigned openshift-ingress/e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762 to ip-10-0-133-222.ec2.internal
23:20:52	openshift-ingress		payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g to ip-10-0-133-222.ec2.internal
23:25:29	opendatahub		test-curl-7850-2dd76d	Scheduled	Successfully assigned opendatahub/test-curl-7850-2dd76d to ip-10-0-133-222.ec2.internal
23:11:05	openshift-lws-operator		lws-controller-manager-858688bfcc-xs7c6	Scheduled	Successfully assigned openshift-lws-operator/lws-controller-manager-858688bfcc-xs7c6 to ip-10-0-140-44.ec2.internal
23:06:14	openshift-network-operator		iptables-alerter-mqng4	Scheduled	Successfully assigned openshift-network-operator/iptables-alerter-mqng4 to ip-10-0-133-222.ec2.internal
23:20:13	openshift-ingress		payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg to ip-10-0-133-222.ec2.internal
23:20:07	openshift-ingress		e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	Scheduled	Successfully assigned openshift-ingress/e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh to ip-10-0-133-222.ec2.internal
23:11:35	openshift-ingress		data-science-gateway-data-science-gateway-class-68cf4d799cfh66k	Scheduled	Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cfh66k to ip-10-0-141-215.ec2.internal
23:25:31	opendatahub		test-curl-7850-57ba95	Scheduled	Successfully assigned opendatahub/test-curl-7850-57ba95 to ip-10-0-133-222.ec2.internal
23:25:33	opendatahub		test-curl-7850-b3181f	Scheduled	Successfully assigned opendatahub/test-curl-7850-b3181f to ip-10-0-133-222.ec2.internal
23:18:51	openshift-ingress		payload-processing-e2e-autores-61e623-54fc96f859-lxvv4	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-autores-61e623-54fc96f859-lxvv4 to ip-10-0-133-222.ec2.internal
23:23:04	openshift-ingress		e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	Scheduled	Successfully assigned openshift-ingress/e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq to ip-10-0-141-215.ec2.internal
23:07:44	openshift-monitoring		node-exporter-55dvl	Scheduled	Successfully assigned openshift-monitoring/node-exporter-55dvl to ip-10-0-140-44.ec2.internal
23:34:40	opendatahub		test-curl-7853-a6a3d6	Scheduled	Successfully assigned opendatahub/test-curl-7853-a6a3d6 to ip-10-0-133-222.ec2.internal
23:31:02	openshift-ingress		payload-processing-e2e-api-b-b54c32-f695d495-vtwg5	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b54c32-f695d495-vtwg5 to ip-10-0-133-222.ec2.internal
23:34:42	opendatahub		test-curl-7853-fb8638	Scheduled	Successfully assigned opendatahub/test-curl-7853-fb8638 to ip-10-0-133-222.ec2.internal
23:07:44	openshift-monitoring		node-exporter-njz52	Scheduled	Successfully assigned openshift-monitoring/node-exporter-njz52 to ip-10-0-133-222.ec2.internal
23:06:30	openshift-network-diagnostics		network-check-target-zsdgk	Scheduled	Successfully assigned openshift-network-diagnostics/network-check-target-zsdgk to ip-10-0-141-215.ec2.internal
23:06:49	openshift-cluster-storage-operator		volume-data-source-validator-6c58dcd66d-nc7tm	FailedScheduling	0/3 nodes are available: 1 node(s) didn't match Pod's node affinity/selector, 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.
23:30:27	openshift-ingress		payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw to ip-10-0-141-215.ec2.internal
23:33:12	opendatahub		test-curl-7853-fd8981	Scheduled	Successfully assigned opendatahub/test-curl-7853-fd8981 to ip-10-0-133-222.ec2.internal
23:20:13	openshift-ingress		payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr to ip-10-0-133-222.ec2.internal
23:18:40	opendatahub		test-curl-7862-9ee82a	Scheduled	Successfully assigned opendatahub/test-curl-7862-9ee82a to ip-10-0-133-222.ec2.internal
23:07:44	openshift-monitoring		node-exporter-qrvdw	Scheduled	Successfully assigned openshift-monitoring/node-exporter-qrvdw to ip-10-0-141-215.ec2.internal
23:06:14	openshift-network-diagnostics		network-check-target-sq8mp	Scheduled	Successfully assigned openshift-network-diagnostics/network-check-target-sq8mp to ip-10-0-133-222.ec2.internal
23:24:38	openshift-ingress		e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	Scheduled	Successfully assigned openshift-ingress/e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d to ip-10-0-133-222.ec2.internal
23:06:49	openshift-kube-storage-version-migrator-operator		kube-storage-version-migrator-operator-55889f7b47-4gmns	Scheduled	Successfully assigned openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-4gmns to ip-10-0-133-222.ec2.internal
23:18:35	opendatahub		test-curl-7862-c8a2b7	Scheduled	Successfully assigned opendatahub/test-curl-7862-c8a2b7 to ip-10-0-133-222.ec2.internal
23:18:55	openshift-ingress		payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49 to ip-10-0-133-222.ec2.internal
23:06:44	openshift-cluster-csi-drivers		aws-ebs-csi-driver-node-5gdc6	Scheduled	Successfully assigned openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gdc6 to ip-10-0-140-44.ec2.internal
23:15:21	openshift-ingress		payload-processing-5b54b7fbb7-x5r9q	Scheduled	Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-x5r9q to ip-10-0-133-222.ec2.internal
23:06:49	openshift-cluster-storage-operator		volume-data-source-validator-5c4db8bdf9-sx67h	Scheduled	Successfully assigned openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-sx67h to ip-10-0-133-222.ec2.internal
23:22:12	openshift-ingress		payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w to ip-10-0-133-222.ec2.internal
23:06:44	openshift-network-diagnostics		network-check-target-9vxwv	Scheduled	Successfully assigned openshift-network-diagnostics/network-check-target-9vxwv to ip-10-0-140-44.ec2.internal
23:07:44	openshift-monitoring		openshift-state-metrics-86c5bc79d6-jwstr	Scheduled	Successfully assigned openshift-monitoring/openshift-state-metrics-86c5bc79d6-jwstr to ip-10-0-140-44.ec2.internal
23:06:30	openshift-cluster-csi-drivers		aws-ebs-csi-driver-node-dg9pc	Scheduled	Successfully assigned openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dg9pc to ip-10-0-141-215.ec2.internal
23:24:19	openshift-ingress		e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd to ip-10-0-133-222.ec2.internal
23:18:39	openshift-ingress		payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk to ip-10-0-133-222.ec2.internal
23:07:50	openshift-monitoring		prometheus-k8s-0	Scheduled	Successfully assigned openshift-monitoring/prometheus-k8s-0 to ip-10-0-140-44.ec2.internal
23:18:42	openshift-ingress		payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc to ip-10-0-141-215.ec2.internal
23:06:14	openshift-cluster-csi-drivers		aws-ebs-csi-driver-node-r4q5m	Scheduled	Successfully assigned openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4q5m to ip-10-0-133-222.ec2.internal
23:27:18	openshift-ingress		payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq to ip-10-0-133-222.ec2.internal
23:25:01	openshift-ingress		payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7 to ip-10-0-133-222.ec2.internal
23:24:38	openshift-ingress		e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	Scheduled	Successfully assigned openshift-ingress/e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d to ip-10-0-133-222.ec2.internal
23:06:49	openshift-network-diagnostics		network-check-source-7cbc45fddc-5bgrm	Scheduled	Successfully assigned openshift-network-diagnostics/network-check-source-7cbc45fddc-5bgrm to ip-10-0-133-222.ec2.internal
23:06:47	openshift-ingress-canary		ingress-canary-6xlrg	Scheduled	Successfully assigned openshift-ingress-canary/ingress-canary-6xlrg to ip-10-0-133-222.ec2.internal
23:26:50	openshift-ingress		payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq to ip-10-0-141-215.ec2.internal
23:07:38	openshift-monitoring		prometheus-operator-7bd5d56d6-n2rtl	Scheduled	Successfully assigned openshift-monitoring/prometheus-operator-7bd5d56d6-n2rtl to ip-10-0-140-44.ec2.internal
23:06:14	openshift-multus		multus-nvk6c	Scheduled	Successfully assigned openshift-multus/multus-nvk6c to ip-10-0-133-222.ec2.internal
23:26:42	openshift-ingress		e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t to ip-10-0-133-222.ec2.internal
23:18:39	openshift-ingress		payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc to ip-10-0-133-222.ec2.internal
23:13:52	openshift-ingress		maas-default-gateway-openshift-default-5ccb968c66-dxbq6	Scheduled	Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dxbq6 to ip-10-0-141-215.ec2.internal
23:18:42	openshift-ingress		payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs to ip-10-0-141-215.ec2.internal
23:27:18	openshift-ingress		payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc to ip-10-0-141-215.ec2.internal
23:25:01	openshift-ingress		payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484 to ip-10-0-141-215.ec2.internal
23:06:53	openshift-network-console		networking-console-plugin-6446c8d75d-dp5fl	Scheduled	Successfully assigned openshift-network-console/networking-console-plugin-6446c8d75d-dp5fl to ip-10-0-133-222.ec2.internal
23:24:27	openshift-ingress		payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh to ip-10-0-133-222.ec2.internal
23:07:33	openshift-monitoring		prometheus-operator-admission-webhook-5c6747dc7b-nlgxb	Scheduled	Successfully assigned openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-nlgxb to ip-10-0-140-44.ec2.internal
23:23:15	openshift-ingress		payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg to ip-10-0-133-222.ec2.internal
23:26:50	openshift-ingress		payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6 to ip-10-0-141-215.ec2.internal
23:24:52	openshift-ingress		e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	Scheduled	Successfully assigned openshift-ingress/e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc to ip-10-0-133-222.ec2.internal
23:26:42	openshift-ingress		e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t to ip-10-0-133-222.ec2.internal
23:24:27	openshift-ingress		payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv to ip-10-0-133-222.ec2.internal
23:23:15	openshift-ingress		payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8 to ip-10-0-141-215.ec2.internal
23:25:42	openshift-ingress		payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg to ip-10-0-141-215.ec2.internal
23:19:36	openshift-ingress		payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc to ip-10-0-133-222.ec2.internal
23:38:02	openshift-ingress		payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7 to ip-10-0-141-215.ec2.internal
23:36:51	openshift-ingress		payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7 to ip-10-0-133-222.ec2.internal
23:09:08	openshift-monitoring		telemeter-client-7f785bf9cb-nf4rh	Scheduled	Successfully assigned openshift-monitoring/telemeter-client-7f785bf9cb-nf4rh to ip-10-0-141-215.ec2.internal
23:25:42	openshift-ingress		payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p to ip-10-0-133-222.ec2.internal
23:06:14	openshift-multus		network-metrics-daemon-vk29c	Scheduled	Successfully assigned openshift-multus/network-metrics-daemon-vk29c to ip-10-0-133-222.ec2.internal
23:27:12	openshift-ingress		e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	Scheduled	Successfully assigned openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5 to ip-10-0-141-215.ec2.internal
23:36:21	openshift-ingress		payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj to ip-10-0-141-215.ec2.internal
23:19:09	openshift-ingress		payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv to ip-10-0-133-222.ec2.internal
23:11:28	openshift-ingress		kube-auth-proxy-65f4688f79-k7p9x	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-65f4688f79-k7p9x to ip-10-0-140-44.ec2.internal
23:24:19	openshift-ingress		e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	Scheduled	Successfully assigned openshift-ingress/e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd to ip-10-0-133-222.ec2.internal
23:19:36	openshift-ingress		payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r to ip-10-0-133-222.ec2.internal
23:07:46	openshift-monitoring		thanos-querier-787444c6d5-86h6h	Scheduled	Successfully assigned openshift-monitoring/thanos-querier-787444c6d5-86h6h to ip-10-0-140-44.ec2.internal
23:18:40	openshift-ingress		payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j to ip-10-0-133-222.ec2.internal
23:22:12	openshift-ingress		payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4 to ip-10-0-133-222.ec2.internal
23:24:52	openshift-ingress		e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	Scheduled	Successfully assigned openshift-ingress/e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc to ip-10-0-133-222.ec2.internal
23:20:52	openshift-ingress		payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g to ip-10-0-133-222.ec2.internal
23:06:44	openshift-multus		network-metrics-daemon-r5mz6	Scheduled	Successfully assigned openshift-multus/network-metrics-daemon-r5mz6 to ip-10-0-140-44.ec2.internal
23:18:51	openshift-ingress		payload-processing-e2e-autores-61e623-54fc96f859-lxvv4	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-autores-61e623-54fc96f859-lxvv4 to ip-10-0-133-222.ec2.internal
23:18:34	openshift-ingress		e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw to ip-10-0-141-215.ec2.internal
23:11:28	openshift-ingress		kube-auth-proxy-65f4688f79-d4v4q	Scheduled	Successfully assigned openshift-ingress/kube-auth-proxy-65f4688f79-d4v4q to ip-10-0-133-222.ec2.internal
23:31:02	openshift-ingress		payload-processing-e2e-api-b-b54c32-f695d495-vtwg5	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b54c32-f695d495-vtwg5 to ip-10-0-133-222.ec2.internal
23:38:02	openshift-ingress		payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn to ip-10-0-133-222.ec2.internal
23:30:27	openshift-ingress		payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw to ip-10-0-141-215.ec2.internal
23:20:13	openshift-ingress		payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr to ip-10-0-133-222.ec2.internal
23:18:55	openshift-ingress		payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49	Scheduled	Successfully assigned openshift-ingress/payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49 to ip-10-0-133-222.ec2.internal
23:15:21	openshift-ingress		payload-processing-5b54b7fbb7-x5r9q	Scheduled	Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-x5r9q to ip-10-0-133-222.ec2.internal
23:36:51	openshift-ingress		payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685 to ip-10-0-133-222.ec2.internal
23:18:39	openshift-ingress		payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk to ip-10-0-133-222.ec2.internal
23:06:30	openshift-multus		network-metrics-daemon-d8wwk	Scheduled	Successfully assigned openshift-multus/network-metrics-daemon-d8wwk to ip-10-0-141-215.ec2.internal
23:18:34	openshift-ingress		e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z to ip-10-0-141-215.ec2.internal
23:06:30	openshift-cluster-node-tuning-operator		tuned-2mjrz	Scheduled	Successfully assigned openshift-cluster-node-tuning-operator/tuned-2mjrz to ip-10-0-141-215.ec2.internal
23:06:44	openshift-cluster-node-tuning-operator		tuned-rjcdn	Scheduled	Successfully assigned openshift-cluster-node-tuning-operator/tuned-rjcdn to ip-10-0-140-44.ec2.internal
23:06:44	openshift-multus		multus-additional-cni-plugins-9sjsw	Scheduled	Successfully assigned openshift-multus/multus-additional-cni-plugins-9sjsw to ip-10-0-140-44.ec2.internal
23:36:21	openshift-ingress		payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr to ip-10-0-141-215.ec2.internal
23:06:14	openshift-cluster-node-tuning-operator		tuned-swdt6	Scheduled	Successfully assigned openshift-cluster-node-tuning-operator/tuned-swdt6 to ip-10-0-133-222.ec2.internal
23:19:09	openshift-ingress		payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg to ip-10-0-141-215.ec2.internal
23:06:49	openshift-cluster-samples-operator		cluster-samples-operator-685d7d68b5-lrvzv	Scheduled	Successfully assigned openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-lrvzv to ip-10-0-133-222.ec2.internal
23:06:44	openshift-multus		multus-xg9wq	Scheduled	Successfully assigned openshift-multus/multus-xg9wq to ip-10-0-140-44.ec2.internal
23:18:40	openshift-ingress		payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx to ip-10-0-133-222.ec2.internal
23:18:42	openshift-ingress		payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc to ip-10-0-141-215.ec2.internal
23:27:18	openshift-ingress		payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq to ip-10-0-133-222.ec2.internal
23:27:12	openshift-ingress		e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	Scheduled	Successfully assigned openshift-ingress/e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5 to ip-10-0-141-215.ec2.internal
23:11:46	openshift-ingress		istiod-openshift-gateway-5677ccb49b-lvldr	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-lvldr to ip-10-0-141-215.ec2.internal
23:20:52	openshift-ingress		payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9 to ip-10-0-133-222.ec2.internal
23:18:34	openshift-ingress		e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	Scheduled	Successfully assigned openshift-ingress/e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw to ip-10-0-141-215.ec2.internal
23:22:12	openshift-ingress		payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w to ip-10-0-133-222.ec2.internal
23:18:40	openshift-ingress		payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx to ip-10-0-133-222.ec2.internal
23:19:09	openshift-ingress		payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg to ip-10-0-141-215.ec2.internal
23:36:21	openshift-ingress		payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr to ip-10-0-141-215.ec2.internal
23:11:30	openshift-ingress		istiod-openshift-gateway-7b7995d5cd-vtckc	Scheduled	Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vtckc to ip-10-0-133-222.ec2.internal
23:36:51	openshift-ingress		payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685 to ip-10-0-133-222.ec2.internal
23:38:02	openshift-ingress		payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn to ip-10-0-133-222.ec2.internal
23:19:36	openshift-ingress		payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r to ip-10-0-133-222.ec2.internal
23:25:42	openshift-ingress		payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p to ip-10-0-133-222.ec2.internal
23:23:15	openshift-ingress		payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg to ip-10-0-133-222.ec2.internal
23:24:27	openshift-ingress		payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh to ip-10-0-133-222.ec2.internal
23:26:50	openshift-ingress		payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq to ip-10-0-141-215.ec2.internal
23:25:01	openshift-ingress		payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7	Scheduled	Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7 to ip-10-0-133-222.ec2.internal
22:59:18	default	apiserver	openshift-kube-apiserver	KubeAPIReadyz	readyz=true
22:59:29	kube-system	kube-controller-manager	kube-controller-manager	LeaderElection	kube-controller-manager-7d7c4b78f8-dd46k_04e96776-c406-422e-aa6d-9e513b4a1a25 became leader
22:59:31	kube-system	default-scheduler	kube-scheduler	LeaderElection	kube-scheduler-65cf8c7bd9-gmqtj_814f58b7-cb00-4805-ab5f-b5fc2765eb67 became leader
22:59:49	openshift-cluster-version	openshift-cluster-version	version	LeaderElection	cluster-version-operator-78bd76b765-64x82_041aed0d-92d6-47ed-9bdc-0d295a6aae8d became leader
22:59:51	openshift-cluster-version	openshift-cluster-version	version	RetrievePayload	Retrieving and verifying payload version="4.21.34" image="quay.io/openshift-release-dev/ocp-release@sha256:b6bdbb9508197e3ca704994cfae3441d1ad3526a6569793919b8e3938dfc559a"
22:59:51	openshift-cluster-version	openshift-cluster-version	version	LoadPayload	Loading payload version="4.21.34" image="quay.io/openshift-release-dev/ocp-release@sha256:b6bdbb9508197e3ca704994cfae3441d1ad3526a6569793919b8e3938dfc559a"
22:59:52	openshift-cluster-version	openshift-cluster-version	version	PayloadLoaded	Payload loaded version="4.21.34" image="quay.io/openshift-release-dev/ocp-release@sha256:b6bdbb9508197e3ca704994cfae3441d1ad3526a6569793919b8e3938dfc559a" architecture="Multi"
22:59:58	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: Progressing changed from Unknown to True ("CSISnapshotControllerProgressing: Waiting for Deployment to act on changes"),Available changed from Unknown to False ("CSISnapshotControllerAvailable: Waiting for Deployment")
22:59:58	openshift-cluster-storage-operator	csi-snapshot-controller-csisnapshotgueststaticresourcecontroller-csisnapshotgueststaticresourcecontroller-staticresources	csi-snapshot-controller-operator	CustomResourceDefinitionCreated	Created CustomResourceDefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io because it was missing
22:59:58	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Degraded changed from Unknown to False ("CSIDriverStarterDegraded: infrastructure.config.openshift.io \"cluster\" not found")
22:59:58	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: Progressing message changed from "CSISnapshotControllerProgressing: Waiting for Deployment to act on changes" to "CSISnapshotControllerProgressing: Waiting for Deployment to deploy pods"
22:59:58	openshift-cluster-storage-operator	storage-VolumeDataSourceValidatorStarter-volumedatasourcevalidatorstaticcontroller-volumedatasourcevalidatorstaticcontroller-staticresources	aws-cloud-controller-manager	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/volume-data-source-validator because it was missing
22:59:58	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorVersionChanged	clusteroperator/storage version "operator" changed from "" to "4.21.34"
22:59:58	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: Degraded changed from Unknown to False ("All is well")
22:59:58	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Progressing changed from Unknown to True ("DefaultStorageClassControllerProgressing: infrastructure.config.openshift.io \"cluster\" not found"),Available changed from Unknown to False ("DefaultStorageClassControllerAvailable: infrastructure.config.openshift.io \"cluster\" not found")
22:59:58	openshift-cluster-storage-operator	csi-snapshot-controller	csi-snapshot-controller-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "GatewayAPIWithoutOLM", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
22:59:58	openshift-cluster-storage-operator	csi-snapshot-controller-csisnapshotstaticresourcecontroller-csisnapshotstaticresourcecontroller-staticresources	csi-snapshot-controller-operator	ServiceAccountCreated	Created ServiceAccount/csi-snapshot-controller -n clusters-93dee3fd-67ea-4296-9f8e-cfc37f6a17c9 because it was missing
22:59:58	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: Degraded set to Unknown (""),Progressing set to Unknown (""),Available set to Unknown (""),Upgradeable set to Unknown (""),EvaluationConditionsDetected set to Unknown ("")
22:59:58	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Degraded message changed from "CSIDriverStarterDegraded: infrastructure.config.openshift.io \"cluster\" not found\nVolumeDataSourceValidatorDeploymentControllerDegraded: error running hook function (index=0): infrastructure.config.openshift.io \"cluster\" not found" to "CSIDriverStarterDegraded: infrastructure.config.openshift.io \"cluster\" not found\nVolumeDataSourceValidatorDeploymentControllerDegraded: error running hook function (index=0): infrastructure.config.openshift.io \"cluster\" not found\nDefaultStorageClassControllerDegraded: infrastructure.config.openshift.io \"cluster\" not found"
22:59:58	openshift-cluster-storage-operator	csi-snapshot-controller-csisnapshotstaticresourcecontroller-csisnapshotstaticresourcecontroller-staticresources	csi-snapshot-controller-operator	PodDisruptionBudgetCreated	Created PodDisruptionBudget.policy/csi-snapshot-controller-pdb -n clusters-93dee3fd-67ea-4296-9f8e-cfc37f6a17c9 because it was missing
22:59:58	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: Upgradeable changed from Unknown to True ("All is well")
22:59:58	openshift-cluster-storage-operator	csi-snapshot-controller-csisnapshotcontroller-deployment-controller--csisnapshotcontroller	csi-snapshot-controller-operator	DeploymentCreated	Created Deployment.apps/csi-snapshot-controller -n clusters-93dee3fd-67ea-4296-9f8e-cfc37f6a17c9 because it was missing
22:59:58	openshift-cluster-storage-operator	csi-snapshot-controller-csisnapshotgueststaticresourcecontroller-csisnapshotgueststaticresourcecontroller-staticresources	csi-snapshot-controller-operator	CustomResourceDefinitionCreated	Created CustomResourceDefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io because it was missing
22:59:58	openshift-cluster-storage-operator	storage	aws-cloud-controller-manager	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "GatewayAPIWithoutOLM", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
22:59:58	openshift-cluster-storage-operator	csi-snapshot-controller-csisnapshotgueststaticresourcecontroller-csisnapshotgueststaticresourcecontroller-staticresources	csi-snapshot-controller-operator	CustomResourceDefinitionCreated	Created CustomResourceDefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io because it was missing
22:59:58	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Degraded set to Unknown (""),Progressing set to Unknown (""),Available set to Unknown (""),Upgradeable set to Unknown (""),EvaluationConditionsDetected set to Unknown (""),status.relatedObjects changed from [] to [{"" "namespaces" "" "openshift-cluster-storage-operator"} {"" "namespaces" "" "openshift-cluster-csi-drivers"} {"operator.openshift.io" "storages" "" "cluster"} {"rbac.authorization.k8s.io" "clusterrolebindings" "" "cluster-storage-operator-role"}],status.versions changed from [] to [{"operator" "4.21.34"}]
22:59:58	openshift-cluster-storage-operator	storage-VolumeDataSourceValidatorStarter-volumedatasourcevalidatorstaticcontroller-volumedatasourcevalidatorstaticcontroller-staticresources	aws-cloud-controller-manager	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/volume-data-source-validator because it was missing
22:59:58	openshift-cluster-storage-operator	storage-VolumeDataSourceValidatorStarter-volumedatasourcevalidatorstaticcontroller-volumedatasourcevalidatorstaticcontroller-staticresources	aws-cloud-controller-manager	ServiceAccountCreated	Created ServiceAccount/volume-data-source-validator -n openshift-cluster-storage-operator because it was missing
22:59:58	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Degraded message changed from "CSIDriverStarterDegraded: infrastructure.config.openshift.io \"cluster\" not found" to "CSIDriverStarterDegraded: infrastructure.config.openshift.io \"cluster\" not found\nVolumeDataSourceValidatorDeploymentControllerDegraded: error running hook function (index=0): infrastructure.config.openshift.io \"cluster\" not found"
22:59:58	openshift-cluster-storage-operator	storage-VolumeDataSourceValidatorStarter-volumedatasourcevalidatorstaticcontroller-volumedatasourcevalidatorstaticcontroller-staticresources	aws-cloud-controller-manager	CustomResourceDefinitionCreated	Created CustomResourceDefinition.apiextensions.k8s.io/volumepopulators.populator.storage.k8s.io because it was missing
22:59:59	openshift-cluster-storage-operator	snapshot-controller-leader/csi-snapshot-controller-6d847c6fd9-jz9m8	snapshot-controller-leader	LeaderElection	csi-snapshot-controller-6d847c6fd9-jz9m8 became leader
23:00:00	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorVersionChanged	clusteroperator/csi-snapshot-controller version "csi-snapshot-controller" changed from "" to "4.21.34"
23:00:00	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: status.versions changed from [] to [{"csi-snapshot-controller" "4.21.34"} {"operator" "4.21.34"}]
23:00:00	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorStatusChanged	Status for clusteroperator/csi-snapshot-controller changed: Progressing changed from True to False ("CSISnapshotControllerProgressing: Deployment is not progressing"),Available changed from False to True ("CSISnapshotControllerAvailable: Deployment is available")
23:00:00	openshift-cluster-storage-operator	csi-snapshot-controller-status-controller-statussyncer_csi-snapshot-controller	csi-snapshot-controller-operator	OperatorVersionChanged	clusteroperator/csi-snapshot-controller version "operator" changed from "" to "4.21.34"
23:00:06 (x2)	openshift-operator-lifecycle-manager	controllermanager	packageserver-pdb	NoPods	No matching pods found
23:00:08 (x7)	openshift-cluster-storage-operator	storage-config-observer-controller--config-observer-configobserver	aws-cloud-controller-manager	ObserveProxyConfig	proxy.config.openshift.io/cluster not found
23:00:08	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Degraded message changed from "CSIDriverStarterDegraded: infrastructure.config.openshift.io \"cluster\" not found\nVolumeDataSourceValidatorDeploymentControllerDegraded: error running hook function (index=0): infrastructure.config.openshift.io \"cluster\" not found\nDefaultStorageClassControllerDegraded: infrastructure.config.openshift.io \"cluster\" not found" to "CSIDriverStarterDegraded: infrastructure.config.openshift.io \"cluster\" not found\nVolumeDataSourceValidatorDeploymentControllerDegraded: error running hook function (index=0): infrastructure.config.openshift.io \"cluster\" not found"
23:00:08	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Progressing changed from True to False ("All is well"),Available changed from False to True ("DefaultStorageClassControllerAvailable: No default StorageClass for this platform"),Upgradeable changed from Unknown to True ("All is well")
23:00:08	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Degraded message changed from "CSIDriverStarterDegraded: infrastructure.config.openshift.io \"cluster\" not found\nVolumeDataSourceValidatorDeploymentControllerDegraded: error running hook function (index=0): infrastructure.config.openshift.io \"cluster\" not found" to "VolumeDataSourceValidatorDeploymentControllerDegraded: error running hook function (index=0): infrastructure.config.openshift.io \"cluster\" not found"
23:00:13	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	Status for clusteroperator/storage changed: Available message changed from "DefaultStorageClassControllerAvailable: No default StorageClass for this platform" to "DefaultStorageClassControllerAvailable: StorageClass provided by supplied CSI Driver instead of the cluster-storage-operator",status.relatedObjects changed from [{"" "namespaces" "" "openshift-cluster-storage-operator"} {"" "namespaces" "" "openshift-cluster-csi-drivers"} {"operator.openshift.io" "storages" "" "cluster"} {"rbac.authorization.k8s.io" "clusterrolebindings" "" "cluster-storage-operator-role"}] to [{"" "serviceaccounts" "openshift-cluster-csi-drivers" "aws-ebs-csi-driver-operator"} {"rbac.authorization.k8s.io" "roles" "openshift-cluster-csi-drivers" "aws-ebs-csi-driver-operator-role"} {"rbac.authorization.k8s.io" "rolebindings" "openshift-cluster-csi-drivers" "aws-ebs-csi-driver-operator-rolebinding"} {"rbac.authorization.k8s.io" "clusterroles" "" "aws-ebs-csi-driver-operator-clusterrole"} {"rbac.authorization.k8s.io" "clusterrolebindings" "" "aws-ebs-csi-driver-operator-clusterrolebinding"} {"operator.openshift.io" "clustercsidrivers" "" "ebs.csi.aws.com"} {"" "namespaces" "" "openshift-cluster-storage-operator"} {"" "namespaces" "" "openshift-cluster-csi-drivers"} {"operator.openshift.io" "storages" "" "cluster"} {"rbac.authorization.k8s.io" "clusterrolebindings" "" "cluster-storage-operator-role"}]
23:00:13	openshift-cluster-storage-operator	storage-CSIDriverStarter-AWSEBS	aws-cloud-controller-manager	ClusterCSIDriverCreated	Created ClusterCSIDriver.operator.openshift.io/ebs.csi.aws.com -n openshift-cluster-csi-drivers because it was missing
23:00:13	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatorstaticcontroller-awsebscsidriveroperatorstaticcontroller-staticresources	aws-cloud-controller-manager	ServiceAccountCreated	Created ServiceAccount/aws-ebs-csi-driver-operator -n openshift-cluster-csi-drivers because it was missing
23:00:14	openshift-cluster-storage-operator	storage-CSIDriverStarter-AWSEBS	aws-cloud-controller-manager	DeploymentCreated	Created Deployment.apps/aws-ebs-csi-driver-operator -n clusters-93dee3fd-67ea-4296-9f8e-cfc37f6a17c9 because it was missing
23:00:14	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatorstaticcontroller-awsebscsidriveroperatorstaticcontroller-staticresources	aws-cloud-controller-manager	RoleCreated	Created Role.rbac.authorization.k8s.io/aws-ebs-csi-driver-operator-role -n openshift-cluster-csi-drivers because it was missing
23:00:14	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatormgmtstaticcontroller-awsebscsidriveroperatormgmtstaticcontroller-staticresources	aws-cloud-controller-manager	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/aws-ebs-csi-driver-operator-rolebinding -n clusters-93dee3fd-67ea-4296-9f8e-cfc37f6a17c9 because it was missing
23:00:14	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatormgmtstaticcontroller-awsebscsidriveroperatormgmtstaticcontroller-staticresources	aws-cloud-controller-manager	ServiceAccountCreated	Created ServiceAccount/aws-ebs-csi-driver-operator -n clusters-93dee3fd-67ea-4296-9f8e-cfc37f6a17c9 because it was missing
23:00:14	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatormgmtstaticcontroller-awsebscsidriveroperatormgmtstaticcontroller-staticresources	aws-cloud-controller-manager	RoleCreated	Created Role.rbac.authorization.k8s.io/aws-ebs-csi-driver-operator-role -n clusters-93dee3fd-67ea-4296-9f8e-cfc37f6a17c9 because it was missing
23:00:15	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatorstaticcontroller-awsebscsidriveroperatorstaticcontroller-staticresources	aws-cloud-controller-manager	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/aws-ebs-csi-driver-operator-clusterrole because it was missing
23:00:15	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatorstaticcontroller-awsebscsidriveroperatorstaticcontroller-staticresources	aws-cloud-controller-manager	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/aws-ebs-csi-driver-operator-rolebinding -n openshift-cluster-csi-drivers because it was missing
23:00:16	openshift-image-registry	image-registry-operator	openshift-master-controllers	LeaderElection	cluster-image-registry-operator-8464d579f9-ddqbn_7c525201-6e2e-42f7-a543-0f54fbc60eca became leader
23:00:16	openshift-image-registry	image-registry-operator	openshift-image-registry	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "GatewayAPIWithoutOLM", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
23:00:16	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator	aws-ebs-csi-driver-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "GatewayAPIWithoutOLM", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
23:00:16	openshift-cluster-storage-operator	storage-CSIDriverStarter-awsebscsidriveroperatorstaticcontroller-awsebscsidriveroperatorstaticcontroller-staticresources	aws-cloud-controller-manager	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/aws-ebs-csi-driver-operator-clusterrolebinding because it was missing
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-main-snapshotter-binding because it was missing
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivercontrolplanestaticresourcescontroller-awsebsdrivercontrolplanestaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ServiceAccountCreated	Created ServiceAccount/aws-ebs-csi-driver-controller-sa -n clusters-93dee3fd-67ea-4296-9f8e-cfc37f6a17c9 because it was missing
23:00:17 (x2)	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-csi-driver-node-service_awsebsdrivernodeservicecontroller-awsebsdrivernodeservicecontroller	aws-ebs-csi-driver-operator	DaemonSetUpdated	Updated DaemonSet.apps/aws-ebs-csi-driver-node -n openshift-cluster-csi-drivers because it changed
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-csi-config-observer-controller-awsebsdrivercsiconfigobservercontroller-config-observer-configobserver	aws-ebs-csi-driver-operator	ObservedConfigChanged	Writing updated observed config: @@ -1 +1,18 @@ -{} +{ + "targetcsiconfig": { + "servingInfo": { + "cipherSuites": [ + "TLS_AES_128_GCM_SHA256", + "TLS_AES_256_GCM_SHA384", + "TLS_CHACHA20_POLY1305_SHA256", + "TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256", + "TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256", + "TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384", + "TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384", + "TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256", + "TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256" + ], + "minTLSVersion": "VersionTLS12" + } + } +}
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-csi-config-observer-controller-awsebsdrivercsiconfigobservercontroller-config-observer-configobserver	aws-ebs-csi-driver-operator	ObserveTLSSecurityProfile	cipherSuites changed to ["TLS_AES_128_GCM_SHA256" "TLS_AES_256_GCM_SHA384" "TLS_CHACHA20_POLY1305_SHA256" "TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256" "TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256" "TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384" "TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384" "TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256" "TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256"]
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-csi-config-observer-controller-awsebsdrivercsiconfigobservercontroller-config-observer-configobserver	aws-ebs-csi-driver-operator	ObserveTLSSecurityProfile	minTLSVersion changed to VersionTLS12
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/aws-ebs-csi-driver-prometheus -n openshift-cluster-csi-drivers because it was missing
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivercontrollerservicecontroller-deployment-controller--awsebsdrivercontrollerservicecontroller	aws-ebs-csi-driver-operator	DeploymentCreated	Created Deployment.apps/aws-ebs-csi-driver-controller -n clusters-93dee3fd-67ea-4296-9f8e-cfc37f6a17c9 because it was missing
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/ebs-kube-rbac-proxy-role because it was missing
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivercontrolplanestaticresourcescontroller-awsebsdrivercontrolplanestaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	PodDisruptionBudgetCreated	Created PodDisruptionBudget.policy/aws-ebs-csi-driver-controller-pdb -n clusters-93dee3fd-67ea-4296-9f8e-cfc37f6a17c9 because it was missing
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-csi-driver-node-service_awsebsdrivernodeservicecontroller-awsebsdrivernodeservicecontroller	aws-ebs-csi-driver-operator	DaemonSetCreated	Created DaemonSet.apps/aws-ebs-csi-driver-node -n openshift-cluster-csi-drivers because it was missing
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator	aws-ebs-csi-driver-operator	StorageClassCreated	Created StorageClass.storage.k8s.io/gp2-csi because it was missing
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/aws-ebs-csi-driver-lease-leader-election -n openshift-cluster-csi-drivers because it was missing
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivercontrolplanestaticresourcescontroller-awsebsdrivercontrolplanestaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ConfigMapCreated	Created ConfigMap/aws-ebs-csi-driver-trusted-ca-bundle -n clusters-93dee3fd-67ea-4296-9f8e-cfc37f6a17c9 because it was missing
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator	aws-ebs-csi-driver-operator	StorageClassCreated	Created StorageClass.storage.k8s.io/gp3-csi because it was missing
23:00:17	openshift-monitoring	deployment-controller	cluster-monitoring-operator	ScalingReplicaSet	Scaled up replica set cluster-monitoring-operator-847b8bd8d7 from 0 to 1
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivercontrollerservicecontroller-deployment-controller--awsebsdrivercontrollerservicecontroller	aws-ebs-csi-driver-operator	DeploymentUpdated	Updated Deployment.apps/aws-ebs-csi-driver-controller -n clusters-93dee3fd-67ea-4296-9f8e-cfc37f6a17c9 because it changed
23:00:17	openshift-image-registry	image-registry-operator	openshift-image-registry	DaemonSetCreated	Created DaemonSet.apps/node-ca -n openshift-image-registry because it was missing
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivercontrolplanestaticresourcescontroller-awsebsdrivercontrolplanestaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ServiceCreated	Created Service/aws-ebs-csi-driver-controller-metrics -n clusters-93dee3fd-67ea-4296-9f8e-cfc37f6a17c9 because it was missing
23:00:17	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/ebs-privileged-role because it was missing
23:00:18	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-kube-rbac-proxy-binding because it was missing
23:00:18	openshift-ingress-operator	cluster-ingress-operator	ingress-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "GatewayAPIWithoutOLM", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
23:00:18	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-volumesnapshot-reader-provisioner-binding because it was missing
23:00:18	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-volumeattributesclass-reader-resizer-binding because it was missing
23:00:18	openshift-cluster-storage-operator	storage-VolumeDataSourceValidatorStarter-volumedatasourcevalidatordeploymentcontroller-deployment-controller--volumedatasourcevalidatordeploymentcontroller	aws-cloud-controller-manager	DeploymentCreated	Created Deployment.apps/volume-data-source-validator -n openshift-cluster-storage-operator because it was missing
23:00:19	openshift-ingress	deployment-controller	router-default	ScalingReplicaSet	Scaled up replica set router-default-5cd8bf6458 from 0 to 1
23:00:19	openshift-config-managed	certificate_publisher_controller	default-ingress-cert	PublishedRouterCA	Published "default-ingress-cert" in "openshift-config-managed"
23:00:19	openshift-ingress	deployment-controller	router-default	ScalingReplicaSet	Scaled up replica set router-default-5cd8bf6458 from 0 to 1
23:00:19	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-main-provisioner-binding because it was missing
23:00:19	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-main-resizer-binding because it was missing
23:00:19	openshift-config-managed	certificate_publisher_controller	router-certs	PublishedRouterCertificates	Published router certificates
23:00:19	openshift-ingress-operator	ingress_controller	default	Admitted	ingresscontroller passed validation
23:00:19	openshift-ingress-operator	certificate_controller	router-ca	CreatedWildcardCACert	Created a default wildcard CA certificate
23:00:20	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-storageclass-reader-resizer-binding because it was missing
23:00:20	openshift-cluster-csi-drivers	ebs.csi.aws.com/1789686020859-5120-ebs.csi.aws.com	ebs-csi-aws-com	LeaderElection	1789686020859-5120-ebs-csi-aws-com became leader
23:00:20	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-node-privileged-binding because it was missing
23:00:20	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-main-attacher-binding because it was missing
23:00:21	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/aws-ebs-csi-driver-prometheus -n openshift-cluster-csi-drivers because it was missing
23:00:21	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/aws-ebs-csi-driver-lease-leader-election -n openshift-cluster-csi-drivers because it was missing
23:00:21	openshift-cluster-csi-drivers	external-attacher-leader-ebs.csi.aws.com/aws-ebs-csi-driver-controller-7c54c657cb-zmf7b	external-attacher-leader-ebs-csi-aws-com	LeaderElection	aws-ebs-csi-driver-controller-7c54c657cb-zmf7b became leader
23:00:22	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ClusterRoleBindingCreated	(combined from similar events): Created ClusterRoleBinding.rbac.authorization.k8s.io/ebs-csi-volumeattributesclass-reader-provisioner-binding because it was missing
23:00:22	openshift-network-operator	network-operator	network-operator-lock	LeaderElection	cluster-network-operator-5884d86489-qkw4z_558bac96-a7a2-4cbf-8176-a65b686db4f7 became leader
23:00:22	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	ServiceAccountCreated	Created ServiceAccount/aws-ebs-csi-driver-node-sa -n openshift-cluster-csi-drivers because it was missing
23:00:22	openshift-cluster-csi-drivers	aws-ebs-csi-driver-operator-awsebsdrivergueststaticresourcescontroller-awsebsdrivergueststaticresourcescontroller-staticresources	aws-ebs-csi-driver-operator	CSIDriverCreated	Created CSIDriver.storage.k8s.io/ebs.csi.aws.com because it was missing
23:00:22	openshift-network-operator	network-operator	openshift-network-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "GatewayAPIWithoutOLM", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
23:00:22	openshift-cluster-csi-drivers	external-resizer-ebs-csi-aws-com/aws-ebs-csi-driver-controller-7c54c657cb-zmf7b	external-resizer-ebs-csi-aws-com	LeaderElection	aws-ebs-csi-driver-controller-7c54c657cb-zmf7b became leader
23:00:22	openshift-insights	deployment-controller	insights-operator	ScalingReplicaSet	Scaled up replica set insights-operator-6f9c644dd9 from 0 to 1
23:00:23	openshift-ingress	service-controller	router-default	UnAvailableLoadBalancer	There are no available nodes for LoadBalancer
23:00:23	openshift-ingress	service-controller	router-default	UnAvailableLoadBalancer	There are no available nodes for LoadBalancer
23:00:23	openshift-ingress	service-controller	router-default	EnsuringLoadBalancer	Ensuring load balancer
23:00:23	openshift-cluster-csi-drivers	external-snapshotter-leader-ebs.csi.aws.com/aws-ebs-csi-driver-controller-7c54c657cb-zmf7b	external-snapshotter-leader-ebs-csi-aws-com	LeaderElection	aws-ebs-csi-driver-controller-7c54c657cb-zmf7b became leader
23:00:23	openshift-ingress	service-controller	router-default	EnsuringLoadBalancer	Ensuring load balancer
23:00:26	openshift-ingress	service-controller	router-default	EnsuredLoadBalancer	Ensured load balancer
23:00:26	openshift-ingress	service-controller	router-default	EnsuredLoadBalancer	Ensured load balancer
23:00:29	openshift-cluster-node-tuning-operator	cluster-node-tuning-operator-746b654554-wbqq7_19fac9ae-f77d-4d0e-8667-16cfa040793c	node-tuning-operator-lock	LeaderElection	cluster-node-tuning-operator-746b654554-wbqq7_19fac9ae-f77d-4d0e-8667-16cfa040793c became leader
23:00:29	openshift-kube-storage-version-migrator-operator	deployment-controller	kube-storage-version-migrator-operator	ReplicaSetCreateError	Failed to create new replica set "kube-storage-version-migrator-operator-55889f7b47": Internal error occurred: admission plugin "PodSecurity" failed to complete validation in 13s
23:00:30	openshift-service-ca-operator	deployment-controller	service-ca-operator	ReplicaSetCreateError	Failed to create new replica set "service-ca-operator-57cdc4b768": Internal error occurred: admission plugin "PodSecurity" failed to complete validation in 13s
23:00:30	openshift-cluster-storage-operator	deployment-controller	volume-data-source-validator	ScalingReplicaSet	Scaled up replica set volume-data-source-validator-6c58dcd66d from 0 to 1
23:00:30	openshift-cluster-storage-operator	storage-VolumeDataSourceValidatorStarter-volumedatasourcevalidatordeploymentcontroller-deployment-controller--volumedatasourcevalidatordeploymentcontroller	aws-cloud-controller-manager	DeploymentUpdateFailed	Failed to update Deployment.apps/volume-data-source-validator -n openshift-cluster-storage-operator: Operation cannot be fulfilled on deployments.apps "volume-data-source-validator": the object has been modified; please apply your changes to the latest version and try again
23:00:36	openshift-controller-manager	openshift-controller-manager	openshift-master-controllers	LeaderElection	openshift-controller-manager-58fc9dc5cc-gn6gj_fc8abc00-f4c9-4a51-8e06-1a84f7ec46f2 became leader
23:00:39	openshift-ingress-canary	canary_certificate_controller	canary-serving-cert	CreatedCanaryCertificate	created canary certificate
23:00:39	openshift-kube-storage-version-migrator-operator	deployment-controller	kube-storage-version-migrator-operator	ScalingReplicaSet	Scaled up replica set kube-storage-version-migrator-operator-55889f7b47 from 0 to 1
23:00:40	openshift-service-ca-operator	deployment-controller	service-ca-operator	ScalingReplicaSet	Scaled up replica set service-ca-operator-57cdc4b768 from 0 to 1
23:00:40	openshift-cluster-samples-operator	deployment-controller	cluster-samples-operator	ScalingReplicaSet	Scaled up replica set cluster-samples-operator-685d7d68b5 from 0 to 1
23:00:40	openshift-cluster-storage-operator	storage-VolumeDataSourceValidatorStarter-volumedatasourcevalidatordeploymentcontroller-deployment-controller--volumedatasourcevalidatordeploymentcontroller	aws-cloud-controller-manager	DeploymentUpdated	Updated Deployment.apps/volume-data-source-validator -n openshift-cluster-storage-operator because it changed
23:00:41	openshift-console-operator	deployment-controller	console-operator	ScalingReplicaSet	Scaled up replica set console-operator-fd4bb46c from 0 to 1
23:00:43 (x13)	openshift-insights	replicaset-controller	insights-operator-6f9c644dd9	FailedCreate	Error creating: pods "insights-operator-6f9c644dd9-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:00:44	openshift-kube-controller-manager	cluster-policy-controller	cluster-policy-controller-lock	LeaderElection	cluster-policy-controller-68978f75d8-58228_bc316a8d-d7a3-4164-83cd-26d1b8fdc86f became leader
23:00:45	openshift-ovn-kubernetes	ovnk-controlplane	ovn-kubernetes-master	LeaderElection	ovnkube-control-plane-555d45f96f-swbsk became leader
23:00:50	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-authentication namespace
23:00:50	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for kube-system namespace
23:00:50	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for kube-node-lease namespace
23:00:50	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-apiserver-operator namespace
23:00:50	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for default namespace
23:00:50	openshift-cluster-storage-operator	deployment-controller	volume-data-source-validator	ScalingReplicaSet	Scaled up replica set volume-data-source-validator-5c4db8bdf9 from 0 to 1
23:00:50	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-apiserver namespace
23:00:50	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cloud-credential-operator namespace
23:00:50	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for kube-public namespace
23:00:50	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-authentication-operator namespace
23:00:50	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift namespace
23:00:50 (x13)	openshift-cluster-storage-operator	replicaset-controller	volume-data-source-validator-6c58dcd66d	FailedCreate	Error creating: pods "volume-data-source-validator-6c58dcd66d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:00:50	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cloud-controller-manager namespace
23:00:51	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cloud-network-config-controller namespace
23:00:51	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cluster-samples-operator namespace
23:00:51	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cluster-node-tuning-operator namespace
23:00:51	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cluster-machine-approver namespace
23:00:51	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cluster-csi-drivers namespace
23:00:52	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cluster-version namespace
23:00:52	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-config-managed namespace
23:00:52	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-cluster-storage-operator namespace
23:00:52	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-config-operator namespace
23:00:52	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-config namespace
23:00:53	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-console-user-settings namespace
23:00:53	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-controller-manager namespace
23:00:53	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-console namespace
23:00:53	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-console-operator namespace
23:00:53	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-controller-manager-operator namespace
23:00:54	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-image-registry namespace
23:00:54	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-host-network namespace
23:00:54	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-dns-operator namespace
23:00:54	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-dns namespace
23:00:54	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-etcd namespace
23:00:55	openshift-image-registry	image-registry-operator	openshift-image-registry	DeploymentCreated	Created Deployment.apps/image-registry -n openshift-image-registry because it was missing
23:00:55 (x2)	openshift-image-registry	controllermanager	image-registry	NoPods	No matching pods found
23:00:55	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-insights namespace
23:00:55	openshift-image-registry	deployment-controller	image-registry	ScalingReplicaSet	Scaled up replica set image-registry-65c9d8846b from 0 to 1
23:00:55	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-infra namespace
23:00:55	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-ingress namespace
23:00:55	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-ingress-operator namespace
23:00:55	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-ingress-canary namespace
23:00:56	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-scheduler namespace
23:00:56	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-apiserver-operator namespace
23:00:56	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-controller-manager namespace
23:00:56	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-controller-manager-operator namespace
23:00:56	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-apiserver namespace
23:00:57	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-machine-api namespace
23:00:57	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-scheduler-operator namespace
23:00:57	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-storage-version-migrator-operator namespace
23:00:57	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-marketplace namespace
23:00:57	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-machine-config-operator namespace
23:00:58	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-network-operator namespace
23:00:58	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-multus namespace
23:00:58	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-network-diagnostics namespace
23:00:58	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-node namespace
23:00:58	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-monitoring namespace
23:00:58 (x14)	openshift-monitoring	replicaset-controller	cluster-monitoring-operator-847b8bd8d7	FailedCreate	Error creating: pods "cluster-monitoring-operator-847b8bd8d7-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:00:59	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-route-controller-manager namespace
23:00:59	openshift-network-diagnostics	deployment-controller	network-check-source	ScalingReplicaSet	Scaled up replica set network-check-source-7cbc45fddc from 0 to 1
23:00:59	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-operators namespace
23:00:59 (x13)	openshift-kube-storage-version-migrator-operator	replicaset-controller	kube-storage-version-migrator-operator-55889f7b47	FailedCreate	Error creating: pods "kube-storage-version-migrator-operator-55889f7b47-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:00:59	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-operator-lifecycle-manager namespace
23:00:59	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-ovn-kubernetes namespace
23:00:59	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-service-ca-operator namespace
23:01:00 (x11)	openshift-image-registry	replicaset-controller	image-registry-65c9d8846b	FailedCreate	Error creating: pods "image-registry-65c9d8846b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:01:00 (x12)	openshift-cluster-storage-operator	replicaset-controller	volume-data-source-validator-5c4db8bdf9	FailedCreate	Error creating: pods "volume-data-source-validator-5c4db8bdf9-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:01:00 (x13)	openshift-service-ca-operator	replicaset-controller	service-ca-operator-57cdc4b768	FailedCreate	Error creating: pods "service-ca-operator-57cdc4b768-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:01:00	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-user-workload-monitoring namespace
23:01:00 (x14)	openshift-ingress	replicaset-controller	router-default-5cd8bf6458	FailedCreate	Error creating: pods "router-default-5cd8bf6458-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:01:00	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-network-node-identity namespace
23:01:00 (x14)	openshift-ingress	replicaset-controller	router-default-5cd8bf6458	FailedCreate	Error creating: pods "router-default-5cd8bf6458-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:01:00 (x13)	openshift-cluster-samples-operator	replicaset-controller	cluster-samples-operator-685d7d68b5	FailedCreate	Error creating: pods "cluster-samples-operator-685d7d68b5-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:01:02 (x13)	openshift-console-operator	replicaset-controller	console-operator-fd4bb46c	FailedCreate	Error creating: pods "console-operator-fd4bb46c-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:01:02 (x10)	openshift-network-diagnostics	replicaset-controller	network-check-source-7cbc45fddc	FailedCreate	Error creating: pods "network-check-source-7cbc45fddc-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:01:04	openshift-network-node-identity	network-node-identity-57b9c97cd-ml2mk_0cbfd48a-6a25-4a68-af1f-c9868a731eba	ovnkube-identity	LeaderElection	network-node-identity-57b9c97cd-ml2mk_0cbfd48a-6a25-4a68-af1f-c9868a731eba became leader
23:01:21	openshift-operator-lifecycle-manager	controllermanager	packageserver-pdb	NoPods	No matching pods found
23:01:21	openshift-image-registry	controllermanager	image-registry	NoPods	No matching pods found
23:01:21	kube-system	kube-controller-manager	kube-controller-manager	LeaderElection	kube-controller-manager-84c5b887f-pq7q2_4a3feac5-2e16-4128-85b4-4af96c86c820 became leader
23:01:25	openshift-network-console	deployment-controller	networking-console-plugin	ScalingReplicaSet	Scaled up replica set networking-console-plugin-6446c8d75d from 0 to 1
23:01:25	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-network-console namespace
23:01:58	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for open-cluster-management-agent-addon namespace
23:01:58	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for open-cluster-management-93dee3fd-67ea-4296-9f8e-cfc37f6a1 namespace
23:04:05 (x16)	openshift-cluster-samples-operator	replicaset-controller	cluster-samples-operator-685d7d68b5	FailedCreate	Error creating: pods "cluster-samples-operator-685d7d68b5-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:04:05 (x16)	openshift-console-operator	replicaset-controller	console-operator-fd4bb46c	FailedCreate	Error creating: pods "console-operator-fd4bb46c-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:04:05 (x16)	openshift-monitoring	replicaset-controller	cluster-monitoring-operator-847b8bd8d7	FailedCreate	Error creating: pods "cluster-monitoring-operator-847b8bd8d7-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:04:05 (x16)	openshift-cluster-storage-operator	replicaset-controller	volume-data-source-validator-6c58dcd66d	FailedCreate	Error creating: pods "volume-data-source-validator-6c58dcd66d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:04:05 (x16)	openshift-ingress	replicaset-controller	router-default-5cd8bf6458	FailedCreate	Error creating: pods "router-default-5cd8bf6458-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:04:05 (x16)	openshift-network-diagnostics	replicaset-controller	network-check-source-7cbc45fddc	FailedCreate	Error creating: pods "network-check-source-7cbc45fddc-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:04:05 (x16)	openshift-image-registry	replicaset-controller	image-registry-65c9d8846b	FailedCreate	Error creating: pods "image-registry-65c9d8846b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:04:05 (x16)	openshift-ingress	replicaset-controller	router-default-5cd8bf6458	FailedCreate	Error creating: pods "router-default-5cd8bf6458-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:04:05 (x16)	openshift-insights	replicaset-controller	insights-operator-6f9c644dd9	FailedCreate	Error creating: pods "insights-operator-6f9c644dd9-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:04:05 (x16)	openshift-service-ca-operator	replicaset-controller	service-ca-operator-57cdc4b768	FailedCreate	Error creating: pods "service-ca-operator-57cdc4b768-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:04:05 (x16)	openshift-cluster-storage-operator	replicaset-controller	volume-data-source-validator-5c4db8bdf9	FailedCreate	Error creating: pods "volume-data-source-validator-5c4db8bdf9-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:04:05 (x16)	openshift-kube-storage-version-migrator-operator	replicaset-controller	kube-storage-version-migrator-operator-55889f7b47	FailedCreate	Error creating: pods "kube-storage-version-migrator-operator-55889f7b47-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:04:09 (x16)	openshift-network-console	replicaset-controller	networking-console-plugin-6446c8d75d	FailedCreate	Error creating: pods "networking-console-plugin-6446c8d75d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
23:06:14	openshift-image-registry	deployment-controller	image-registry	ScalingReplicaSet	Scaled up replica set image-registry-7f64f764df from 0 to 1
23:06:14	openshift-dns	daemonset-controller	node-resolver	SuccessfulCreate	Created pod: node-resolver-fxvl4
23:06:14	openshift-image-registry	replicaset-controller	image-registry-7f64f764df	SuccessfulCreate	Created pod: image-registry-7f64f764df-gtws9
23:06:14	openshift-cluster-csi-drivers	daemonset-controller	aws-ebs-csi-driver-node	SuccessfulCreate	Created pod: aws-ebs-csi-driver-node-r4q5m
23:06:14	openshift-cluster-node-tuning-operator	daemonset-controller	tuned	SuccessfulCreate	Created pod: tuned-swdt6
23:06:14	openshift-network-operator	daemonset-controller	iptables-alerter	SuccessfulCreate	Created pod: iptables-alerter-mqng4
23:06:14	openshift-network-diagnostics	daemonset-controller	network-check-target	SuccessfulCreate	Created pod: network-check-target-sq8mp
23:06:14	kube-system	daemonset-controller	konnectivity-agent	SuccessfulCreate	Created pod: konnectivity-agent-9vswh
23:06:14	openshift-multus	daemonset-controller	network-metrics-daemon	SuccessfulCreate	Created pod: network-metrics-daemon-vk29c
23:06:14	kube-system	daemonset-controller	global-pull-secret-syncer	SuccessfulCreate	Created pod: global-pull-secret-syncer-92l5f
23:06:14	openshift-image-registry	image-registry-operator	openshift-image-registry	DaemonSetUpdated	Updated DaemonSet.apps/node-ca -n openshift-image-registry because it changed
23:06:14	openshift-multus	daemonset-controller	multus-additional-cni-plugins	SuccessfulCreate	Created pod: multus-additional-cni-plugins-lx2wl
23:06:14	default	cloud-node-controller	ip-10-0-133-222.ec2.internal	Synced	Node synced successfully
23:06:14	openshift-ovn-kubernetes	daemonset-controller	ovnkube-node	SuccessfulCreate	Created pod: ovnkube-node-ljnfz
23:06:14 (x7)	default	kubelet	ip-10-0-133-222.ec2.internal	NodeHasSufficientMemory	Node ip-10-0-133-222.ec2.internal status is now: NodeHasSufficientMemory
23:06:14	openshift-image-registry	daemonset-controller	node-ca	SuccessfulCreate	Created pod: node-ca-l5s9l
23:06:14 (x7)	default	kubelet	ip-10-0-133-222.ec2.internal	NodeHasNoDiskPressure	Node ip-10-0-133-222.ec2.internal status is now: NodeHasNoDiskPressure
23:06:14 (x7)	default	kubelet	ip-10-0-133-222.ec2.internal	NodeHasSufficientPID	Node ip-10-0-133-222.ec2.internal status is now: NodeHasSufficientPID
23:06:14	default	kubelet	ip-10-0-133-222.ec2.internal	NodeAllocatableEnforced	Updated Node Allocatable limit across pods
23:06:14	openshift-multus	daemonset-controller	multus	SuccessfulCreate	Created pod: multus-nvk6c
23:06:15	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-r4q5m	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3d3869c161a073dfbaf036364ff0996f20e4d9ee240af9f0daa929f78c7ea46e"
23:06:15	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e"
23:06:15	openshift-network-operator	kubelet	iptables-alerter-mqng4	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8946e875b8c70aba812220ab6f6607097da88ae08ef6bebdabadea24dd62613d"
23:06:15	openshift-dns	kubelet	node-resolver-fxvl4	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8946e875b8c70aba812220ab6f6607097da88ae08ef6bebdabadea24dd62613d"
23:06:15	openshift-image-registry	kubelet	node-ca-l5s9l	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4cc46ad3182efd0b6783ccc5ae462469de3ead29627706b3a90ef2e46827bcd5"
23:06:15	kube-system	kubelet	konnectivity-agent-9vswh	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:804c33f4d2f186a4968326ed9d398c7bc4669539fb76023857e7b13efd6c8cb0"
23:06:15	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d69f815924343676a7380b09cff7434d6a4abe10f8c28dfff99ace3624e9604a"
23:06:15	openshift-multus	kubelet	multus-nvk6c	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e593011a6c882d153207bb561d02609759cba4aa0f900b0fe4479e5239e479bb"
23:06:15	kube-system	kubelet	kube-apiserver-proxy-ip-10-0-133-222.ec2.internal	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f"
23:06:15	openshift-cluster-node-tuning-operator	kubelet	tuned-swdt6	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea"
23:06:16	default	node-controller	ip-10-0-133-222.ec2.internal	RegisteredNode	Node ip-10-0-133-222.ec2.internal event: Registered Node ip-10-0-133-222.ec2.internal in Controller
23:06:29	kube-system	kubelet	kube-apiserver-proxy-ip-10-0-133-222.ec2.internal	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" in 14.442s (14.442s including waiting). Image size: 320421125 bytes.
23:06:30	openshift-multus	daemonset-controller	multus	SuccessfulCreate	Created pod: multus-lkdzw
23:06:30	openshift-multus	daemonset-controller	network-metrics-daemon	SuccessfulCreate	Created pod: network-metrics-daemon-d8wwk
23:06:30 (x7)	default	kubelet	ip-10-0-141-215.ec2.internal	NodeHasSufficientMemory	Node ip-10-0-141-215.ec2.internal status is now: NodeHasSufficientMemory
23:06:30	openshift-multus	daemonset-controller	multus-additional-cni-plugins	SuccessfulCreate	Created pod: multus-additional-cni-plugins-h42tf
23:06:30 (x7)	default	kubelet	ip-10-0-141-215.ec2.internal	NodeHasNoDiskPressure	Node ip-10-0-141-215.ec2.internal status is now: NodeHasNoDiskPressure
23:06:30 (x7)	default	kubelet	ip-10-0-141-215.ec2.internal	NodeHasSufficientPID	Node ip-10-0-141-215.ec2.internal status is now: NodeHasSufficientPID
23:06:30	default	kubelet	ip-10-0-141-215.ec2.internal	NodeAllocatableEnforced	Updated Node Allocatable limit across pods
23:06:30	default	cloud-node-controller	ip-10-0-141-215.ec2.internal	Synced	Node synced successfully
23:06:30	openshift-ovn-kubernetes	daemonset-controller	ovnkube-node	SuccessfulCreate	Created pod: ovnkube-node-2nzwr
23:06:30	kube-system	daemonset-controller	global-pull-secret-syncer	SuccessfulCreate	Created pod: global-pull-secret-syncer-fvjmj
23:06:30	openshift-cluster-node-tuning-operator	daemonset-controller	tuned	SuccessfulCreate	Created pod: tuned-2mjrz
23:06:30	openshift-image-registry	daemonset-controller	node-ca	SuccessfulCreate	Created pod: node-ca-skqrh
23:06:30	openshift-cluster-csi-drivers	daemonset-controller	aws-ebs-csi-driver-node	SuccessfulCreate	Created pod: aws-ebs-csi-driver-node-dg9pc
23:06:30	openshift-network-operator	daemonset-controller	iptables-alerter	SuccessfulCreate	Created pod: iptables-alerter-mrkhc
23:06:30	openshift-network-diagnostics	daemonset-controller	network-check-target	SuccessfulCreate	Created pod: network-check-target-zsdgk
23:06:30	kube-system	kubelet	konnectivity-agent-9vswh	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:804c33f4d2f186a4968326ed9d398c7bc4669539fb76023857e7b13efd6c8cb0" in 14.732s (14.732s including waiting). Image size: 287345457 bytes.
23:06:30	openshift-dns	daemonset-controller	node-resolver	SuccessfulCreate	Created pod: node-resolver-wzlbb
23:06:30	default	kubelet	ip-10-0-141-215.ec2.internal	Starting	Starting kubelet.
23:06:30	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d69f815924343676a7380b09cff7434d6a4abe10f8c28dfff99ace3624e9604a" in 14.686s (14.686s including waiting). Image size: 347291415 bytes.
23:06:30	kube-system	daemonset-controller	konnectivity-agent	SuccessfulCreate	Created pod: konnectivity-agent-qw68s
23:06:31	default	node-controller	ip-10-0-141-215.ec2.internal	RegisteredNode	Node ip-10-0-141-215.ec2.internal event: Registered Node ip-10-0-141-215.ec2.internal in Controller
23:06:31	kube-system	kubelet	kube-apiserver-proxy-ip-10-0-141-215.ec2.internal	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f"
23:06:33	kube-system	kubelet	kube-apiserver-proxy-ip-10-0-141-215.ec2.internal	Created	Created container: haproxy
23:06:33	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e"
23:06:33	openshift-image-registry	kubelet	node-ca-l5s9l	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4cc46ad3182efd0b6783ccc5ae462469de3ead29627706b3a90ef2e46827bcd5" in 18.403s (18.403s including waiting). Image size: 316415403 bytes.
23:06:33	openshift-dns	kubelet	node-resolver-wzlbb	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8946e875b8c70aba812220ab6f6607097da88ae08ef6bebdabadea24dd62613d"
23:06:33	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-dg9pc	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3d3869c161a073dfbaf036364ff0996f20e4d9ee240af9f0daa929f78c7ea46e"
23:06:33	kube-system	kubelet	konnectivity-agent-qw68s	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:804c33f4d2f186a4968326ed9d398c7bc4669539fb76023857e7b13efd6c8cb0"
23:06:33	openshift-cluster-node-tuning-operator	kubelet	tuned-swdt6	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea" in 18.513s (18.513s including waiting). Image size: 590341734 bytes.
23:06:33	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-r4q5m	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3d3869c161a073dfbaf036364ff0996f20e4d9ee240af9f0daa929f78c7ea46e" in 18.529s (18.529s including waiting). Image size: 352704612 bytes.
23:06:33	openshift-dns	kubelet	node-resolver-fxvl4	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8946e875b8c70aba812220ab6f6607097da88ae08ef6bebdabadea24dd62613d" in 18.421s (18.421s including waiting). Image size: 350070731 bytes.
23:06:33	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d69f815924343676a7380b09cff7434d6a4abe10f8c28dfff99ace3624e9604a"
23:06:33	kube-system	kubelet	kube-apiserver-proxy-ip-10-0-141-215.ec2.internal	Started	Started container haproxy
23:06:33	kube-system	kubelet	kube-apiserver-proxy-ip-10-0-141-215.ec2.internal	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" in 1.873s (1.873s including waiting). Image size: 320421125 bytes.
23:06:33	openshift-network-operator	kubelet	iptables-alerter-mrkhc	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8946e875b8c70aba812220ab6f6607097da88ae08ef6bebdabadea24dd62613d"
23:06:33	openshift-image-registry	kubelet	node-ca-skqrh	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4cc46ad3182efd0b6783ccc5ae462469de3ead29627706b3a90ef2e46827bcd5"
23:06:33	openshift-network-operator	kubelet	iptables-alerter-mqng4	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8946e875b8c70aba812220ab6f6607097da88ae08ef6bebdabadea24dd62613d" in 18.48s (18.48s including waiting). Image size: 350070731 bytes.
23:06:33	openshift-cluster-node-tuning-operator	kubelet	tuned-2mjrz	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea"
23:06:33	openshift-multus	kubelet	multus-lkdzw	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e593011a6c882d153207bb561d02609759cba4aa0f900b0fe4479e5239e479bb"
23:06:34	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-r4q5m	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:54fc81b7047fca86ea91318cae087e3f654cc8d54725953ea6f0ddfcaf515545"
23:06:34	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-r4q5m	Created	Created container: csi-driver
23:06:34	kube-system	kubelet	kube-apiserver-proxy-ip-10-0-133-222.ec2.internal	Started	Started container haproxy
23:06:34	openshift-image-registry	kubelet	node-ca-l5s9l	Created	Created container: node-ca
23:06:34	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Started	Started container egress-router-binary-copy
23:06:34	openshift-image-registry	kubelet	node-ca-l5s9l	Started	Started container node-ca
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Created	Created container: kube-rbac-proxy-ovn-metrics
23:06:34	openshift-multus	kubelet	multus-nvk6c	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e593011a6c882d153207bb561d02609759cba4aa0f900b0fe4479e5239e479bb" in 18.776s (18.776s including waiting). Image size: 1186602155 bytes.
23:06:34	openshift-multus	kubelet	multus-nvk6c	Created	Created container: kube-multus
23:06:34	kube-system	kubelet	kube-apiserver-proxy-ip-10-0-133-222.ec2.internal	Created	Created container: haproxy
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Started	Started container kube-rbac-proxy-ovn-metrics
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Started	Started container kube-rbac-proxy-node
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Created	Created container: kube-rbac-proxy-node
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:06:34	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Created	Created container: egress-router-binary-copy
23:06:34	openshift-multus	kubelet	multus-nvk6c	Started	Started container kube-multus
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Started	Started container nbdb
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Started	Started container ovn-acl-logging
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Created	Created container: ovn-acl-logging
23:06:34	openshift-cluster-node-tuning-operator	kubelet	tuned-swdt6	Started	Started container tuned
23:06:34	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-r4q5m	Started	Started container csi-driver
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" in 18.505s (18.505s including waiting). Image size: 1189908850 bytes.
23:06:34	openshift-dns	kubelet	node-resolver-fxvl4	Created	Created container: dns-node-resolver
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Created	Created container: nbdb
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:06:34	openshift-dns	kubelet	node-resolver-fxvl4	Started	Started container dns-node-resolver
23:06:34	openshift-cluster-node-tuning-operator	kubelet	tuned-swdt6	Created	Created container: tuned
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Created	Created container: northd
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Started	Started container northd
23:06:34	kube-system	kubelet	konnectivity-agent-9vswh	Created	Created container: konnectivity-agent
23:06:34	kube-system	kubelet	konnectivity-agent-9vswh	Started	Started container konnectivity-agent
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Created	Created container: ovn-controller
23:06:34	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Started	Started container ovn-controller
23:06:35	openshift-network-operator	kubelet	iptables-alerter-mqng4	Started	Started container iptables-alerter
23:06:35	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-r4q5m	Started	Started container csi-node-driver-registrar
23:06:35	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-r4q5m	Created	Created container: csi-node-driver-registrar
23:06:35	openshift-network-operator	kubelet	iptables-alerter-mqng4	Created	Created container: iptables-alerter
23:06:35	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-r4q5m	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c43eb8f4e3024c90d819ecdc6c4101d91bd5c368d5b50945756ddf6fa4b3b9cf"
23:06:35	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-r4q5m	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:54fc81b7047fca86ea91318cae087e3f654cc8d54725953ea6f0ddfcaf515545" in 755ms (755ms including waiting). Image size: 238601909 bytes.
23:06:35	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:62a4fddd79f098aea5d63eb9901680b25b64ae1ae744fe7062a29d278ba7a6d5"
23:06:36	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Started	Started container sbdb
23:06:36	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-r4q5m	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c43eb8f4e3024c90d819ecdc6c4101d91bd5c368d5b50945756ddf6fa4b3b9cf" in 1.148s (1.148s including waiting). Image size: 238859942 bytes.
23:06:36	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-r4q5m	Created	Created container: csi-liveness-probe
23:06:36	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Created	Created container: sbdb
23:06:36	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-r4q5m	Started	Started container csi-liveness-probe
23:06:36	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:06:37 (x18)	openshift-cluster-storage-operator	storage-status-controller-statussyncer_storage	aws-cloud-controller-manager	OperatorStatusChanged	(combined from similar events): Status for clusteroperator/storage changed: Available changed from False to True ("DefaultStorageClassControllerAvailable: StorageClass provided by supplied CSI Driver instead of the cluster-storage-operator\nAWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverNodeServiceControllerAvailable: DaemonSet is available\nAWSEBSCSIDriverOperatorCRAvailable: AWSEBSDriverControllerServiceControllerAvailable: Deployment is available")
23:06:38	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:06:39	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Started	Started container ovnkube-controller
23:06:39	openshift-ovn-kubernetes	kubelet	ovnkube-node-ljnfz	Created	Created container: ovnkube-controller
23:06:40 (x4)	default	ovnk-controlplane	ip-10-0-133-222.ec2.internal	ErrorReconcilingNode	[k8s.ovn.org/node-chassis-id annotation not found for node ip-10-0-133-222.ec2.internal, error getting gateway config for node ip-10-0-133-222.ec2.internal: k8s.ovn.org/l3-gateway-config annotation not found for node "ip-10-0-133-222.ec2.internal", failed to update chassis to local for local node ip-10-0-133-222.ec2.internal, error: failed to parse node chassis-id for node - ip-10-0-133-222.ec2.internal, error: k8s.ovn.org/node-chassis-id annotation not found for node ip-10-0-133-222.ec2.internal]
23:06:42	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Started	Started container cni-plugins
23:06:42	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Created	Created container: cni-plugins
23:06:42	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:62a4fddd79f098aea5d63eb9901680b25b64ae1ae744fe7062a29d278ba7a6d5" in 6.544s (6.544s including waiting). Image size: 541678855 bytes.
23:06:42	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ac45c784ed515baa8893b738667ff319f42d867171bbc17726853391cbcb96ae"
23:06:43	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ac45c784ed515baa8893b738667ff319f42d867171bbc17726853391cbcb96ae" in 1.167s (1.167s including waiting). Image size: 226114472 bytes.
23:06:43	default	kubelet	ip-10-0-140-44.ec2.internal	NodeAllocatableEnforced	Updated Node Allocatable limit across pods
23:06:43	default	kubelet	ip-10-0-140-44.ec2.internal	Starting	Starting kubelet.
23:06:43	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Created	Created container: bond-cni-plugin
23:06:43	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Started	Started container bond-cni-plugin
23:06:44	openshift-cluster-csi-drivers	daemonset-controller	aws-ebs-csi-driver-node	SuccessfulCreate	Created pod: aws-ebs-csi-driver-node-5gdc6
23:06:44 (x3)	openshift-ingress	service-controller	router-default	UpdatedLoadBalancer	Updated load balancer with new hosts
23:06:44	default	cloud-node-controller	ip-10-0-140-44.ec2.internal	Synced	Node synced successfully
23:06:44	openshift-dns	daemonset-controller	node-resolver	SuccessfulCreate	Created pod: node-resolver-qkccv
23:06:44	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64ef7e5a22628f287b1ddc492a203e750d9d771272ba4cac4b558d719a0c3832"
23:06:44	openshift-multus	daemonset-controller	network-metrics-daemon	SuccessfulCreate	Created pod: network-metrics-daemon-r5mz6
23:06:44	openshift-multus	daemonset-controller	multus-additional-cni-plugins	SuccessfulCreate	Created pod: multus-additional-cni-plugins-9sjsw
23:06:44	openshift-network-diagnostics	daemonset-controller	network-check-target	SuccessfulCreate	Created pod: network-check-target-9vxwv
23:06:44	kube-system	daemonset-controller	global-pull-secret-syncer	SuccessfulCreate	Created pod: global-pull-secret-syncer-rw5hp
23:06:44	openshift-image-registry	daemonset-controller	node-ca	SuccessfulCreate	Created pod: node-ca-dghj8
23:06:44	openshift-network-operator	daemonset-controller	iptables-alerter	SuccessfulCreate	Created pod: iptables-alerter-xzrtv
23:06:44	openshift-cluster-node-tuning-operator	daemonset-controller	tuned	SuccessfulCreate	Created pod: tuned-rjcdn
23:06:44	openshift-ovn-kubernetes	daemonset-controller	ovnkube-node	SuccessfulCreate	Created pod: ovnkube-node-zlpxj
23:06:44 (x7)	default	kubelet	ip-10-0-140-44.ec2.internal	NodeHasSufficientPID	Node ip-10-0-140-44.ec2.internal status is now: NodeHasSufficientPID
23:06:44 (x7)	default	kubelet	ip-10-0-140-44.ec2.internal	NodeHasSufficientMemory	Node ip-10-0-140-44.ec2.internal status is now: NodeHasSufficientMemory
23:06:44	openshift-multus	daemonset-controller	multus	SuccessfulCreate	Created pod: multus-xg9wq
23:06:44 (x7)	default	kubelet	ip-10-0-140-44.ec2.internal	NodeHasNoDiskPressure	Node ip-10-0-140-44.ec2.internal status is now: NodeHasNoDiskPressure
23:06:44	kube-system	daemonset-controller	konnectivity-agent	SuccessfulCreate	Created pod: konnectivity-agent-5xj9x
23:06:44 (x3)	openshift-ingress	service-controller	router-default	UpdatedLoadBalancer	Updated load balancer with new hosts
23:06:45	kube-system	kubelet	kube-apiserver-proxy-ip-10-0-140-44.ec2.internal	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f"
23:06:45 (x16)	openshift-network-diagnostics	kubelet	network-check-target-sq8mp	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
23:06:45	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:12cb51ec57bf3b05a5dd183836fbe84495da0bab151903002153f81d3564bb32"
23:06:45	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Created	Created container: routeoverride-cni
23:06:45	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Started	Started container routeoverride-cni
23:06:45	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64ef7e5a22628f287b1ddc492a203e750d9d771272ba4cac4b558d719a0c3832" in 772ms (772ms including waiting). Image size: 221667607 bytes.
23:06:46	default	node-controller	ip-10-0-140-44.ec2.internal	RegisteredNode	Node ip-10-0-140-44.ec2.internal event: Registered Node ip-10-0-140-44.ec2.internal in Controller
23:06:46 (x7)	openshift-multus	kubelet	network-metrics-daemon-vk29c	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : object "openshift-multus"/"metrics-daemon-secret" not registered
23:06:46 (x18)	kube-system	kubelet	global-pull-secret-syncer-92l5f	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
23:06:46 (x7)	openshift-network-diagnostics	kubelet	network-check-target-sq8mp	FailedMount	MountVolume.SetUp failed for volume "kube-api-access-xlff5" : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
23:06:46	kube-system	kubelet	konnectivity-agent-qw68s	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:804c33f4d2f186a4968326ed9d398c7bc4669539fb76023857e7b13efd6c8cb0" in 13.443s (13.443s including waiting). Image size: 287345457 bytes.
23:06:46 (x17)	openshift-multus	kubelet	network-metrics-daemon-vk29c	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
23:06:46 (x7)	kube-system	kubelet	global-pull-secret-syncer-92l5f	FailedMount	MountVolume.SetUp failed for volume "original-pull-secret" : object "kube-system"/"original-pull-secret" not registered
23:06:47	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e"
23:06:47	kube-system	kubelet	kube-apiserver-proxy-ip-10-0-140-44.ec2.internal	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" in 1.949s (1.949s including waiting). Image size: 320421125 bytes.
23:06:47	openshift-ingress-canary	kubelet	ingress-canary-6xlrg	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:95b866020b3bf0ae064bff227e49faec3542fd6542471f32f86e086c087451cf"
23:06:47	kube-system	kubelet	kube-apiserver-proxy-ip-10-0-140-44.ec2.internal	Created	Created container: haproxy
23:06:47	openshift-network-operator	kubelet	iptables-alerter-xzrtv	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8946e875b8c70aba812220ab6f6607097da88ae08ef6bebdabadea24dd62613d"
23:06:47	openshift-cluster-node-tuning-operator	kubelet	tuned-rjcdn	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea"
23:06:47	kube-system	kubelet	konnectivity-agent-5xj9x	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:804c33f4d2f186a4968326ed9d398c7bc4669539fb76023857e7b13efd6c8cb0"
23:06:47	default	kubelet	ip-10-0-133-222.ec2.internal	NodeReady	Node ip-10-0-133-222.ec2.internal status is now: NodeReady
23:06:47	openshift-ingress-canary	daemonset-controller	ingress-canary	SuccessfulCreate	Created pod: ingress-canary-6xlrg
23:06:47	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-5gdc6	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3d3869c161a073dfbaf036364ff0996f20e4d9ee240af9f0daa929f78c7ea46e"
23:06:47	kube-system	kubelet	kube-apiserver-proxy-ip-10-0-140-44.ec2.internal	Started	Started container haproxy
23:06:47	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d69f815924343676a7380b09cff7434d6a4abe10f8c28dfff99ace3624e9604a"
23:06:47	openshift-dns	daemonset-controller	dns-default	SuccessfulCreate	Created pod: dns-default-2fdkb
23:06:47	openshift-image-registry	kubelet	node-ca-dghj8	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4cc46ad3182efd0b6783ccc5ae462469de3ead29627706b3a90ef2e46827bcd5"
23:06:47	openshift-dns	kubelet	node-resolver-qkccv	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8946e875b8c70aba812220ab6f6607097da88ae08ef6bebdabadea24dd62613d"
23:06:47	openshift-ingress-canary	multus	ingress-canary-6xlrg	AddedInterface	Add eth0 [10.132.0.8/23] from ovn-kubernetes
23:06:47	openshift-multus	kubelet	multus-xg9wq	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e593011a6c882d153207bb561d02609759cba4aa0f900b0fe4479e5239e479bb"
23:06:49	openshift-kube-storage-version-migrator-operator	replicaset-controller	kube-storage-version-migrator-operator-55889f7b47	SuccessfulCreate	Created pod: kube-storage-version-migrator-operator-55889f7b47-4gmns
23:06:49	openshift-cluster-storage-operator	replicaset-controller	volume-data-source-validator-5c4db8bdf9	SuccessfulCreate	Created pod: volume-data-source-validator-5c4db8bdf9-sx67h
23:06:49	openshift-insights	replicaset-controller	insights-operator-6f9c644dd9	SuccessfulCreate	Created pod: insights-operator-6f9c644dd9-gw259
23:06:49	openshift-ingress	replicaset-controller	router-default-5cd8bf6458	SuccessfulCreate	Created pod: router-default-5cd8bf6458-jhsss
23:06:49	openshift-network-diagnostics	replicaset-controller	network-check-source-7cbc45fddc	SuccessfulCreate	Created pod: network-check-source-7cbc45fddc-5bgrm
23:06:49	openshift-cluster-storage-operator	replicaset-controller	volume-data-source-validator-6c58dcd66d	SuccessfulCreate	Created pod: volume-data-source-validator-6c58dcd66d-nc7tm
23:06:49	openshift-cluster-samples-operator	replicaset-controller	cluster-samples-operator-685d7d68b5	SuccessfulCreate	Created pod: cluster-samples-operator-685d7d68b5-lrvzv
23:06:49	openshift-monitoring	replicaset-controller	cluster-monitoring-operator-847b8bd8d7	SuccessfulCreate	Created pod: cluster-monitoring-operator-847b8bd8d7-r2vwj
23:06:49	openshift-ingress	replicaset-controller	router-default-5cd8bf6458	SuccessfulCreate	Created pod: router-default-5cd8bf6458-jhsss
23:06:49	openshift-console-operator	replicaset-controller	console-operator-fd4bb46c	SuccessfulCreate	Created pod: console-operator-fd4bb46c-kfrv8
23:06:49	openshift-service-ca-operator	replicaset-controller	service-ca-operator-57cdc4b768	SuccessfulCreate	Created pod: service-ca-operator-57cdc4b768-g6ngg
23:06:49	openshift-image-registry	replicaset-controller	image-registry-65c9d8846b	SuccessfulCreate	Created pod: image-registry-65c9d8846b-wq7k9
23:06:51	openshift-network-operator	kubelet	iptables-alerter-mrkhc	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8946e875b8c70aba812220ab6f6607097da88ae08ef6bebdabadea24dd62613d" in 17.695s (17.695s including waiting). Image size: 350070731 bytes.
23:06:51	openshift-multus	kubelet	multus-lkdzw	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e593011a6c882d153207bb561d02609759cba4aa0f900b0fe4479e5239e479bb" in 17.751s (17.751s including waiting). Image size: 1186602155 bytes.
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Started	Started container northd
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Created	Created container: northd
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:06:51	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:12cb51ec57bf3b05a5dd183836fbe84495da0bab151903002153f81d3564bb32" in 5.897s (5.897s including waiting). Image size: 583957089 bytes.
23:06:51	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Created	Created container: whereabouts-cni-bincopy
23:06:51	openshift-image-registry	kubelet	node-ca-skqrh	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4cc46ad3182efd0b6783ccc5ae462469de3ead29627706b3a90ef2e46827bcd5" in 17.689s (17.689s including waiting). Image size: 316415403 bytes.
23:06:51	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Started	Started container whereabouts-cni-bincopy
23:06:51	openshift-image-registry	kubelet	node-ca-skqrh	Created	Created container: node-ca
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Created	Created container: nbdb
23:06:51	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:62a4fddd79f098aea5d63eb9901680b25b64ae1ae744fe7062a29d278ba7a6d5"
23:06:51	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Started	Started container egress-router-binary-copy
23:06:51	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Created	Created container: egress-router-binary-copy
23:06:51	openshift-image-registry	kubelet	node-ca-skqrh	Started	Started container node-ca
23:06:51	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d69f815924343676a7380b09cff7434d6a4abe10f8c28dfff99ace3624e9604a" in 17.689s (17.689s including waiting). Image size: 347291415 bytes.
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Started	Started container nbdb
23:06:51	openshift-multus	kubelet	multus-lkdzw	Created	Created container: kube-multus
23:06:51	openshift-multus	kubelet	multus-lkdzw	Started	Started container kube-multus
23:06:51	openshift-service-ca-operator	kubelet	service-ca-operator-57cdc4b768-g6ngg	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c030b660bee8debb47feae355ad21ca87984abf181de93e6a0bb3750cab88c4f"
23:06:51	openshift-service-ca-operator	multus	service-ca-operator-57cdc4b768-g6ngg	AddedInterface	Add eth0 [10.132.0.15/23] from ovn-kubernetes
23:06:51	openshift-insights	kubelet	insights-operator-6f9c644dd9-gw259	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9c8b813e74034164c1abfb26369b76f4b6d24f3d46e277b08f72ddcbc369c7d8"
23:06:51	openshift-insights	multus	insights-operator-6f9c644dd9-gw259	AddedInterface	Add eth0 [10.132.0.14/23] from ovn-kubernetes
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Started	Started container kube-rbac-proxy-ovn-metrics
23:06:51	openshift-cluster-node-tuning-operator	kubelet	tuned-2mjrz	Started	Started container tuned
23:06:51	openshift-cluster-node-tuning-operator	kubelet	tuned-2mjrz	Created	Created container: tuned
23:06:51	openshift-cluster-node-tuning-operator	kubelet	tuned-2mjrz	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea" in 17.687s (17.688s including waiting). Image size: 590341734 bytes.
23:06:51	openshift-ingress-canary	kubelet	ingress-canary-6xlrg	Started	Started container serve-healthcheck-canary
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Created	Created container: kube-rbac-proxy-ovn-metrics
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Started	Started container kube-rbac-proxy-node
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Created	Created container: kube-rbac-proxy-node
23:06:51	openshift-network-diagnostics	multus	network-check-source-7cbc45fddc-5bgrm	AddedInterface	Add eth0 [10.132.0.16/23] from ovn-kubernetes
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Started	Started container ovn-acl-logging
23:06:51	openshift-kube-storage-version-migrator-operator	kubelet	kube-storage-version-migrator-operator-55889f7b47-4gmns	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:19f97ecb88e6cbef776b9ec3c20fde1b9bf3e3584afdd21ed2dab9d4b0541102"
23:06:51	openshift-ingress-canary	kubelet	ingress-canary-6xlrg	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:95b866020b3bf0ae064bff227e49faec3542fd6542471f32f86e086c087451cf" in 3.645s (3.645s including waiting). Image size: 390259992 bytes.
23:06:51	openshift-kube-storage-version-migrator-operator	multus	kube-storage-version-migrator-operator-55889f7b47-4gmns	AddedInterface	Add eth0 [10.132.0.13/23] from ovn-kubernetes
23:06:51	openshift-console-operator	multus	console-operator-fd4bb46c-kfrv8	AddedInterface	Add eth0 [10.132.0.12/23] from ovn-kubernetes
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Created	Created container: ovn-acl-logging
23:06:51	openshift-ingress-canary	kubelet	ingress-canary-6xlrg	Created	Created container: serve-healthcheck-canary
23:06:51	openshift-console-operator	kubelet	console-operator-fd4bb46c-kfrv8	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff12d08d05379ba6cf62fe8dd9e33da283be9c68b68f66ada7dad62f9fadd6b5"
23:06:51	openshift-network-diagnostics	kubelet	network-check-source-7cbc45fddc-5bgrm	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:37390c626811724e9dfa2edb9b6f7ab4c26ce227e3068999d52f275c82722991"
23:06:51	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-dg9pc	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:54fc81b7047fca86ea91318cae087e3f654cc8d54725953ea6f0ddfcaf515545"
23:06:51	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-dg9pc	Started	Started container csi-driver
23:06:51	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-dg9pc	Created	Created container: csi-driver
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" in 17.71s (17.71s including waiting). Image size: 1189908850 bytes.
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Started	Started container ovn-controller
23:06:51	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-dg9pc	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3d3869c161a073dfbaf036364ff0996f20e4d9ee240af9f0daa929f78c7ea46e" in 17.687s (17.687s including waiting). Image size: 352704612 bytes.
23:06:51	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Created	Created container: ovn-controller
23:06:51	openshift-dns	kubelet	node-resolver-wzlbb	Started	Started container dns-node-resolver
23:06:51	openshift-dns	kubelet	node-resolver-wzlbb	Created	Created container: dns-node-resolver
23:06:51	kube-system	kubelet	konnectivity-agent-qw68s	Started	Started container konnectivity-agent
23:06:51	openshift-cluster-storage-operator	kubelet	volume-data-source-validator-5c4db8bdf9-sx67h	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fcf92586b0800da0c7611d579e19b109bc966fa0cbc624de06c4a2b416d8cce7"
23:06:51	openshift-cluster-storage-operator	multus	volume-data-source-validator-5c4db8bdf9-sx67h	AddedInterface	Add eth0 [10.132.0.9/23] from ovn-kubernetes
23:06:51	openshift-dns	kubelet	node-resolver-wzlbb	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8946e875b8c70aba812220ab6f6607097da88ae08ef6bebdabadea24dd62613d" in 17.642s (17.642s including waiting). Image size: 350070731 bytes.
23:06:51	kube-system	kubelet	konnectivity-agent-qw68s	Created	Created container: konnectivity-agent
23:06:52	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-dg9pc	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:54fc81b7047fca86ea91318cae087e3f654cc8d54725953ea6f0ddfcaf515545" in 852ms (852ms including waiting). Image size: 238601909 bytes.
23:06:52	openshift-network-operator	kubelet	iptables-alerter-mrkhc	Created	Created container: iptables-alerter
23:06:52	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-dg9pc	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c43eb8f4e3024c90d819ecdc6c4101d91bd5c368d5b50945756ddf6fa4b3b9cf"
23:06:52	openshift-network-operator	kubelet	iptables-alerter-mrkhc	Started	Started container iptables-alerter
23:06:52	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-dg9pc	Started	Started container csi-node-driver-registrar
23:06:52	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-dg9pc	Created	Created container: csi-node-driver-registrar
23:06:53	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Started	Started container whereabouts-cni
23:06:53	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-dg9pc	Started	Started container csi-liveness-probe
23:06:53	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Created	Created container: kube-multus-additional-cni-plugins
23:06:53	openshift-cluster-storage-operator	kubelet	volume-data-source-validator-5c4db8bdf9-sx67h	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fcf92586b0800da0c7611d579e19b109bc966fa0cbc624de06c4a2b416d8cce7" in 1.731s (1.731s including waiting). Image size: 253368055 bytes.
23:06:53	openshift-cluster-storage-operator	kubelet	volume-data-source-validator-5c4db8bdf9-sx67h	Created	Created container: volume-data-source-validator
23:06:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:06:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Created	Created container: sbdb
23:06:53	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Started	Started container sbdb
23:06:53	openshift-cluster-storage-operator	kubelet	volume-data-source-validator-5c4db8bdf9-sx67h	Started	Started container volume-data-source-validator
23:06:53	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e593011a6c882d153207bb561d02609759cba4aa0f900b0fe4479e5239e479bb" already present on machine
23:06:53	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Created	Created container: whereabouts-cni
23:06:53	openshift-multus	kubelet	multus-additional-cni-plugins-lx2wl	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:12cb51ec57bf3b05a5dd183836fbe84495da0bab151903002153f81d3564bb32" already present on machine
23:06:53	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-dg9pc	Created	Created container: csi-liveness-probe
23:06:53	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-dg9pc	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c43eb8f4e3024c90d819ecdc6c4101d91bd5c368d5b50945756ddf6fa4b3b9cf" in 879ms (879ms including waiting). Image size: 238859942 bytes.
23:06:53	openshift-cluster-storage-operator	data-source-validator-leader/volume-data-source-validator-5c4db8bdf9-sx67h	data-source-validator-leader	LeaderElection	volume-data-source-validator-5c4db8bdf9-sx67h became leader
23:06:53	openshift-network-console	replicaset-controller	networking-console-plugin-6446c8d75d	SuccessfulCreate	Created pod: networking-console-plugin-6446c8d75d-dp5fl
23:06:54	openshift-cluster-storage-operator	replicaset-controller	volume-data-source-validator-6c58dcd66d	SuccessfulDelete	Deleted pod: volume-data-source-validator-6c58dcd66d-nc7tm
23:06:54	openshift-cluster-storage-operator	deployment-controller	volume-data-source-validator	ScalingReplicaSet	Scaled down replica set volume-data-source-validator-6c58dcd66d from 1 to 0
23:06:55	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:06:55	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:62a4fddd79f098aea5d63eb9901680b25b64ae1ae744fe7062a29d278ba7a6d5" in 4.364s (4.364s including waiting). Image size: 541678855 bytes.
23:06:56	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ac45c784ed515baa8893b738667ff319f42d867171bbc17726853391cbcb96ae"
23:06:56	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Created	Created container: cni-plugins
23:06:56	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Started	Started container ovnkube-controller
23:06:56	openshift-ovn-kubernetes	kubelet	ovnkube-node-2nzwr	Created	Created container: ovnkube-controller
23:06:56	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Started	Started container cni-plugins
23:06:56 (x5)	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-685d7d68b5-lrvzv	FailedMount	MountVolume.SetUp failed for volume "samples-operator-tls" : secret "samples-operator-tls" not found
23:06:57	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Started	Started container bond-cni-plugin
23:06:57	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ac45c784ed515baa8893b738667ff319f42d867171bbc17726853391cbcb96ae" in 1.11s (1.11s including waiting). Image size: 226114472 bytes.
23:06:57	kube-system	kubelet	konnectivity-agent-5xj9x	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:804c33f4d2f186a4968326ed9d398c7bc4669539fb76023857e7b13efd6c8cb0" in 9.956s (9.956s including waiting). Image size: 287345457 bytes.
23:06:57 (x3)	default	ovnk-controlplane	ip-10-0-141-215.ec2.internal	ErrorReconcilingNode	[k8s.ovn.org/node-chassis-id annotation not found for node ip-10-0-141-215.ec2.internal, error getting gateway config for node ip-10-0-141-215.ec2.internal: k8s.ovn.org/l3-gateway-config annotation not found for node "ip-10-0-141-215.ec2.internal", failed to update chassis to local for local node ip-10-0-141-215.ec2.internal, error: failed to parse node chassis-id for node - ip-10-0-141-215.ec2.internal, error: k8s.ovn.org/node-chassis-id annotation not found for node ip-10-0-141-215.ec2.internal]
23:06:57	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Created	Created container: bond-cni-plugin
23:06:58	openshift-console-operator	kubelet	console-operator-fd4bb46c-kfrv8	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff12d08d05379ba6cf62fe8dd9e33da283be9c68b68f66ada7dad62f9fadd6b5" in 6.339s (6.339s including waiting). Image size: 340166709 bytes.
23:06:58	openshift-kube-storage-version-migrator-operator	kubelet	kube-storage-version-migrator-operator-55889f7b47-4gmns	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:19f97ecb88e6cbef776b9ec3c20fde1b9bf3e3584afdd21ed2dab9d4b0541102" in 6.341s (6.341s including waiting). Image size: 332365783 bytes.
23:06:58	openshift-network-diagnostics	kubelet	network-check-source-7cbc45fddc-5bgrm	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:37390c626811724e9dfa2edb9b6f7ab4c26ce227e3068999d52f275c82722991" in 6.346s (6.346s including waiting). Image size: 459700390 bytes.
23:06:58	openshift-service-ca-operator	service-ca-operator	service-ca-operator-lock	LeaderElection	service-ca-operator-57cdc4b768-g6ngg_0cf4f581-a8fb-43e3-9029-686f124c658c became leader
23:06:58	openshift-network-diagnostics	kubelet	network-check-source-7cbc45fddc-5bgrm	Started	Started container check-endpoints
23:06:58	openshift-network-diagnostics	kubelet	network-check-source-7cbc45fddc-5bgrm	Created	Created container: check-endpoints
23:06:58	openshift-service-ca-operator	kubelet	service-ca-operator-57cdc4b768-g6ngg	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c030b660bee8debb47feae355ad21ca87984abf181de93e6a0bb3750cab88c4f" in 6.334s (6.334s including waiting). Image size: 341225223 bytes.
23:06:58	openshift-insights	kubelet	insights-operator-6f9c644dd9-gw259	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9c8b813e74034164c1abfb26369b76f4b6d24f3d46e277b08f72ddcbc369c7d8" in 6.341s (6.341s including waiting). Image size: 336828457 bytes.
23:06:58	openshift-service-ca-operator	service-ca-operator	service-ca-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "GatewayAPIWithoutOLM", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
23:06:58	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64ef7e5a22628f287b1ddc492a203e750d9d771272ba4cac4b558d719a0c3832"
23:06:59	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Created	Created container: routeoverride-cni
23:06:59	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-kubestorageversionmigratorstaticresources-kubestorageversionmigratorstaticresources-staticresources	kube-storage-version-migrator-operator	ServiceAccountCreated	Created ServiceAccount/kube-storage-version-migrator-sa -n openshift-kube-storage-version-migrator because it was missing
23:06:59	openshift-kube-storage-version-migrator	replicaset-controller	migrator-76794cbd6c	SuccessfulCreate	Created pod: migrator-76794cbd6c-r8t9z
23:06:59	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-status-controller-statussyncer_kube-storage-version-migrator	kube-storage-version-migrator-operator	OperatorStatusChanged	Status for clusteroperator/kube-storage-version-migrator changed: Upgradeable changed from Unknown to True ("All is well")
23:06:59	openshift-service-ca-operator	service-ca-operator	service-ca-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/system:openshift:controller:service-ca -n openshift-service-ca because it was missing
23:06:59	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-kubestorageversionmigrator-deployment-controller--kubestorageversionmigrator	kube-storage-version-migrator-operator	DeploymentCreated	Created Deployment.apps/migrator -n openshift-kube-storage-version-migrator because it was missing
23:06:59	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Started	Started container routeoverride-cni
23:06:59	openshift-service-ca-operator	service-ca-operator	service-ca-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/system:openshift:controller:service-ca -n openshift-service-ca because it was missing
23:06:59	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-status-controller-statussyncer_kube-storage-version-migrator	kube-storage-version-migrator-operator	OperatorStatusChanged	Status for clusteroperator/kube-storage-version-migrator changed: Progressing changed from Unknown to True ("KubeStorageVersionMigratorProgressing: Waiting for Deployment to act on changes"),Available changed from Unknown to False ("KubeStorageVersionMigratorAvailable: Waiting for Deployment")
23:06:59	openshift-service-ca-operator	service-ca-operator	service-ca-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/system:openshift:controller:service-ca because it was missing
23:06:59	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-kubestorageversionmigratorstaticresources-kubestorageversionmigratorstaticresources-staticresources	kube-storage-version-migrator-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/storage-version-migration-migrator because it was missing
23:06:59	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-status-controller-statussyncer_kube-storage-version-migrator	kube-storage-version-migrator-operator	OperatorVersionChanged	clusteroperator/kube-storage-version-migrator version "operator" changed from "" to "4.21.34"
23:06:59	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64ef7e5a22628f287b1ddc492a203e750d9d771272ba4cac4b558d719a0c3832" in 1.063s (1.063s including waiting). Image size: 221667607 bytes.
23:06:59	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-kube-storage-version-migrator namespace
23:06:59	openshift-service-ca-operator	service-ca-operator	service-ca-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/system:openshift:controller:service-ca because it was missing
23:06:59	openshift-kube-storage-version-migrator	deployment-controller	migrator	ScalingReplicaSet	Scaled up replica set migrator-76794cbd6c from 0 to 1
23:06:59	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-status-controller-statussyncer_kube-storage-version-migrator	kube-storage-version-migrator-operator	OperatorStatusChanged	Status for clusteroperator/kube-storage-version-migrator changed: Degraded set to Unknown (""),Progressing set to Unknown (""),Available set to Unknown (""),Upgradeable set to Unknown (""),EvaluationConditionsDetected set to Unknown (""),status.versions changed from [] to [{"operator" "4.21.34"}]
23:06:59	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-kubestorageversionmigratorstaticresources-kubestorageversionmigratorstaticresources-staticresources	kube-storage-version-migrator-operator	NamespaceCreated	Created Namespace/openshift-kube-storage-version-migrator because it was missing
23:06:59	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-status-controller-statussyncer_kube-storage-version-migrator	kube-storage-version-migrator-operator	OperatorStatusChanged	Status for clusteroperator/kube-storage-version-migrator changed: Degraded changed from Unknown to False ("All is well")
23:06:59	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-service-ca namespace
23:06:59	openshift-service-ca-operator	service-ca-operator	service-ca-operator	NamespaceCreated	Created Namespace/openshift-service-ca because it was missing
23:06:59	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-lock	LeaderElection	kube-storage-version-migrator-operator-55889f7b47-4gmns_1388f38a-c5ef-48c9-baa0-b50280bbd89c became leader
23:06:59	openshift-insights	openshift-insights-operator	insights-operator	DaemonSet Updated	Runtime extractor DaemonSet openshift-insights/insights-runtime-extractor was created or updated
23:06:59	openshift-insights	daemonset-controller	insights-runtime-extractor	SuccessfulCreate	Created pod: insights-runtime-extractor-vhnn4
23:06:59	openshift-service-ca-operator	service-ca-operator-status-controller-statussyncer_service-ca	service-ca-operator	OperatorStatusChanged	Status for clusteroperator/service-ca changed: Degraded changed from Unknown to False ("All is well")
23:06:59	openshift-insights	openshift-insights-operator	insights-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "GatewayAPIWithoutOLM", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
23:06:59	openshift-service-ca-operator	service-ca-operator-status-controller-statussyncer_service-ca	service-ca-operator	OperatorStatusChanged	Status for clusteroperator/service-ca changed: Degraded set to Unknown (""),Progressing set to Unknown (""),Available set to Unknown (""),Upgradeable set to Unknown (""),EvaluationConditionsDetected set to Unknown (""),status.relatedObjects changed from [] to [{"operator.openshift.io" "servicecas" "" "cluster"} {"" "namespaces" "" "openshift-config"} {"" "namespaces" "" "openshift-config-managed"} {"" "namespaces" "" "openshift-service-ca-operator"} {"" "namespaces" "" "openshift-service-ca"}]
23:06:59	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-status-controller-statussyncer_kube-storage-version-migrator	kube-storage-version-migrator-operator	OperatorStatusChanged	Status for clusteroperator/kube-storage-version-migrator changed: Progressing message changed from "KubeStorageVersionMigratorProgressing: Waiting for Deployment to act on changes" to "KubeStorageVersionMigratorProgressing: Waiting for Deployment to deploy pods"
23:06:59	openshift-insights	openshift-insights-operator	insights-operator	DaemonSetCreated	Created DaemonSet.apps/insights-runtime-extractor -n openshift-insights because it was missing
23:07:00	openshift-kube-storage-version-migrator	multus	migrator-76794cbd6c-r8t9z	AddedInterface	Add eth0 [10.132.0.20/23] from ovn-kubernetes
23:07:00	openshift-service-ca-operator	service-ca-operator	service-ca-operator	ServiceAccountCreated	Created ServiceAccount/service-ca -n openshift-service-ca because it was missing
23:07:00	openshift-service-ca-operator	service-ca-operator	service-ca-operator	SecretCreated	Created Secret/signing-key -n openshift-service-ca because it was missing
23:07:00 (x2)	openshift-console-operator	kubelet	console-operator-fd4bb46c-kfrv8	BackOff	Back-off restarting failed container console-operator in pod console-operator-fd4bb46c-kfrv8_openshift-console-operator(c69cad18-c083-405a-aed3-91740cc79fd4)
23:07:00	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:12cb51ec57bf3b05a5dd183836fbe84495da0bab151903002153f81d3564bb32"
23:07:00	openshift-kube-storage-version-migrator	kubelet	migrator-76794cbd6c-r8t9z	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d7cc8333a2beda24519786c3115e60b0cec1f2791d28b41201dd6a54ac557d80"
23:07:01	openshift-service-ca-operator	service-ca-operator-status-controller-statussyncer_service-ca	service-ca-operator	OperatorStatusChanged	Status for clusteroperator/service-ca changed: Progressing changed from Unknown to True ("Progressing: \nProgressing: service-ca does not have available replicas"),Available changed from Unknown to True ("All is well"),Upgradeable changed from Unknown to True ("All is well")
23:07:01	openshift-service-ca	deployment-controller	service-ca	ScalingReplicaSet	Scaled up replica set service-ca-55f6fc7b86 from 0 to 1
23:07:01 (x3)	openshift-insights	kubelet	insights-runtime-extractor-vhnn4	FailedMount	MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" : configmap "kube-rbac-proxy" not found
23:07:01	openshift-service-ca	replicaset-controller	service-ca-55f6fc7b86	SuccessfulCreate	Created pod: service-ca-55f6fc7b86-glczx
23:07:01	openshift-service-ca-operator	service-ca-operator	service-ca-operator	DeploymentCreated	Created Deployment.apps/service-ca -n openshift-service-ca because it was missing
23:07:01	openshift-service-ca-operator	service-ca-operator-resource-sync-controller-resourcesynccontroller	service-ca-operator	ConfigMapCreated	Created ConfigMap/service-ca -n openshift-config-managed because it was missing
23:07:01	openshift-service-ca-operator	service-ca-operator	service-ca-operator	ConfigMapCreated	Created ConfigMap/signing-cabundle -n openshift-service-ca because it was missing
23:07:02	openshift-service-ca	kubelet	service-ca-55f6fc7b86-glczx	Created	Created container: service-ca-controller
23:07:02	openshift-kube-storage-version-migrator	kubelet	migrator-76794cbd6c-r8t9z	Created	Created container: migrator
23:07:02	openshift-kube-storage-version-migrator	kubelet	migrator-76794cbd6c-r8t9z	Created	Created container: graceful-termination
23:07:02	openshift-service-ca	kubelet	service-ca-55f6fc7b86-glczx	Started	Started container service-ca-controller
23:07:02	openshift-kube-storage-version-migrator	kubelet	migrator-76794cbd6c-r8t9z	Started	Started container migrator
23:07:02	openshift-kube-storage-version-migrator	kubelet	migrator-76794cbd6c-r8t9z	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d7cc8333a2beda24519786c3115e60b0cec1f2791d28b41201dd6a54ac557d80" already present on machine
23:07:02	openshift-kube-storage-version-migrator	kubelet	migrator-76794cbd6c-r8t9z	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d7cc8333a2beda24519786c3115e60b0cec1f2791d28b41201dd6a54ac557d80" in 1.533s (1.533s including waiting). Image size: 258136237 bytes.
23:07:02	openshift-kube-storage-version-migrator	kubelet	migrator-76794cbd6c-r8t9z	Started	Started container graceful-termination
23:07:02	openshift-service-ca	multus	service-ca-55f6fc7b86-glczx	AddedInterface	Add eth0 [10.132.0.21/23] from ovn-kubernetes
23:07:02	openshift-service-ca	kubelet	service-ca-55f6fc7b86-glczx	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c030b660bee8debb47feae355ad21ca87984abf181de93e6a0bb3750cab88c4f" already present on machine
23:07:03	openshift-service-ca	service-ca-controller	service-ca-controller-lock	LeaderElection	service-ca-55f6fc7b86-glczx_7a2a2cf8-4eff-42c7-a7ea-b748935e72c0 became leader
23:07:03 (x18)	openshift-network-diagnostics	kubelet	network-check-target-zsdgk	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
23:07:03 (x6)	openshift-image-registry	kubelet	image-registry-7f64f764df-gtws9	FailedMount	MountVolume.SetUp failed for volume "registry-tls" : secret "image-registry-tls" not found
23:07:03 (x6)	openshift-dns	kubelet	dns-default-2fdkb	FailedMount	MountVolume.SetUp failed for volume "metrics-tls" : secret "dns-default-metrics-tls" not found
23:07:04	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-5gdc6	Created	Created container: csi-driver
23:07:04	openshift-multus	kubelet	multus-xg9wq	Created	Created container: kube-multus
23:07:04	openshift-cluster-node-tuning-operator	kubelet	tuned-rjcdn	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0720c8b078cc0cebb01b4c5cde21180aee7c2bb1a0d322b21890c0d3707406ea" in 17.44s (17.44s including waiting). Image size: 590341734 bytes.
23:07:04	openshift-image-registry	kubelet	node-ca-dghj8	Started	Started container node-ca
23:07:04	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Created	Created container: egress-router-binary-copy
23:07:04	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d69f815924343676a7380b09cff7434d6a4abe10f8c28dfff99ace3624e9604a" in 17.438s (17.438s including waiting). Image size: 347291415 bytes.
23:07:04 (x7)	openshift-network-diagnostics	kubelet	network-check-target-zsdgk	FailedMount	MountVolume.SetUp failed for volume "kube-api-access-hs6ql" : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
23:07:04	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Created	Created container: ovn-acl-logging
23:07:04	openshift-multus	kubelet	multus-xg9wq	Started	Started container kube-multus
23:07:04	openshift-cluster-node-tuning-operator	kubelet	tuned-rjcdn	Created	Created container: tuned
23:07:04	kube-system	kubelet	konnectivity-agent-5xj9x	Created	Created container: konnectivity-agent
23:07:04	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:04	kube-system	kubelet	konnectivity-agent-5xj9x	Started	Started container konnectivity-agent
23:07:04	openshift-cluster-node-tuning-operator	kubelet	tuned-rjcdn	Started	Started container tuned
23:07:04	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Created	Created container: ovn-controller
23:07:04	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Started	Started container ovn-controller
23:07:04	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:07:04	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Started	Started container egress-router-binary-copy
23:07:04 (x7)	openshift-multus	kubelet	network-metrics-daemon-d8wwk	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : object "openshift-multus"/"metrics-daemon-secret" not registered
23:07:04	openshift-network-operator	kubelet	iptables-alerter-xzrtv	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8946e875b8c70aba812220ab6f6607097da88ae08ef6bebdabadea24dd62613d" in 17.411s (17.411s including waiting). Image size: 350070731 bytes.
23:07:04	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" in 17.437s (17.437s including waiting). Image size: 1189908850 bytes.
23:07:04	openshift-dns	kubelet	node-resolver-qkccv	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8946e875b8c70aba812220ab6f6607097da88ae08ef6bebdabadea24dd62613d" in 17.439s (17.439s including waiting). Image size: 350070731 bytes.
23:07:04	openshift-multus	kubelet	multus-xg9wq	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e593011a6c882d153207bb561d02609759cba4aa0f900b0fe4479e5239e479bb" in 17.481s (17.481s including waiting). Image size: 1186602155 bytes.
23:07:04	openshift-image-registry	kubelet	node-ca-dghj8	Created	Created container: node-ca
23:07:04	openshift-dns	kubelet	node-resolver-qkccv	Created	Created container: dns-node-resolver
23:07:04	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Started	Started container ovn-acl-logging
23:07:04	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:04	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Created	Created container: kube-rbac-proxy-node
23:07:04	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-5gdc6	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:54fc81b7047fca86ea91318cae087e3f654cc8d54725953ea6f0ddfcaf515545"
23:07:04	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-5gdc6	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3d3869c161a073dfbaf036364ff0996f20e4d9ee240af9f0daa929f78c7ea46e" in 17.458s (17.458s including waiting). Image size: 352704612 bytes.
23:07:04 (x7)	kube-system	kubelet	global-pull-secret-syncer-fvjmj	FailedMount	MountVolume.SetUp failed for volume "original-pull-secret" : object "kube-system"/"original-pull-secret" not registered
23:07:04	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-5gdc6	Started	Started container csi-driver
23:07:04	openshift-dns	kubelet	node-resolver-qkccv	Started	Started container dns-node-resolver
23:07:04	openshift-image-registry	kubelet	node-ca-dghj8	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4cc46ad3182efd0b6783ccc5ae462469de3ead29627706b3a90ef2e46827bcd5" in 17.442s (17.442s including waiting). Image size: 316415403 bytes.
23:07:04	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Started	Started container kube-rbac-proxy-node
23:07:05	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Created	Created container: whereabouts-cni-bincopy
23:07:05	openshift-cluster-samples-operator	multus	cluster-samples-operator-685d7d68b5-lrvzv	AddedInterface	Add eth0 [10.132.0.11/23] from ovn-kubernetes
23:07:05	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Started	Started container whereabouts-cni-bincopy
23:07:05	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-5gdc6	Created	Created container: csi-node-driver-registrar
23:07:05 (x18)	openshift-multus	kubelet	network-metrics-daemon-d8wwk	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
23:07:05 (x6)	openshift-ingress	kubelet	router-default-5cd8bf6458-jhsss	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
23:07:05 (x6)	openshift-ingress	kubelet	router-default-5cd8bf6458-jhsss	FailedMount	MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
23:07:05 (x6)	openshift-ingress	kubelet	router-default-5cd8bf6458-jhsss	FailedMount	MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
23:07:05 (x6)	openshift-ingress	kubelet	router-default-5cd8bf6458-jhsss	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
23:07:05	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:12cb51ec57bf3b05a5dd183836fbe84495da0bab151903002153f81d3564bb32" already present on machine
23:07:05	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Created	Created container: whereabouts-cni
23:07:05	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Started	Started container whereabouts-cni
23:07:05 (x6)	openshift-monitoring	kubelet	cluster-monitoring-operator-847b8bd8d7-r2vwj	FailedMount	MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" : secret "cluster-monitoring-operator-tls" not found
23:07:05	openshift-network-operator	kubelet	iptables-alerter-xzrtv	Created	Created container: iptables-alerter
23:07:05	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:62a4fddd79f098aea5d63eb9901680b25b64ae1ae744fe7062a29d278ba7a6d5"
23:07:05	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Started	Started container nbdb
23:07:05	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-5gdc6	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:54fc81b7047fca86ea91318cae087e3f654cc8d54725953ea6f0ddfcaf515545" in 1.04s (1.04s including waiting). Image size: 238601909 bytes.
23:07:05	openshift-network-operator	kubelet	iptables-alerter-xzrtv	Started	Started container iptables-alerter
23:07:05	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Created	Created container: nbdb
23:07:05	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-685d7d68b5-lrvzv	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5c8b46ce614692e4c96480c58d97eec18f3f8212c904f91b1848bd77312db3f"
23:07:05	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:07:05	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Started	Started container northd
23:07:05	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Created	Created container: northd
23:07:05	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:07:05 (x18)	kube-system	kubelet	global-pull-secret-syncer-fvjmj	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
23:07:05	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:12cb51ec57bf3b05a5dd183836fbe84495da0bab151903002153f81d3564bb32" in 4.43s (4.43s including waiting). Image size: 583957089 bytes.
23:07:05	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Started	Started container kube-rbac-proxy-ovn-metrics
23:07:05	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Created	Created container: kube-rbac-proxy-ovn-metrics
23:07:06	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-685d7d68b5-lrvzv	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5c8b46ce614692e4c96480c58d97eec18f3f8212c904f91b1848bd77312db3f" in 1.505s (1.505s including waiting). Image size: 311250922 bytes.
23:07:06	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Created	Created container: kube-multus-additional-cni-plugins
23:07:06	openshift-multus	kubelet	multus-additional-cni-plugins-h42tf	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e593011a6c882d153207bb561d02609759cba4aa0f900b0fe4479e5239e479bb" already present on machine
23:07:06	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-5gdc6	Started	Started container csi-liveness-probe
23:07:06	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-5gdc6	Created	Created container: csi-liveness-probe
23:07:06	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-5gdc6	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c43eb8f4e3024c90d819ecdc6c4101d91bd5c368d5b50945756ddf6fa4b3b9cf" in 748ms (748ms including waiting). Image size: 238859942 bytes.
23:07:06	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-5gdc6	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c43eb8f4e3024c90d819ecdc6c4101d91bd5c368d5b50945756ddf6fa4b3b9cf"
23:07:06	openshift-cluster-csi-drivers	kubelet	aws-ebs-csi-driver-node-5gdc6	Started	Started container csi-node-driver-registrar
23:07:07	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-685d7d68b5-lrvzv	Created	Created container: cluster-samples-operator-watch
23:07:07	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-685d7d68b5-lrvzv	Started	Started container cluster-samples-operator
23:07:07	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Created	Created container: sbdb
23:07:07	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-685d7d68b5-lrvzv	Created	Created container: cluster-samples-operator
23:07:07	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:07:07 (x5)	openshift-insights	kubelet	insights-runtime-extractor-vhnn4	FailedMount	MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" : secret "insights-runtime-extractor-tls" not found
23:07:07	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-685d7d68b5-lrvzv	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5c8b46ce614692e4c96480c58d97eec18f3f8212c904f91b1848bd77312db3f" already present on machine
23:07:07	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Started	Started container sbdb
23:07:07	openshift-cluster-samples-operator	kubelet	cluster-samples-operator-685d7d68b5-lrvzv	Started	Started container cluster-samples-operator-watch
23:07:07	openshift-cluster-samples-operator	file-change-watchdog	cluster-samples-operator	FileChangeWatchdogStarted	Started watching files for process cluster-samples-operator[2]
23:07:09	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:62a4fddd79f098aea5d63eb9901680b25b64ae1ae744fe7062a29d278ba7a6d5" in 4.45s (4.45s including waiting). Image size: 541678855 bytes.
23:07:09 (x6)	openshift-network-console	kubelet	networking-console-plugin-6446c8d75d-dp5fl	FailedMount	MountVolume.SetUp failed for volume "networking-console-plugin-cert" : secret "networking-console-plugin-cert" not found
23:07:09 (x3)	openshift-console-operator	kubelet	console-operator-fd4bb46c-kfrv8	Started	Started container console-operator
23:07:09	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Started	Started container ovnkube-controller
23:07:09	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Created	Created container: ovnkube-controller
23:07:09 (x3)	openshift-console-operator	kubelet	console-operator-fd4bb46c-kfrv8	Created	Created container: console-operator
23:07:09	openshift-ovn-kubernetes	kubelet	ovnkube-node-zlpxj	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3a0df0e827e39567f587ece03a40630a77aaaeacecf070c175b10d086f0631e" already present on machine
23:07:09	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Started	Started container cni-plugins
23:07:09 (x2)	openshift-console-operator	kubelet	console-operator-fd4bb46c-kfrv8	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff12d08d05379ba6cf62fe8dd9e33da283be9c68b68f66ada7dad62f9fadd6b5" already present on machine
23:07:09	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Created	Created container: cni-plugins
23:07:10	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "RouteHealthDegraded: route.route.openshift.io \"console\" not found" to "RouteHealthDegraded: route.route.openshift.io \"console\" not found\nConsoleDefaultRouteSyncDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console",Upgradeable changed from Unknown to False ("ConsoleDefaultRouteSyncUpgradeable: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console")
23:07:10	openshift-console-operator	console-operator-console-pdb-controller-poddisruptionbudgetcontroller	console-operator	PodDisruptionBudgetCreated	Created PodDisruptionBudget.policy/console -n openshift-console because it was missing
23:07:10	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "All is well" to "RouteHealthDegraded: route.route.openshift.io \"console\" not found"
23:07:10	openshift-console-operator	console-operator-health-check-controller-healthcheckcontroller	console-operator	FastControllerResync	Controller "HealthCheckController" resync interval is set to 30s which might lead to client request throttling
23:07:10	openshift-console-operator	console-operator	console-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "GatewayAPIWithoutOLM", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
23:07:10	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorVersionChanged	clusteroperator/console version "operator" changed from "" to "4.21.34"
23:07:10	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ac45c784ed515baa8893b738667ff319f42d867171bbc17726853391cbcb96ae"
23:07:10	openshift-console-operator	console-operator-console-downloads-deployment-controller-consoledownloadsdeploymentsynccontroller	console-operator	DeploymentCreated	Created Deployment.apps/downloads -n openshift-console because it was missing
23:07:10	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded set to False ("All is well"),Progressing set to False ("All is well"),Available set to Unknown (""),Upgradeable set to Unknown (""),EvaluationConditionsDetected set to Unknown (""),status.relatedObjects changed from [] to [{"console.openshift.io" "consoleplugins" "" "networking-console-plugin"} {"" "namespaces" "" "openshift-network-console"} {"oauth.openshift.io" "oauthclients" "" "console"} {"operator.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "infrastructures" "" "cluster"} {"config.openshift.io" "proxies" "" "cluster"} {"config.openshift.io" "oauths" "" "cluster"} {"" "namespaces" "" "openshift-console-operator"} {"" "namespaces" "" "openshift-console"} {"" "configmaps" "openshift-config-managed" "console-public"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-operator"} {"rbac.authorization.k8s.io" "clusterroles" "" "console"} {"rbac.authorization.k8s.io" "clusterroles" "" "helm-chartrepos-viewer"} {"rbac.authorization.k8s.io" "clusterroles" "" "project-helm-chartrepository-editor"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-extensions-reader"}],status.versions changed from [] to [{"operator" "4.21.34"}]
23:07:10	openshift-console-operator	console-operator-resource-sync-controller-resourcesynccontroller	console-operator	ConfigMapCreated	Created ConfigMap/oauth-serving-cert -n openshift-console because it was missing
23:07:10 (x8)	openshift-image-registry	image-registry-operator	openshift-image-registry	DeploymentUpdated	Updated Deployment.apps/image-registry -n openshift-image-registry because it changed
23:07:10	openshift-console-operator	console-operator-downloads-pdb-controller-poddisruptionbudgetcontroller	console-operator	PodDisruptionBudgetCreated	Created PodDisruptionBudget.policy/downloads -n openshift-console because it was missing
23:07:10	openshift-console-operator	console-operator	console-operator-lock	LeaderElection	console-operator-fd4bb46c-kfrv8_292573fa-79d3-411c-bd66-0fe3ed400530 became leader
23:07:11	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Created	Created container: bond-cni-plugin
23:07:11	openshift-console-operator	console-operator-resource-sync-controller-resourcesynccontroller	console-operator	ConfigMapCreated	Created ConfigMap/default-ingress-cert -n openshift-console because it was missing
23:07:11	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ac45c784ed515baa8893b738667ff319f42d867171bbc17726853391cbcb96ae" in 1.109s (1.109s including waiting). Image size: 226114472 bytes.
23:07:11	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Started	Started container bond-cni-plugin
23:07:11	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "RouteHealthDegraded: route.route.openshift.io \"console\" not found\nConsoleDefaultRouteSyncDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console" to "RouteHealthDegraded: route.route.openshift.io \"console\" not found\nConsoleDefaultRouteSyncDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nOAuthClientsControllerDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console"
23:07:11	openshift-console-operator	console-operator-console-service-controller-consoleservicecontroller	console-operator	ServiceCreated	Created Service/downloads -n openshift-console because it was missing
23:07:12	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64ef7e5a22628f287b1ddc492a203e750d9d771272ba4cac4b558d719a0c3832"
23:07:12	openshift-console-operator	console-operator-oauthclient-secret-controller-oauthclientsecretcontroller	console-operator	SecretCreated	Created Secret/console-oauth-config -n openshift-console because it was missing
23:07:12	openshift-console-operator	console-operator-console-service-controller-consoleservicecontroller	console-operator	ServiceCreated	Created Service/console -n openshift-console because it was missing
23:07:13	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64ef7e5a22628f287b1ddc492a203e750d9d771272ba4cac4b558d719a0c3832" in 1.051s (1.051s including waiting). Image size: 221667607 bytes.
23:07:13	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Created	Created container: routeoverride-cni
23:07:13	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Started	Started container routeoverride-cni
23:07:14	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:12cb51ec57bf3b05a5dd183836fbe84495da0bab151903002153f81d3564bb32"
23:07:15	openshift-insights	kubelet	insights-runtime-extractor-vhnn4	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:15	openshift-insights	multus	insights-runtime-extractor-vhnn4	AddedInterface	Add eth0 [10.132.0.19/23] from ovn-kubernetes
23:07:15	openshift-insights	kubelet	insights-runtime-extractor-vhnn4	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a00a9089530d2fc24732f39112400011fff28d9d159cfdf2614233b0b98c6e76"
23:07:15	openshift-insights	kubelet	insights-runtime-extractor-vhnn4	Started	Started container kube-rbac-proxy
23:07:15	openshift-insights	kubelet	insights-runtime-extractor-vhnn4	Created	Created container: kube-rbac-proxy
23:07:16	openshift-insights	kubelet	insights-runtime-extractor-vhnn4	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:097bd782e8288e489c5833636d23fc54cd6114a178383f87999d05c5eea221c5"
23:07:16	openshift-insights	kubelet	insights-runtime-extractor-vhnn4	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a00a9089530d2fc24732f39112400011fff28d9d159cfdf2614233b0b98c6e76" in 573ms (573ms including waiting). Image size: 218875016 bytes.
23:07:16	openshift-insights	kubelet	insights-runtime-extractor-vhnn4	Started	Started container exporter
23:07:16	openshift-insights	kubelet	insights-runtime-extractor-vhnn4	Created	Created container: exporter
23:07:17 (x7)	kube-system	kubelet	global-pull-secret-syncer-rw5hp	FailedMount	MountVolume.SetUp failed for volume "original-pull-secret" : object "kube-system"/"original-pull-secret" not registered
23:07:17 (x7)	openshift-multus	kubelet	network-metrics-daemon-r5mz6	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : object "openshift-multus"/"metrics-daemon-secret" not registered
23:07:17	openshift-insights	kubelet	insights-runtime-extractor-vhnn4	Started	Started container extractor
23:07:17	openshift-insights	kubelet	insights-runtime-extractor-vhnn4	Created	Created container: extractor
23:07:17	openshift-insights	kubelet	insights-runtime-extractor-vhnn4	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:097bd782e8288e489c5833636d23fc54cd6114a178383f87999d05c5eea221c5" in 1.361s (1.361s including waiting). Image size: 285423543 bytes.
23:07:17 (x7)	openshift-network-diagnostics	kubelet	network-check-target-9vxwv	FailedMount	MountVolume.SetUp failed for volume "kube-api-access-vncd8" : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
23:07:18	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Created	Created container: whereabouts-cni-bincopy
23:07:18	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:12cb51ec57bf3b05a5dd183836fbe84495da0bab151903002153f81d3564bb32" in 4.357s (4.357s including waiting). Image size: 583957089 bytes.
23:07:18	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Started	Started container whereabouts-cni-bincopy
23:07:19	openshift-multus	kubelet	network-metrics-daemon-vk29c	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cc9e90ba265590a3fcbdbf332fea492e53c27f0a1a2c568afb736438aeb9836c"
23:07:19	openshift-network-diagnostics	kubelet	network-check-target-sq8mp	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:37390c626811724e9dfa2edb9b6f7ab4c26ce227e3068999d52f275c82722991" already present on machine
23:07:19	openshift-multus	multus	network-metrics-daemon-vk29c	AddedInterface	Add eth0 [10.132.0.4/23] from ovn-kubernetes
23:07:19	kube-system	multus	global-pull-secret-syncer-92l5f	AddedInterface	Add eth0 [10.132.0.3/23] from ovn-kubernetes
23:07:19	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Started	Started container whereabouts-cni
23:07:19	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Created	Created container: whereabouts-cni
23:07:19	openshift-image-registry	multus	image-registry-7f64f764df-gtws9	AddedInterface	Add eth0 [10.132.0.6/23] from ovn-kubernetes
23:07:19	openshift-dns	multus	dns-default-2fdkb	AddedInterface	Add eth0 [10.132.0.7/23] from ovn-kubernetes
23:07:19	openshift-image-registry	kubelet	image-registry-7f64f764df-gtws9	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4cc46ad3182efd0b6783ccc5ae462469de3ead29627706b3a90ef2e46827bcd5" already present on machine
23:07:19	openshift-image-registry	kubelet	image-registry-7f64f764df-gtws9	Created	Created container: registry
23:07:19	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:12cb51ec57bf3b05a5dd183836fbe84495da0bab151903002153f81d3564bb32" already present on machine
23:07:19	openshift-image-registry	kubelet	image-registry-7f64f764df-gtws9	Started	Started container registry
23:07:19	kube-system	kubelet	global-pull-secret-syncer-92l5f	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b4f435f3abc206296a8780c8ac19e07d8716958d5d6af9c855e58ede0127674"
23:07:19	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "RouteHealthDegraded: route.route.openshift.io \"console\" not found\nConsoleDefaultRouteSyncDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nOAuthClientsControllerDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console" to "RouteHealthDegraded: route.route.openshift.io \"console\" not found\nConsoleDefaultRouteSyncDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nOAuthClientsControllerDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nDownloadsDefaultRouteSyncDegraded: no ingress for host downloads-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route downloads in namespace openshift-console",Upgradeable message changed from "ConsoleDefaultRouteSyncUpgradeable: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console" to "ConsoleDefaultRouteSyncUpgradeable: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nDownloadsDefaultRouteSyncUpgradeable: no ingress for host downloads-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route downloads in namespace openshift-console"
23:07:19	openshift-dns	kubelet	dns-default-2fdkb	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f4cbb849328be33f241f3e06c1650f476a5a2a393a540a3b66565ef7c01673e"
23:07:19	openshift-network-diagnostics	multus	network-check-target-sq8mp	AddedInterface	Add eth0 [10.132.0.5/23] from ovn-kubernetes
23:07:19 (x18)	openshift-network-diagnostics	kubelet	network-check-target-9vxwv	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
23:07:19 (x18)	kube-system	kubelet	global-pull-secret-syncer-rw5hp	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
23:07:19	openshift-network-diagnostics	kubelet	network-check-target-sq8mp	Started	Started container network-check-target-container
23:07:19	openshift-network-diagnostics	kubelet	network-check-target-sq8mp	Created	Created container: network-check-target-container
23:07:19 (x18)	openshift-multus	kubelet	network-metrics-daemon-r5mz6	NetworkNotReady	network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?
23:07:20	openshift-multus	kubelet	network-metrics-daemon-vk29c	Started	Started container kube-rbac-proxy
23:07:20	openshift-multus	kubelet	network-metrics-daemon-vk29c	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:20	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Created	Created container: kube-multus-additional-cni-plugins
23:07:20	kube-system	kube-controller-manager	kube-controller-manager	LeaderElection	kube-controller-manager-78bfc67b8c-6tqjd_96c5c377-652d-4ba7-b721-2dcb2b2d9b1d became leader
23:07:20	openshift-multus	kubelet	network-metrics-daemon-vk29c	Created	Created container: kube-rbac-proxy
23:07:20	openshift-multus	kubelet	network-metrics-daemon-vk29c	Started	Started container network-metrics-daemon
23:07:20	openshift-multus	kubelet	multus-additional-cni-plugins-9sjsw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e593011a6c882d153207bb561d02609759cba4aa0f900b0fe4479e5239e479bb" already present on machine
23:07:20	openshift-multus	kubelet	network-metrics-daemon-vk29c	Created	Created container: network-metrics-daemon
23:07:20	openshift-multus	kubelet	network-metrics-daemon-vk29c	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cc9e90ba265590a3fcbdbf332fea492e53c27f0a1a2c568afb736438aeb9836c" in 998ms (998ms including waiting). Image size: 252195882 bytes.
23:07:21	openshift-service-ca-operator	service-ca-operator-status-controller-statussyncer_service-ca	service-ca-operator	OperatorStatusChanged	Status for clusteroperator/service-ca changed: status.versions changed from [] to [{"operator" "4.21.34"}]
23:07:21	openshift-ingress	kubelet	router-default-5cd8bf6458-jhsss	Created	Created container: router
23:07:21	openshift-console	deployment-controller	downloads	ScalingReplicaSet	Scaled up replica set downloads-6594f4c75 from 0 to 1
23:07:21	openshift-ingress	kubelet	router-default-5cd8bf6458-jhsss	Started	Started container router
23:07:21	openshift-ingress	kubelet	router-default-5cd8bf6458-jhsss	Created	Created container: router
23:07:21	openshift-ingress	kubelet	router-default-5cd8bf6458-jhsss	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine
23:07:21	openshift-ingress	multus	router-default-5cd8bf6458-jhsss	AddedInterface	Add eth0 [10.132.0.17/23] from ovn-kubernetes
23:07:21	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-status-controller-statussyncer_kube-storage-version-migrator	kube-storage-version-migrator-operator	OperatorStatusChanged	Status for clusteroperator/kube-storage-version-migrator changed: Progressing changed from True to False ("All is well"),Available changed from False to True ("All is well")
23:07:21	openshift-image-registry	deployment-controller	image-registry	ScalingReplicaSet	Scaled down replica set image-registry-65c9d8846b from 1 to 0
23:07:21	openshift-image-registry	deployment-controller	image-registry	ScalingReplicaSet	Scaled up replica set image-registry-68999896c6 from 0 to 1
23:07:21	openshift-dns	kubelet	dns-default-2fdkb	Started	Started container kube-rbac-proxy
23:07:21	openshift-dns	kubelet	dns-default-2fdkb	Created	Created container: kube-rbac-proxy
23:07:21	openshift-dns	kubelet	dns-default-2fdkb	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:21	openshift-image-registry	replicaset-controller	image-registry-65c9d8846b	SuccessfulDelete	Deleted pod: image-registry-65c9d8846b-wq7k9
23:07:21	openshift-dns	kubelet	dns-default-2fdkb	Started	Started container dns
23:07:21	openshift-dns	kubelet	dns-default-2fdkb	Created	Created container: dns
23:07:21	openshift-dns	kubelet	dns-default-2fdkb	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f4cbb849328be33f241f3e06c1650f476a5a2a393a540a3b66565ef7c01673e" in 1.973s (1.973s including waiting). Image size: 321597557 bytes.
23:07:21	default	node-controller	ip-10-0-141-215.ec2.internal	RegisteredNode	Node ip-10-0-141-215.ec2.internal event: Registered Node ip-10-0-141-215.ec2.internal in Controller
23:07:21	openshift-console	replicaset-controller	downloads-6594f4c75	SuccessfulCreate	Created pod: downloads-6594f4c75-kzt9c
23:07:21	openshift-image-registry	replicaset-controller	image-registry-68999896c6	SuccessfulCreate	Created pod: image-registry-68999896c6-2gpfj
23:07:21	openshift-service-ca-operator	service-ca-operator-status-controller-statussyncer_service-ca	service-ca-operator	OperatorStatusChanged	Status for clusteroperator/service-ca changed: Progressing changed from True to False ("Progressing: All service-ca-operator deployments updated")
23:07:21 (x2)	openshift-console	controllermanager	console	NoPods	No matching pods found
23:07:21	default	node-controller	ip-10-0-140-44.ec2.internal	RegisteredNode	Node ip-10-0-140-44.ec2.internal event: Registered Node ip-10-0-140-44.ec2.internal in Controller
23:07:21	default	node-controller	ip-10-0-133-222.ec2.internal	RegisteredNode	Node ip-10-0-133-222.ec2.internal event: Registered Node ip-10-0-133-222.ec2.internal in Controller
23:07:21	openshift-ingress	kubelet	router-default-5cd8bf6458-jhsss	Started	Started container router
23:07:21	openshift-console	multus	downloads-6594f4c75-kzt9c	AddedInterface	Add eth0 [10.132.0.25/23] from ovn-kubernetes
23:07:21	openshift-service-ca-operator	service-ca-operator-status-controller-statussyncer_service-ca	service-ca-operator	OperatorVersionChanged	clusteroperator/service-ca version "operator" changed from "" to "4.21.34"
23:07:21 (x2)	openshift-console	controllermanager	downloads	NoPods	No matching pods found
23:07:21 (x2)	openshift-console-operator	console-operator-console-downloads-deployment-controller-consoledownloadsdeploymentsynccontroller	console-operator	DeploymentUpdated	Updated Deployment.apps/downloads -n openshift-console because it changed
23:07:21	openshift-monitoring	kubelet	cluster-monitoring-operator-847b8bd8d7-r2vwj	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b2f78967f61007a3e2a147c96bb8123ed15e7cce43318fc1998a00124a05af0"
23:07:21	openshift-monitoring	multus	cluster-monitoring-operator-847b8bd8d7-r2vwj	AddedInterface	Add eth0 [10.132.0.10/23] from ovn-kubernetes
23:07:21	openshift-console	kubelet	downloads-6594f4c75-kzt9c	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:42472278fab42285a189b682a62b86a237b7073c2b99b44a816dfab9225e1504"
23:07:21	openshift-ingress	multus	router-default-5cd8bf6458-jhsss	AddedInterface	Add eth0 [10.132.0.17/23] from ovn-kubernetes
23:07:21	openshift-ingress	kubelet	router-default-5cd8bf6458-jhsss	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine
23:07:22	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "RouteHealthDegraded: route.route.openshift.io \"console\" not found\nConsoleDefaultRouteSyncDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nOAuthClientsControllerDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nDownloadsDefaultRouteSyncDegraded: no ingress for host downloads-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route downloads in namespace openshift-console" to "RouteHealthDegraded: console route is not admitted\nConsoleDefaultRouteSyncDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nOAuthClientsControllerDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nDownloadsDefaultRouteSyncDegraded: no ingress for host downloads-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route downloads in namespace openshift-console",Available changed from Unknown to False ("RouteHealthAvailable: console route is not admitted")
23:07:22	openshift-dns	daemonset-controller	dns-default	SuccessfulCreate	Created pod: dns-default-kc4rm
23:07:22	openshift-ingress-canary	multus	ingress-canary-n6wf4	AddedInterface	Add eth0 [10.133.0.7/23] from ovn-kubernetes
23:07:22	openshift-ingress-canary	kubelet	ingress-canary-n6wf4	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:95b866020b3bf0ae064bff227e49faec3542fd6542471f32f86e086c087451cf"
23:07:22	openshift-image-registry	kubelet	image-registry-68999896c6-2gpfj	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4cc46ad3182efd0b6783ccc5ae462469de3ead29627706b3a90ef2e46827bcd5" already present on machine
23:07:22	openshift-image-registry	multus	image-registry-68999896c6-2gpfj	AddedInterface	Add eth0 [10.133.0.6/23] from ovn-kubernetes
23:07:22	default	kubelet	ip-10-0-141-215.ec2.internal	NodeReady	Node ip-10-0-141-215.ec2.internal status is now: NodeReady
23:07:22	openshift-dns	multus	dns-default-kc4rm	AddedInterface	Add eth0 [10.133.0.8/23] from ovn-kubernetes
23:07:22	openshift-ingress-canary	daemonset-controller	ingress-canary	SuccessfulCreate	Created pod: ingress-canary-n6wf4
23:07:22	openshift-dns	kubelet	dns-default-kc4rm	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f4cbb849328be33f241f3e06c1650f476a5a2a393a540a3b66565ef7c01673e"
23:07:22	openshift-insights	daemonset-controller	insights-runtime-extractor	SuccessfulCreate	Created pod: insights-runtime-extractor-2knf6
23:07:23	openshift-insights	kubelet	insights-runtime-extractor-2knf6	Started	Started container kube-rbac-proxy
23:07:23	openshift-image-registry	kubelet	image-registry-68999896c6-2gpfj	Started	Started container registry
23:07:23	kube-system	kubelet	global-pull-secret-syncer-92l5f	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b4f435f3abc206296a8780c8ac19e07d8716958d5d6af9c855e58ede0127674" in 4.531s (4.531s including waiting). Image size: 579458568 bytes.
23:07:23	openshift-image-registry	kubelet	image-registry-68999896c6-2gpfj	Created	Created container: registry
23:07:23	openshift-insights	kubelet	insights-runtime-extractor-2knf6	Created	Created container: kube-rbac-proxy
23:07:23	openshift-insights	kubelet	insights-runtime-extractor-2knf6	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a00a9089530d2fc24732f39112400011fff28d9d159cfdf2614233b0b98c6e76"
23:07:23	openshift-insights	kubelet	insights-runtime-extractor-2knf6	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:23	openshift-insights	multus	insights-runtime-extractor-2knf6	AddedInterface	Add eth0 [10.133.0.9/23] from ovn-kubernetes
23:07:24	openshift-insights	kubelet	insights-runtime-extractor-2knf6	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a00a9089530d2fc24732f39112400011fff28d9d159cfdf2614233b0b98c6e76" in 1.114s (1.114s including waiting). Image size: 218875016 bytes.
23:07:24	openshift-insights	kubelet	insights-runtime-extractor-2knf6	Created	Created container: exporter
23:07:24	openshift-console-operator	console-operator-console-operator-consoleoperator	console-operator	ConfigMapCreated	Created ConfigMap/console-public -n openshift-config-managed because it was missing
23:07:24	openshift-console-operator	console-operator-console-operator-consoleoperator	console-operator	DeploymentCreated	Created Deployment.apps/console -n openshift-console because it was missing
23:07:24	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled up replica set console-674fc5764c from 0 to 1
23:07:24	kube-system	kubelet	global-pull-secret-syncer-92l5f	Started	Started container global-pull-secret-syncer
23:07:24	openshift-insights	kubelet	insights-runtime-extractor-2knf6	Started	Started container exporter
23:07:24	kube-system	kubelet	global-pull-secret-syncer-92l5f	Created	Created container: global-pull-secret-syncer
23:07:24	openshift-console-operator	console-operator-console-operator-consoleoperator	console-operator	ConfigMapCreated	Created ConfigMap/console-config -n openshift-console because it was missing
23:07:24	openshift-console	replicaset-controller	console-674fc5764c	SuccessfulCreate	Created pod: console-674fc5764c-4ztgh
23:07:24	openshift-insights	kubelet	insights-runtime-extractor-2knf6	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:097bd782e8288e489c5833636d23fc54cd6114a178383f87999d05c5eea221c5"
23:07:26	openshift-dns	kubelet	dns-default-kc4rm	Created	Created container: kube-rbac-proxy
23:07:26	openshift-image-registry	taint-eviction-controller	image-registry-68999896c6-2gpfj	TaintManagerEviction	Cancelling deletion of Pod openshift-image-registry/image-registry-68999896c6-2gpfj
23:07:26	openshift-dns	kubelet	dns-default-kc4rm	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:26	openshift-ingress-canary	kubelet	ingress-canary-n6wf4	Started	Started container serve-healthcheck-canary
23:07:26	openshift-ingress-canary	kubelet	ingress-canary-n6wf4	Created	Created container: serve-healthcheck-canary
23:07:26	openshift-ingress-canary	kubelet	ingress-canary-n6wf4	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:95b866020b3bf0ae064bff227e49faec3542fd6542471f32f86e086c087451cf" in 3.152s (3.152s including waiting). Image size: 390259992 bytes.
23:07:26	openshift-ingress-canary	daemonset-controller	ingress-canary	SuccessfulCreate	Created pod: ingress-canary-wkjrp
23:07:26	openshift-dns	kubelet	dns-default-kc4rm	Started	Started container kube-rbac-proxy
23:07:26	openshift-dns	daemonset-controller	dns-default	SuccessfulCreate	Created pod: dns-default-4sv94
23:07:26	openshift-insights	daemonset-controller	insights-runtime-extractor	SuccessfulCreate	Created pod: insights-runtime-extractor-wcn4x
23:07:26	default	kubelet	ip-10-0-140-44.ec2.internal	NodeReady	Node ip-10-0-140-44.ec2.internal status is now: NodeReady
23:07:26	openshift-dns	kubelet	dns-default-kc4rm	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f4cbb849328be33f241f3e06c1650f476a5a2a393a540a3b66565ef7c01673e" in 3.12s (3.12s including waiting). Image size: 321597557 bytes.
23:07:26	openshift-dns	kubelet	dns-default-kc4rm	Created	Created container: dns
23:07:26	openshift-dns	kubelet	dns-default-kc4rm	Started	Started container dns
23:07:26	openshift-console	taint-eviction-controller	console-674fc5764c-4ztgh	TaintManagerEviction	Cancelling deletion of Pod openshift-console/console-674fc5764c-4ztgh
23:07:26	openshift-console	multus	console-674fc5764c-4ztgh	AddedInterface	Add eth0 [10.133.0.10/23] from ovn-kubernetes
23:07:26	openshift-console	kubelet	console-674fc5764c-4ztgh	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c48957842946a7846a4b0aade93e6ab20f483c51200957ae5daec4f7624a8828"
23:07:27	openshift-dns	kubelet	dns-default-4sv94	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f4cbb849328be33f241f3e06c1650f476a5a2a393a540a3b66565ef7c01673e"
23:07:27	openshift-insights	kubelet	insights-runtime-extractor-wcn4x	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:27	openshift-dns	multus	dns-default-4sv94	AddedInterface	Add eth0 [10.134.0.7/23] from ovn-kubernetes
23:07:27	openshift-ingress-canary	kubelet	ingress-canary-wkjrp	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:95b866020b3bf0ae064bff227e49faec3542fd6542471f32f86e086c087451cf"
23:07:27	openshift-insights	kubelet	insights-runtime-extractor-2knf6	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:097bd782e8288e489c5833636d23fc54cd6114a178383f87999d05c5eea221c5" in 2.881s (2.881s including waiting). Image size: 285423543 bytes.
23:07:27	openshift-insights	kubelet	insights-runtime-extractor-2knf6	Created	Created container: extractor
23:07:27	openshift-ingress-canary	multus	ingress-canary-wkjrp	AddedInterface	Add eth0 [10.134.0.8/23] from ovn-kubernetes
23:07:27	openshift-insights	kubelet	insights-runtime-extractor-2knf6	Started	Started container extractor
23:07:27	openshift-insights	kubelet	insights-runtime-extractor-wcn4x	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a00a9089530d2fc24732f39112400011fff28d9d159cfdf2614233b0b98c6e76"
23:07:27	openshift-insights	kubelet	insights-runtime-extractor-wcn4x	Started	Started container kube-rbac-proxy
23:07:27	openshift-insights	kubelet	insights-runtime-extractor-wcn4x	Created	Created container: kube-rbac-proxy
23:07:27	openshift-insights	multus	insights-runtime-extractor-wcn4x	AddedInterface	Add eth0 [10.134.0.6/23] from ovn-kubernetes
23:07:28	openshift-insights	kubelet	insights-runtime-extractor-wcn4x	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a00a9089530d2fc24732f39112400011fff28d9d159cfdf2614233b0b98c6e76" in 637ms (637ms including waiting). Image size: 218875016 bytes.
23:07:28	openshift-insights	kubelet	insights-runtime-extractor-wcn4x	Created	Created container: exporter
23:07:28	openshift-insights	kubelet	insights-runtime-extractor-wcn4x	Started	Started container exporter
23:07:28	openshift-insights	kubelet	insights-runtime-extractor-wcn4x	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:097bd782e8288e489c5833636d23fc54cd6114a178383f87999d05c5eea221c5"
23:07:29	openshift-dns	kubelet	dns-default-4sv94	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f4cbb849328be33f241f3e06c1650f476a5a2a393a540a3b66565ef7c01673e" in 2.623s (2.623s including waiting). Image size: 321597557 bytes.
23:07:29	openshift-ingress-canary	kubelet	ingress-canary-wkjrp	Started	Started container serve-healthcheck-canary
23:07:29	openshift-ingress-canary	kubelet	ingress-canary-wkjrp	Created	Created container: serve-healthcheck-canary
23:07:29	openshift-ingress-canary	kubelet	ingress-canary-wkjrp	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:95b866020b3bf0ae064bff227e49faec3542fd6542471f32f86e086c087451cf" in 2.608s (2.608s including waiting). Image size: 390259992 bytes.
23:07:29	openshift-insights	kubelet	insights-runtime-extractor-wcn4x	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:097bd782e8288e489c5833636d23fc54cd6114a178383f87999d05c5eea221c5" in 1.861s (1.861s including waiting). Image size: 285423543 bytes.
23:07:30	openshift-dns	kubelet	dns-default-4sv94	Created	Created container: kube-rbac-proxy
23:07:30	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "RouteHealthDegraded: console route is not admitted\nConsoleDefaultRouteSyncDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nOAuthClientsControllerDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nDownloadsDefaultRouteSyncDegraded: no ingress for host downloads-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route downloads in namespace openshift-console" to "RouteHealthDegraded: console route is not admitted\nConsoleDefaultRouteSyncDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nOAuthClientsControllerDegraded: Operation cannot be fulfilled on consoles.operator.openshift.io \"cluster\": the object has been modified; please apply your changes to the latest version and try again\nDownloadsDefaultRouteSyncDegraded: no ingress for host downloads-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route downloads in namespace openshift-console"
23:07:30	openshift-dns	kubelet	dns-default-4sv94	Created	Created container: dns
23:07:30	openshift-insights	kubelet	insights-runtime-extractor-wcn4x	Started	Started container extractor
23:07:30	openshift-insights	kubelet	insights-runtime-extractor-wcn4x	Created	Created container: extractor
23:07:30	openshift-dns	kubelet	dns-default-4sv94	Started	Started container dns
23:07:30	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled up replica set console-fd479bccb from 0 to 1
23:07:30	openshift-dns	kubelet	dns-default-4sv94	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:30	openshift-console	replicaset-controller	console-fd479bccb	SuccessfulCreate	Created pod: console-fd479bccb-8dszg
23:07:30	openshift-dns	kubelet	dns-default-4sv94	Started	Started container kube-rbac-proxy
23:07:31	openshift-console	kubelet	console-674fc5764c-4ztgh	Started	Started container console
23:07:31	openshift-console	kubelet	console-674fc5764c-4ztgh	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c48957842946a7846a4b0aade93e6ab20f483c51200957ae5daec4f7624a8828" in 5.176s (5.176s including waiting). Image size: 446317187 bytes.
23:07:31	openshift-console	kubelet	console-674fc5764c-4ztgh	Created	Created container: console
23:07:31	openshift-console	multus	console-fd479bccb-8dszg	AddedInterface	Add eth0 [10.134.0.9/23] from ovn-kubernetes
23:07:31	openshift-console	kubelet	console-fd479bccb-8dszg	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c48957842946a7846a4b0aade93e6ab20f483c51200957ae5daec4f7624a8828"
23:07:32	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "RouteHealthDegraded: console route is not admitted\nConsoleDefaultRouteSyncDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nOAuthClientsControllerDegraded: Operation cannot be fulfilled on consoles.operator.openshift.io \"cluster\": the object has been modified; please apply your changes to the latest version and try again\nDownloadsDefaultRouteSyncDegraded: no ingress for host downloads-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route downloads in namespace openshift-console" to "RouteHealthDegraded: console route is not admitted\nConsoleDefaultRouteSyncDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nDownloadsDefaultRouteSyncDegraded: no ingress for host downloads-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route downloads in namespace openshift-console"
23:07:33	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringclientcertrequester	cluster-monitoring-operator	ClientCertificateCreated	A new client certificate for OpenShiftMonitoringClientCertRequester is available
23:07:33	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "RouteHealthDegraded: console route is not admitted\nConsoleDefaultRouteSyncDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nDownloadsDefaultRouteSyncDegraded: no ingress for host downloads-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route downloads in namespace openshift-console" to "RouteHealthDegraded: console route is not admitted\nConsoleDefaultRouteSyncDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console",Upgradeable message changed from "ConsoleDefaultRouteSyncUpgradeable: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console\nDownloadsDefaultRouteSyncUpgradeable: no ingress for host downloads-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route downloads in namespace openshift-console" to "ConsoleDefaultRouteSyncUpgradeable: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console"
23:07:33	openshift-kube-controller-manager	cluster-policy-controller-webhook-authenticator-cert-approver-csr-approver-controller-webhookauthenticatorcertapprover_csr-approver-controller		CSRApproval	The CSR "system:openshift:openshift-monitoring-hmwdz" has been approved
23:07:33	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/prometheus-operator because it was missing
23:07:33	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/prometheus-operator-admission-webhook -n openshift-monitoring because it was missing
23:07:33	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/prometheus-operator-admission-webhook -n openshift-monitoring because it was missing
23:07:33	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringmetricsserverclientcertrequester	cluster-monitoring-operator	ClientCertificateCreated	A new client certificate for OpenShiftMonitoringMetricsServerClientCertRequester is available
23:07:33	openshift-kube-controller-manager	cluster-policy-controller-webhook-authenticator-cert-approver-csr-approver-controller-webhookauthenticatorcertapprover_csr-approver-controller		CSRApproval	The CSR "system:openshift:openshift-monitoring-t7ggs" has been approved
23:07:33	openshift-network-console	kubelet	networking-console-plugin-6446c8d75d-dp5fl	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e95176d9ead075d1ba62185b7a755daa4e2ce0e7b146ab4b34515e357c3d7207"
23:07:33	openshift-monitoring	replicaset-controller	prometheus-operator-admission-webhook-5c6747dc7b	SuccessfulCreate	Created pod: prometheus-operator-admission-webhook-5c6747dc7b-nlgxb
23:07:33	openshift-network-console	multus	networking-console-plugin-6446c8d75d-dp5fl	AddedInterface	Add eth0 [10.132.0.18/23] from ovn-kubernetes
23:07:33	openshift-monitoring	kubelet	cluster-monitoring-operator-847b8bd8d7-r2vwj	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b2f78967f61007a3e2a147c96bb8123ed15e7cce43318fc1998a00124a05af0" in 11.124s (11.124s including waiting). Image size: 318702215 bytes.
23:07:33	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringtelemeterclientcertrequester	cluster-monitoring-operator	ClientCertificateCreated	A new client certificate for OpenShiftMonitoringTelemeterClientCertRequester is available
23:07:33	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/metrics-client-ca -n openshift-monitoring because it was missing
23:07:33	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/prometheus-operator -n openshift-monitoring because it was missing
23:07:33	openshift-monitoring	kubelet	cluster-monitoring-operator-847b8bd8d7-r2vwj	Created	Created container: cluster-monitoring-operator
23:07:33	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringtelemeterclientcertrequester	cluster-monitoring-operator	CSRCreated	A csr "system:openshift:openshift-monitoring-rf4pl" is created for OpenShiftMonitoringTelemeterClientCertRequester
23:07:33	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringmetricsserverclientcertrequester	cluster-monitoring-operator	CSRCreated	A csr "system:openshift:openshift-monitoring-hmwdz" is created for OpenShiftMonitoringMetricsServerClientCertRequester
23:07:33	openshift-monitoring	deployment-controller	prometheus-operator-admission-webhook	ScalingReplicaSet	Scaled up replica set prometheus-operator-admission-webhook-5c6747dc7b from 0 to 1
23:07:33	openshift-kube-controller-manager	cluster-policy-controller-webhook-authenticator-cert-approver-csr-approver-controller-webhookauthenticatorcertapprover_csr-approver-controller		CSRApproval	The CSR "system:openshift:openshift-monitoring-rf4pl" has been approved
23:07:33	openshift-monitoring	kubelet	cluster-monitoring-operator-847b8bd8d7-r2vwj	Started	Started container cluster-monitoring-operator
23:07:33	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "GatewayAPIWithoutOLM", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
23:07:33	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringclientcertrequester	cluster-monitoring-operator	NoValidCertificateFound	No valid client certificate for OpenShiftMonitoringClientCertRequester is found: unable to parse certificate: data does not contain any valid RSA or ECDSA certificates
23:07:33	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringmetricsserverclientcertrequester	cluster-monitoring-operator	NoValidCertificateFound	No valid client certificate for OpenShiftMonitoringMetricsServerClientCertRequester is found: unable to parse certificate: data does not contain any valid RSA or ECDSA certificates
23:07:33	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/alert-relabel-configs -n openshift-monitoring because it was missing
23:07:33	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/prometheus-operator because it was missing
23:07:33	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringclientcertrequester	cluster-monitoring-operator	CSRCreated	A csr "system:openshift:openshift-monitoring-t7ggs" is created for OpenShiftMonitoringClientCertRequester
23:07:33	openshift-monitoring	cluster-monitoring-operator-openshiftmonitoringtelemeterclientcertrequester	cluster-monitoring-operator	NoValidCertificateFound	No valid client certificate for OpenShiftMonitoringTelemeterClientCertRequester is found: unable to parse certificate: data does not contain any valid RSA or ECDSA certificates
23:07:34	openshift-network-console	kubelet	networking-console-plugin-6446c8d75d-dp5fl	Started	Started container networking-console-plugin
23:07:34	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "RouteHealthDegraded: console route is not admitted\nConsoleDefaultRouteSyncDegraded: no ingress for host console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com in route console in namespace openshift-console" to "RouteHealthDegraded: console route is not admitted",Upgradeable changed from False to True ("All is well")
23:07:34	openshift-network-console	kubelet	networking-console-plugin-6446c8d75d-dp5fl	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e95176d9ead075d1ba62185b7a755daa4e2ce0e7b146ab4b34515e357c3d7207" in 1.075s (1.075s including waiting). Image size: 256247827 bytes.
23:07:34	openshift-network-console	kubelet	networking-console-plugin-6446c8d75d-dp5fl	Created	Created container: networking-console-plugin
23:07:35	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Progressing changed from False to True ("SyncLoopRefreshProgressing: working toward version 4.21.34, 0 replicas available"),Available message changed from "RouteHealthAvailable: console route is not admitted" to "DeploymentAvailable: 0 replicas available for console deployment\nRouteHealthAvailable: console route is not admitted"
23:07:35	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "RouteHealthDegraded: console route is not admitted" to "RouteHealthDegraded: failed to GET route (https://console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com): Get \"https://console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com\": dial tcp: lookup console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com on 172.31.0.10:53: read udp 10.132.0.12:54848->172.31.0.10:53: read: connection refused",Available message changed from "DeploymentAvailable: 0 replicas available for console deployment\nRouteHealthAvailable: console route is not admitted" to "DeploymentAvailable: 0 replicas available for console deployment\nRouteHealthAvailable: failed to GET route (https://console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com): Get \"https://console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com\": dial tcp: lookup console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com on 172.31.0.10:53: read udp 10.132.0.12:54848->172.31.0.10:53: read: connection refused"
23:07:35	openshift-console	kubelet	console-674fc5764c-4ztgh	ProbeError	Startup probe error: Get "https://10.133.0.10:8443/health": dial tcp 10.133.0.10:8443: connect: connection refused body:
23:07:35	openshift-console	kubelet	console-674fc5764c-4ztgh	Unhealthy	Startup probe failed: Get "https://10.133.0.10:8443/health": dial tcp 10.133.0.10:8443: connect: connection refused
23:07:35	openshift-monitoring	multus	prometheus-operator-admission-webhook-5c6747dc7b-nlgxb	AddedInterface	Add eth0 [10.134.0.10/23] from ovn-kubernetes
23:07:36	openshift-console	kubelet	console-fd479bccb-8dszg	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c48957842946a7846a4b0aade93e6ab20f483c51200957ae5daec4f7624a8828" in 4.595s (4.595s including waiting). Image size: 446317187 bytes.
23:07:36	openshift-network-diagnostics	multus	network-check-target-zsdgk	AddedInterface	Add eth0 [10.133.0.4/23] from ovn-kubernetes
23:07:36	openshift-network-diagnostics	kubelet	network-check-target-zsdgk	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:37390c626811724e9dfa2edb9b6f7ab4c26ce227e3068999d52f275c82722991"
23:07:36	openshift-monitoring	kubelet	prometheus-operator-admission-webhook-5c6747dc7b-nlgxb	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:434c78cc965afca3e9e3e51892668c842c680459d16baa1ce903e1c24e257b6b"
23:07:36	kube-system	kubelet	global-pull-secret-syncer-fvjmj	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b4f435f3abc206296a8780c8ac19e07d8716958d5d6af9c855e58ede0127674"
23:07:36	openshift-console	kubelet	console-fd479bccb-8dszg	Started	Started container console
23:07:36	openshift-console	kubelet	console-fd479bccb-8dszg	Created	Created container: console
23:07:36	kube-system	multus	global-pull-secret-syncer-fvjmj	AddedInterface	Add eth0 [10.133.0.5/23] from ovn-kubernetes
23:07:36	openshift-multus	multus	network-metrics-daemon-d8wwk	AddedInterface	Add eth0 [10.133.0.3/23] from ovn-kubernetes
23:07:36	openshift-multus	kubelet	network-metrics-daemon-d8wwk	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cc9e90ba265590a3fcbdbf332fea492e53c27f0a1a2c568afb736438aeb9836c"
23:07:37	openshift-multus	kubelet	network-metrics-daemon-d8wwk	Started	Started container network-metrics-daemon
23:07:37	openshift-monitoring	kubelet	prometheus-operator-admission-webhook-5c6747dc7b-nlgxb	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:434c78cc965afca3e9e3e51892668c842c680459d16baa1ce903e1c24e257b6b" in 1.33s (1.33s including waiting). Image size: 254259997 bytes.
23:07:37	openshift-multus	kubelet	network-metrics-daemon-d8wwk	Created	Created container: network-metrics-daemon
23:07:37	openshift-monitoring	kubelet	prometheus-operator-admission-webhook-5c6747dc7b-nlgxb	Started	Started container prometheus-operator-admission-webhook
23:07:37	openshift-multus	kubelet	network-metrics-daemon-d8wwk	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:37	openshift-multus	kubelet	network-metrics-daemon-d8wwk	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cc9e90ba265590a3fcbdbf332fea492e53c27f0a1a2c568afb736438aeb9836c" in 1.059s (1.059s including waiting). Image size: 252195882 bytes.
23:07:37	openshift-multus	kubelet	network-metrics-daemon-d8wwk	Created	Created container: kube-rbac-proxy
23:07:37	openshift-monitoring	kubelet	prometheus-operator-admission-webhook-5c6747dc7b-nlgxb	Created	Created container: prometheus-operator-admission-webhook
23:07:37	openshift-multus	kubelet	network-metrics-daemon-d8wwk	Started	Started container kube-rbac-proxy
23:07:38	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ValidatingWebhookConfigurationCreated	Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/prometheusrules.openshift.io because it was missing
23:07:38	openshift-monitoring	replicaset-controller	prometheus-operator-7bd5d56d6	SuccessfulCreate	Created pod: prometheus-operator-7bd5d56d6-n2rtl
23:07:38	openshift-monitoring	kubelet	prometheus-operator-7bd5d56d6-n2rtl	FailedMount	MountVolume.SetUp failed for volume "prometheus-operator-tls" : secret "prometheus-operator-tls" not found
23:07:38	openshift-monitoring	deployment-controller	prometheus-operator	ScalingReplicaSet	Scaled up replica set prometheus-operator-7bd5d56d6 from 0 to 1
23:07:38	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ValidatingWebhookConfigurationCreated	Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/alertmanagerconfigs.openshift.io because it was missing
23:07:38	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/prometheus-operator -n openshift-monitoring because it was missing
23:07:39	openshift-image-registry	kubelet	image-registry-7f64f764df-gtws9	ProbeError	Liveness probe error: HTTP probe failed with statuscode: 503 body: {"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
23:07:39	openshift-image-registry	kubelet	image-registry-7f64f764df-gtws9	Unhealthy	Liveness probe failed: HTTP probe failed with statuscode: 503
23:07:39	openshift-monitoring	multus	prometheus-operator-7bd5d56d6-n2rtl	AddedInterface	Add eth0 [10.134.0.11/23] from ovn-kubernetes
23:07:39	openshift-monitoring	kubelet	prometheus-operator-7bd5d56d6-n2rtl	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6296133aac2b788cf85aed7be93963e70d1f9e0af073bcd1bb23d243dcc66b1b"
23:07:41	kube-system	kubelet	global-pull-secret-syncer-fvjmj	Created	Created container: global-pull-secret-syncer
23:07:41	openshift-monitoring	kubelet	prometheus-operator-7bd5d56d6-n2rtl	Created	Created container: prometheus-operator
23:07:41	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "RouteHealthDegraded: failed to GET route (https://console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com): Get \"https://console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com\": dial tcp: lookup console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com on 172.31.0.10:53: read udp 10.132.0.12:54848->172.31.0.10:53: read: connection refused" to "All is well",Available changed from False to True ("All is well")
23:07:41	kube-system	kubelet	global-pull-secret-syncer-fvjmj	Started	Started container global-pull-secret-syncer
23:07:41	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Progressing message changed from "SyncLoopRefreshProgressing: working toward version 4.21.34, 0 replicas available" to "SyncLoopRefreshProgressing: working toward version 4.21.34, 1 replicas available",Available message changed from "DeploymentAvailable: 0 replicas available for console deployment\nRouteHealthAvailable: failed to GET route (https://console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com): Get \"https://console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com\": dial tcp: lookup console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com on 172.31.0.10:53: read udp 10.132.0.12:54848->172.31.0.10:53: read: connection refused" to "RouteHealthAvailable: failed to GET route (https://console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com): Get \"https://console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com\": dial tcp: lookup console-openshift-console.apps.93dee3fd-67ea-4296-9f8e-cfc37f6a17c9.prod.konfluxeaas.com on 172.31.0.10:53: read udp 10.132.0.12:54848->172.31.0.10:53: read: connection refused"
23:07:41	openshift-monitoring	kubelet	prometheus-operator-7bd5d56d6-n2rtl	Started	Started container kube-rbac-proxy
23:07:41	openshift-monitoring	kubelet	prometheus-operator-7bd5d56d6-n2rtl	Created	Created container: kube-rbac-proxy
23:07:41	openshift-monitoring	kubelet	prometheus-operator-7bd5d56d6-n2rtl	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:41	openshift-monitoring	kubelet	prometheus-operator-7bd5d56d6-n2rtl	Started	Started container prometheus-operator
23:07:41	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled down replica set console-674fc5764c from 1 to 0
23:07:41	openshift-monitoring	kubelet	prometheus-operator-7bd5d56d6-n2rtl	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6296133aac2b788cf85aed7be93963e70d1f9e0af073bcd1bb23d243dcc66b1b" in 1.603s (1.603s including waiting). Image size: 273685375 bytes.
23:07:41	openshift-network-diagnostics	kubelet	network-check-target-zsdgk	Started	Started container network-check-target-container
23:07:41	kube-system	kubelet	global-pull-secret-syncer-fvjmj	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b4f435f3abc206296a8780c8ac19e07d8716958d5d6af9c855e58ede0127674" in 4.556s (4.556s including waiting). Image size: 579458568 bytes.
23:07:41	openshift-console	kubelet	console-674fc5764c-4ztgh	Killing	Stopping container console
23:07:41	openshift-console	replicaset-controller	console-674fc5764c	SuccessfulDelete	Deleted pod: console-674fc5764c-4ztgh
23:07:41	openshift-network-diagnostics	kubelet	network-check-target-zsdgk	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:37390c626811724e9dfa2edb9b6f7ab4c26ce227e3068999d52f275c82722991" in 4.543s (4.543s including waiting). Image size: 459700390 bytes.
23:07:41	openshift-network-diagnostics	kubelet	network-check-target-zsdgk	Created	Created container: network-check-target-container
23:07:42	openshift-console	kubelet	downloads-6594f4c75-kzt9c	Started	Started container download-server
23:07:42	openshift-console	kubelet	downloads-6594f4c75-kzt9c	Created	Created container: download-server
23:07:42	openshift-console	kubelet	downloads-6594f4c75-kzt9c	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:42472278fab42285a189b682a62b86a237b7073c2b99b44a816dfab9225e1504" in 20.447s (20.448s including waiting). Image size: 2070000656 bytes.
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/pod-metrics-reader because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/kube-state-metrics -n openshift-monitoring because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/node-exporter-accelerators-collector-config -n openshift-monitoring because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/kube-state-metrics-custom-resource-state-configmap -n openshift-monitoring because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/node-exporter -n openshift-monitoring because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/kube-state-metrics -n openshift-monitoring because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/openshift-state-metrics -n openshift-monitoring because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreateFailed	Failed to create ClusterRoleBinding.rbac.authorization.k8s.io/telemeter-client-view: clusterrolebindings.rbac.authorization.k8s.io "cluster-monitoring-view" not found
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/node-exporter because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/kube-state-metrics because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/telemeter-client because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/openshift-state-metrics because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/monitoring-rules-edit because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/system:metrics-server because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/metrics-server -n openshift-monitoring because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/kube-state-metrics because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/telemeter-client because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/openshift-state-metrics because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/prometheus-k8s because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/node-exporter because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/prometheus-k8s because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/system:aggregated-metrics-reader because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/kubelet-serving-ca-bundle -n openshift-monitoring because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/node-exporter -n openshift-monitoring because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/telemeter-client -n openshift-monitoring because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/openshift-state-metrics -n openshift-monitoring because it was missing
23:07:43	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/thanos-querier -n openshift-monitoring because it was missing
23:07:44	openshift-monitoring	replicaset-controller	openshift-state-metrics-86c5bc79d6	SuccessfulCreate	Created pod: openshift-state-metrics-86c5bc79d6-jwstr
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/thanos-querier-kube-rbac-proxy-web -n openshift-monitoring because it was missing
23:07:44	openshift-monitoring	deployment-controller	kube-state-metrics	ScalingReplicaSet	Scaled up replica set kube-state-metrics-84c885658c from 0 to 1
23:07:44	openshift-monitoring	replicaset-controller	kube-state-metrics-84c885658c	SuccessfulCreate	Created pod: kube-state-metrics-84c885658c-tg8gr
23:07:44	openshift-monitoring	kubelet	kube-state-metrics-84c885658c-tg8gr	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eb6451a1ba44251e46f4131974a22d9785eb2c930db11722b1e702bd1fea6493"
23:07:44	openshift-monitoring	multus	kube-state-metrics-84c885658c-tg8gr	AddedInterface	Add eth0 [10.134.0.13/23] from ovn-kubernetes
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/alertmanager-main -n openshift-monitoring because it was missing
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/alertmanager-main -n openshift-monitoring because it was missing
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/cluster-monitoring-metrics-api -n openshift-monitoring because it was missing
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/alertmanager-main because it was missing
23:07:44	openshift-monitoring	kubelet	node-exporter-qrvdw	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:90d5c72aa3cd7e19abb4cac0e1b92daa86dffe67a26301f456b8bb39a97882f7"
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/thanos-querier because it was missing
23:07:44	openshift-image-registry	kubelet	image-registry-7f64f764df-gtws9	Killing	Stopping container registry
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/monitoring-alertmanager-view -n openshift-monitoring because it was missing
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/alertmanager-main because it was missing
23:07:44	openshift-image-registry	replicaset-controller	image-registry-7f64f764df	SuccessfulDelete	Deleted pod: image-registry-7f64f764df-gtws9
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/thanos-querier because it was missing
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/thanos-querier -n openshift-monitoring because it was missing
23:07:44	openshift-monitoring	deployment-controller	openshift-state-metrics	ScalingReplicaSet	Scaled up replica set openshift-state-metrics-86c5bc79d6 from 0 to 1
23:07:44	openshift-monitoring	kubelet	node-exporter-55dvl	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:90d5c72aa3cd7e19abb4cac0e1b92daa86dffe67a26301f456b8bb39a97882f7"
23:07:44	openshift-monitoring	kubelet	openshift-state-metrics-86c5bc79d6-jwstr	FailedMount	MountVolume.SetUp failed for volume "openshift-state-metrics-tls" : secret "openshift-state-metrics-tls" not found
23:07:44	openshift-monitoring	daemonset-controller	node-exporter	SuccessfulCreate	Created pod: node-exporter-55dvl
23:07:44	openshift-monitoring	daemonset-controller	node-exporter	SuccessfulCreate	Created pod: node-exporter-njz52
23:07:44	openshift-monitoring	daemonset-controller	node-exporter	SuccessfulCreate	Created pod: node-exporter-qrvdw
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/monitoring-alertmanager-edit -n openshift-monitoring because it was missing
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/monitoring-alertmanager-api-writer -n openshift-user-workload-monitoring because it was missing
23:07:44	openshift-image-registry	deployment-controller	image-registry	ScalingReplicaSet	Scaled down replica set image-registry-7f64f764df from 1 to 0
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/monitoring-alertmanager-api-reader -n openshift-user-workload-monitoring because it was missing
23:07:44	openshift-monitoring	kubelet	node-exporter-njz52	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:90d5c72aa3cd7e19abb4cac0e1b92daa86dffe67a26301f456b8bb39a97882f7"
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/system:metrics-server because it was missing
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/monitoring-rules-view because it was missing
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/metrics-server:system:auth-delegator because it was missing
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/user-workload-monitoring-config-edit -n openshift-user-workload-monitoring because it was missing
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/monitoring-edit because it was missing
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/alert-routing-edit because it was missing
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/cluster-monitoring-view because it was missing
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/metrics-server -n openshift-monitoring because it was missing
23:07:44	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/metrics-server-auth-reader -n kube-system because it was missing
23:07:45	openshift-monitoring	kubelet	openshift-state-metrics-86c5bc79d6-jwstr	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:45	openshift-monitoring	kubelet	node-exporter-55dvl	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:90d5c72aa3cd7e19abb4cac0e1b92daa86dffe67a26301f456b8bb39a97882f7" in 820ms (820ms including waiting). Image size: 251589478 bytes.
23:07:45	openshift-monitoring	kubelet	node-exporter-55dvl	Created	Created container: init-textfile
23:07:45	openshift-monitoring	kubelet	node-exporter-55dvl	Started	Started container init-textfile
23:07:45	openshift-monitoring	kubelet	node-exporter-qrvdw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:45	openshift-monitoring	kubelet	node-exporter-njz52	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:90d5c72aa3cd7e19abb4cac0e1b92daa86dffe67a26301f456b8bb39a97882f7" in 1.39s (1.39s including waiting). Image size: 251589478 bytes.
23:07:45	openshift-monitoring	kubelet	node-exporter-njz52	Created	Created container: init-textfile
23:07:45	openshift-monitoring	kubelet	node-exporter-qrvdw	Created	Created container: kube-rbac-proxy
23:07:45	openshift-monitoring	kubelet	node-exporter-qrvdw	Started	Started container kube-rbac-proxy
23:07:45	openshift-monitoring	multus	openshift-state-metrics-86c5bc79d6-jwstr	AddedInterface	Add eth0 [10.134.0.12/23] from ovn-kubernetes
23:07:45	openshift-monitoring	kubelet	openshift-state-metrics-86c5bc79d6-jwstr	Created	Created container: kube-rbac-proxy-main
23:07:45	openshift-monitoring	kubelet	node-exporter-qrvdw	Started	Started container node-exporter
23:07:45	openshift-monitoring	kubelet	node-exporter-qrvdw	Created	Created container: node-exporter
23:07:45	openshift-monitoring	kubelet	node-exporter-qrvdw	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:90d5c72aa3cd7e19abb4cac0e1b92daa86dffe67a26301f456b8bb39a97882f7" already present on machine
23:07:45	openshift-monitoring	kubelet	node-exporter-qrvdw	Started	Started container init-textfile
23:07:45	openshift-monitoring	kubelet	node-exporter-qrvdw	Created	Created container: init-textfile
23:07:45	openshift-monitoring	kubelet	node-exporter-qrvdw	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:90d5c72aa3cd7e19abb4cac0e1b92daa86dffe67a26301f456b8bb39a97882f7" in 882ms (882ms including waiting). Image size: 251589478 bytes.
23:07:45	openshift-monitoring	kubelet	openshift-state-metrics-86c5bc79d6-jwstr	Started	Started container kube-rbac-proxy-main
23:07:45	openshift-monitoring	kubelet	openshift-state-metrics-86c5bc79d6-jwstr	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:45	openshift-monitoring	kubelet	openshift-state-metrics-86c5bc79d6-jwstr	Created	Created container: kube-rbac-proxy-self
23:07:45	openshift-monitoring	kubelet	openshift-state-metrics-86c5bc79d6-jwstr	Started	Started container kube-rbac-proxy-self
23:07:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/alertmanager-trusted-ca-bundle -n openshift-monitoring because it was missing
23:07:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/grpc-tls -n openshift-monitoring because it was missing
23:07:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/kube-rbac-proxy -n openshift-monitoring because it was missing
23:07:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/prometheus-k8s-kube-rbac-proxy-web -n openshift-monitoring because it was missing
23:07:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceAccountCreated	Created ServiceAccount/prometheus-k8s -n openshift-monitoring because it was missing
23:07:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/alertmanager-prometheusk8s -n openshift-monitoring because it was missing
23:07:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/thanos-querier-grpc-tls-auorv46b00q7o -n openshift-monitoring because it was missing
23:07:45	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/prometheus-k8s-config -n openshift-monitoring because it was missing
23:07:45	openshift-monitoring	kubelet	openshift-state-metrics-86c5bc79d6-jwstr	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c399a183436329b4634a794fc75cb4e2499b231dd97b5f0992ee1ffff924579a"
23:07:45	openshift-monitoring	kubelet	alertmanager-main-0	FailedMount	MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" : configmap references non-existent config key: ca-bundle.crt
23:07:45	openshift-monitoring	kubelet	kube-state-metrics-84c885658c-tg8gr	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eb6451a1ba44251e46f4131974a22d9785eb2c930db11722b1e702bd1fea6493" in 1.335s (1.335s including waiting). Image size: 271483647 bytes.
23:07:45	openshift-monitoring	statefulset-controller	alertmanager-main	SuccessfulCreate	create Pod alertmanager-main-0 in StatefulSet alertmanager-main successful
23:07:46	openshift-monitoring	kubelet	node-exporter-55dvl	Started	Started container node-exporter
23:07:46	openshift-monitoring	deployment-controller	thanos-querier	ScalingReplicaSet	Scaled up replica set thanos-querier-787444c6d5 from 0 to 1
23:07:46	openshift-monitoring	kubelet	openshift-state-metrics-86c5bc79d6-jwstr	Created	Created container: openshift-state-metrics
23:07:46	openshift-monitoring	kubelet	openshift-state-metrics-86c5bc79d6-jwstr	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c399a183436329b4634a794fc75cb4e2499b231dd97b5f0992ee1ffff924579a" in 1.212s (1.212s including waiting). Image size: 246361254 bytes.
23:07:46	openshift-monitoring	kubelet	node-exporter-njz52	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:90d5c72aa3cd7e19abb4cac0e1b92daa86dffe67a26301f456b8bb39a97882f7" already present on machine
23:07:46	openshift-monitoring	kubelet	node-exporter-njz52	Started	Started container init-textfile
23:07:46	openshift-monitoring	multus	alertmanager-main-0	AddedInterface	Add eth0 [10.133.0.11/23] from ovn-kubernetes
23:07:46	openshift-monitoring	kubelet	node-exporter-55dvl	Started	Started container kube-rbac-proxy
23:07:46	openshift-monitoring	kubelet	kube-state-metrics-84c885658c-tg8gr	Started	Started container kube-rbac-proxy-self
23:07:46	openshift-monitoring	kubelet	kube-state-metrics-84c885658c-tg8gr	Created	Created container: kube-rbac-proxy-self
23:07:46	openshift-monitoring	kubelet	kube-state-metrics-84c885658c-tg8gr	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:46	openshift-monitoring	kubelet	kube-state-metrics-84c885658c-tg8gr	Started	Started container kube-rbac-proxy-main
23:07:46	openshift-monitoring	kubelet	kube-state-metrics-84c885658c-tg8gr	Created	Created container: kube-rbac-proxy-main
23:07:46	openshift-monitoring	kubelet	kube-state-metrics-84c885658c-tg8gr	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:46	openshift-monitoring	kubelet	kube-state-metrics-84c885658c-tg8gr	Started	Started container kube-state-metrics
23:07:46	openshift-monitoring	kubelet	kube-state-metrics-84c885658c-tg8gr	Created	Created container: kube-state-metrics
23:07:46	openshift-monitoring	kubelet	node-exporter-55dvl	Created	Created container: kube-rbac-proxy
23:07:46	openshift-monitoring	kubelet	node-exporter-55dvl	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:46	openshift-monitoring	kubelet	node-exporter-55dvl	Created	Created container: node-exporter
23:07:46	openshift-monitoring	kubelet	node-exporter-55dvl	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:90d5c72aa3cd7e19abb4cac0e1b92daa86dffe67a26301f456b8bb39a97882f7" already present on machine
23:07:46	openshift-monitoring	multus	thanos-querier-787444c6d5-86h6h	AddedInterface	Add eth0 [10.134.0.14/23] from ovn-kubernetes
23:07:46	openshift-monitoring	kubelet	openshift-state-metrics-86c5bc79d6-jwstr	Started	Started container openshift-state-metrics
23:07:46	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/prometheus-k8s -n kube-system because it was missing
23:07:46	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/prometheus-k8s -n default because it was missing
23:07:46	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/prometheus-k8s -n openshift-user-workload-monitoring because it was missing
23:07:46	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/prometheus-k8s -n openshift-monitoring because it was missing
23:07:46	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/prometheus-k8s -n kube-system because it was missing
23:07:46	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/prometheus-k8s -n default because it was missing
23:07:46	openshift-monitoring	kubelet	alertmanager-main-0	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:edde5b490bb367e2ca2c39ae1ec08032e0511c9ad83bda8c7e5e3f52faef71dc"
23:07:46	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53aca69b771760b118205c106af64aafd8af7f14ae50bcca8d74dd90209eaf6f"
23:07:46	openshift-monitoring	replicaset-controller	thanos-querier-787444c6d5	SuccessfulCreate	Created pod: thanos-querier-787444c6d5-86h6h
23:07:47	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/metrics-server-audit-profiles -n openshift-monitoring because it was missing
23:07:47	openshift-monitoring	kubelet	node-exporter-njz52	Started	Started container node-exporter
23:07:47	openshift-monitoring	kubelet	alertmanager-main-0	Started	Started container init-config-reloader
23:07:47	openshift-monitoring	kubelet	alertmanager-main-0	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:59f2c2e4a69dc8a948619bd9a73eb250c7a72eb9d2dd778956bfae871d6f2c5e"
23:07:47	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:edde5b490bb367e2ca2c39ae1ec08032e0511c9ad83bda8c7e5e3f52faef71dc" in 922ms (922ms including waiting). Image size: 253582101 bytes.
23:07:47	openshift-monitoring	kubelet	node-exporter-njz52	Started	Started container kube-rbac-proxy
23:07:47	openshift-monitoring	kubelet	node-exporter-njz52	Created	Created container: kube-rbac-proxy
23:07:47	openshift-monitoring	kubelet	node-exporter-njz52	Created	Created container: node-exporter
23:07:47	openshift-monitoring	kubelet	node-exporter-njz52	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:47	openshift-monitoring	kubelet	alertmanager-main-0	Created	Created container: init-config-reloader
23:07:48	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled up replica set console-695bd4fb54 from 0 to 1
23:07:48	openshift-monitoring	multus	metrics-server-5f799df98b-zs8dn	AddedInterface	Add eth0 [10.133.0.12/23] from ovn-kubernetes
23:07:48	openshift-monitoring	replicaset-controller	metrics-server-5f799df98b	SuccessfulCreate	Created pod: metrics-server-5f799df98b-zs8dn
23:07:48	openshift-console	replicaset-controller	console-695bd4fb54	SuccessfulCreate	Created pod: console-695bd4fb54-cktj7
23:07:48	openshift-monitoring	deployment-controller	metrics-server	ScalingReplicaSet	Scaled up replica set metrics-server-5f799df98b from 0 to 1
23:07:48	openshift-monitoring	deployment-controller	monitoring-plugin	ScalingReplicaSet	Scaled up replica set monitoring-plugin-5984459ff8 from 0 to 1
23:07:48	openshift-monitoring	replicaset-controller	monitoring-plugin-5984459ff8	SuccessfulCreate	Created pod: monitoring-plugin-5984459ff8-trd7x
23:07:48	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/metrics-server-5nou8mr7qa1k3 -n openshift-monitoring because it was missing
23:07:48	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: status.relatedObjects changed from [{"console.openshift.io" "consoleplugins" "" "networking-console-plugin"} {"" "namespaces" "" "openshift-network-console"} {"oauth.openshift.io" "oauthclients" "" "console"} {"operator.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "infrastructures" "" "cluster"} {"config.openshift.io" "proxies" "" "cluster"} {"config.openshift.io" "oauths" "" "cluster"} {"" "namespaces" "" "openshift-console-operator"} {"" "namespaces" "" "openshift-console"} {"" "configmaps" "openshift-config-managed" "console-public"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-operator"} {"rbac.authorization.k8s.io" "clusterroles" "" "console"} {"rbac.authorization.k8s.io" "clusterroles" "" "helm-chartrepos-viewer"} {"rbac.authorization.k8s.io" "clusterroles" "" "project-helm-chartrepository-editor"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-extensions-reader"}] to [{"console.openshift.io" "consoleplugins" "" "monitoring-plugin"} {"" "namespaces" "" "openshift-monitoring"} {"console.openshift.io" "consoleplugins" "" "networking-console-plugin"} {"" "namespaces" "" "openshift-network-console"} {"oauth.openshift.io" "oauthclients" "" "console"} {"operator.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "infrastructures" "" "cluster"} {"config.openshift.io" "proxies" "" "cluster"} {"config.openshift.io" "oauths" "" "cluster"} {"" "namespaces" "" "openshift-console-operator"} {"" "namespaces" "" "openshift-console"} {"" "configmaps" "openshift-config-managed" "console-public"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-operator"} {"rbac.authorization.k8s.io" "clusterroles" "" "console"} {"rbac.authorization.k8s.io" "clusterroles" "" "helm-chartrepos-viewer"} {"rbac.authorization.k8s.io" "clusterroles" "" "project-helm-chartrepository-editor"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-extensions-reader"}]
23:07:49	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Created	Created container: thanos-query
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Created	Created container: kube-rbac-proxy-web
23:07:49	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Created	Created container: kube-rbac-proxy
23:07:49	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:49	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Started	Started container kube-rbac-proxy-web
23:07:49	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Created	Created container: kube-rbac-proxy-web
23:07:49	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:49	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Started	Started container thanos-query
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:49	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53aca69b771760b118205c106af64aafd8af7f14ae50bcca8d74dd90209eaf6f" in 2.195s (2.195s including waiting). Image size: 328410579 bytes.
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Started	Started container kube-rbac-proxy
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Created	Created container: kube-rbac-proxy
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Started	Started container kube-rbac-proxy-web
23:07:49	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/prometheus-k8s-grpc-tls-8ftd8u70k8ep2 -n openshift-monitoring because it was missing
23:07:49	openshift-monitoring	kubelet	monitoring-plugin-5984459ff8-trd7x	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ba1bd4eb0a141acc5fe3c1ef3737a8c93e9be0356103780001f79eca9a5579ce"
23:07:49	openshift-monitoring	multus	monitoring-plugin-5984459ff8-trd7x	AddedInterface	Add eth0 [10.133.0.13/23] from ovn-kubernetes
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Created	Created container: kube-rbac-proxy-metric
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Started	Started container kube-rbac-proxy-metric
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3bd301ff8da0ba793392800a22ad550ee9900f0a40b5ade093c34606cf4103ad"
23:07:49	openshift-console	kubelet	console-695bd4fb54-cktj7	Started	Started container console
23:07:49	openshift-console	kubelet	console-695bd4fb54-cktj7	Created	Created container: console
23:07:49	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Started	Started container kube-rbac-proxy
23:07:49	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3bd301ff8da0ba793392800a22ad550ee9900f0a40b5ade093c34606cf4103ad"
23:07:49	openshift-monitoring	kubelet	metrics-server-5f799df98b-zs8dn	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b525e953df30b4930484742fc53c1b81ab715d07d43b3ad5b19d66d848f9ed03"
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Started	Started container config-reloader
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Created	Created container: config-reloader
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:edde5b490bb367e2ca2c39ae1ec08032e0511c9ad83bda8c7e5e3f52faef71dc" already present on machine
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Started	Started container alertmanager
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Created	Created container: alertmanager
23:07:49	openshift-console	kubelet	console-695bd4fb54-cktj7	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c48957842946a7846a4b0aade93e6ab20f483c51200957ae5daec4f7624a8828" already present on machine
23:07:49	openshift-console	multus	console-695bd4fb54-cktj7	AddedInterface	Add eth0 [10.134.0.15/23] from ovn-kubernetes
23:07:49	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:59f2c2e4a69dc8a948619bd9a73eb250c7a72eb9d2dd778956bfae871d6f2c5e" in 1.218s (1.218s including waiting). Image size: 279737262 bytes.
23:07:50	openshift-network-diagnostics	kubelet	network-check-target-9vxwv	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:37390c626811724e9dfa2edb9b6f7ab4c26ce227e3068999d52f275c82722991"
23:07:50	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3bd301ff8da0ba793392800a22ad550ee9900f0a40b5ade093c34606cf4103ad" in 715ms (715ms including waiting). Image size: 228396310 bytes.
23:07:50	openshift-monitoring	kubelet	metrics-server-5f799df98b-zs8dn	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b525e953df30b4930484742fc53c1b81ab715d07d43b3ad5b19d66d848f9ed03" in 1.397s (1.397s including waiting). Image size: 291785175 bytes.
23:07:50	openshift-monitoring	kubelet	metrics-server-5f799df98b-zs8dn	Started	Started container metrics-server
23:07:50	openshift-monitoring	kubelet	monitoring-plugin-5984459ff8-trd7x	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ba1bd4eb0a141acc5fe3c1ef3737a8c93e9be0356103780001f79eca9a5579ce" in 1.562s (1.562s including waiting). Image size: 270021441 bytes.
23:07:50	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Started	Started container kube-rbac-proxy-metrics
23:07:50	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Created	Created container: kube-rbac-proxy-metrics
23:07:50	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:50	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Started	Started container kube-rbac-proxy-rules
23:07:50	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Created	Created container: kube-rbac-proxy-rules
23:07:50	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:50	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Started	Started container prom-label-proxy
23:07:50	openshift-monitoring	kubelet	thanos-querier-787444c6d5-86h6h	Created	Created container: prom-label-proxy
23:07:50	openshift-monitoring	kubelet	prometheus-k8s-0	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:edde5b490bb367e2ca2c39ae1ec08032e0511c9ad83bda8c7e5e3f52faef71dc"
23:07:50	openshift-monitoring	multus	prometheus-k8s-0	AddedInterface	Add eth0 [10.134.0.16/23] from ovn-kubernetes
23:07:50	openshift-multus	multus	network-metrics-daemon-r5mz6	AddedInterface	Add eth0 [10.134.0.5/23] from ovn-kubernetes
23:07:50	openshift-multus	kubelet	network-metrics-daemon-r5mz6	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cc9e90ba265590a3fcbdbf332fea492e53c27f0a1a2c568afb736438aeb9836c"
23:07:50	openshift-network-diagnostics	multus	network-check-target-9vxwv	AddedInterface	Add eth0 [10.134.0.3/23] from ovn-kubernetes
23:07:50	openshift-monitoring	kubelet	metrics-server-5f799df98b-zs8dn	Created	Created container: metrics-server
23:07:50	kube-system	kubelet	global-pull-secret-syncer-rw5hp	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b4f435f3abc206296a8780c8ac19e07d8716958d5d6af9c855e58ede0127674"
23:07:50	kube-system	multus	global-pull-secret-syncer-rw5hp	AddedInterface	Add eth0 [10.134.0.4/23] from ovn-kubernetes
23:07:50	openshift-monitoring	statefulset-controller	prometheus-k8s	SuccessfulCreate	create Pod prometheus-k8s-0 in StatefulSet prometheus-k8s successful
23:07:50	openshift-monitoring	kubelet	alertmanager-main-0	Started	Started container prom-label-proxy
23:07:50	openshift-monitoring	kubelet	alertmanager-main-0	Created	Created container: prom-label-proxy
23:07:50	openshift-monitoring	kubelet	alertmanager-main-0	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3bd301ff8da0ba793392800a22ad550ee9900f0a40b5ade093c34606cf4103ad" in 1.084s (1.084s including waiting). Image size: 228396310 bytes.
23:07:51	openshift-monitoring	kubelet	monitoring-plugin-5984459ff8-trd7x	Started	Started container monitoring-plugin
23:07:51	openshift-monitoring	kubelet	monitoring-plugin-5984459ff8-trd7x	Created	Created container: monitoring-plugin
23:07:52	openshift-multus	kubelet	network-metrics-daemon-r5mz6	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cc9e90ba265590a3fcbdbf332fea492e53c27f0a1a2c568afb736438aeb9836c" in 1.619s (1.619s including waiting). Image size: 252195882 bytes.
23:07:52	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Started container init-config-reloader
23:07:52	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Created container: init-config-reloader
23:07:52	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:edde5b490bb367e2ca2c39ae1ec08032e0511c9ad83bda8c7e5e3f52faef71dc" in 1.114s (1.114s including waiting). Image size: 253582101 bytes.
23:07:52	openshift-monitoring	kubelet	prometheus-k8s-0	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e49054fbe775a28adf6ca32eaaeba351a6b11dba98c978bb226a11a3e918ce7"
23:07:52	openshift-multus	kubelet	network-metrics-daemon-r5mz6	Started	Started container kube-rbac-proxy
23:07:52	openshift-multus	kubelet	network-metrics-daemon-r5mz6	Created	Created container: kube-rbac-proxy
23:07:52	openshift-multus	kubelet	network-metrics-daemon-r5mz6	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:52	openshift-multus	kubelet	network-metrics-daemon-r5mz6	Started	Started container network-metrics-daemon
23:07:52	openshift-multus	kubelet	network-metrics-daemon-r5mz6	Created	Created container: network-metrics-daemon
23:07:55	openshift-network-diagnostics	kubelet	network-check-target-9vxwv	Created	Created container: network-check-target-container
23:07:55	kube-system	kubelet	global-pull-secret-syncer-rw5hp	Started	Started container global-pull-secret-syncer
23:07:55	openshift-network-diagnostics	kubelet	network-check-target-9vxwv	Started	Started container network-check-target-container
23:07:55	kube-system	kubelet	global-pull-secret-syncer-rw5hp	Created	Created container: global-pull-secret-syncer
23:07:55	kube-system	kubelet	global-pull-secret-syncer-rw5hp	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b4f435f3abc206296a8780c8ac19e07d8716958d5d6af9c855e58ede0127674" in 4.924s (4.924s including waiting). Image size: 579458568 bytes.
23:07:55	openshift-network-diagnostics	kubelet	network-check-target-9vxwv	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:37390c626811724e9dfa2edb9b6f7ab4c26ce227e3068999d52f275c82722991" in 4.813s (4.813s including waiting). Image size: 459700390 bytes.
23:07:57	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Started container thanos-sidecar
23:07:57	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Created container: thanos-sidecar
23:07:57	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e49054fbe775a28adf6ca32eaaeba351a6b11dba98c978bb226a11a3e918ce7" in 5.309s (5.309s including waiting). Image size: 478221268 bytes.
23:07:57	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Created container: prometheus
23:07:57	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Started container prometheus
23:07:57	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:edde5b490bb367e2ca2c39ae1ec08032e0511c9ad83bda8c7e5e3f52faef71dc" already present on machine
23:07:57	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Created container: kube-rbac-proxy-web
23:07:57	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:57	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Created container: config-reloader
23:07:57	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Started container config-reloader
23:07:57	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53aca69b771760b118205c106af64aafd8af7f14ae50bcca8d74dd90209eaf6f" already present on machine
23:07:58	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Created container: kube-rbac-proxy
23:07:58	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Started container kube-rbac-proxy-web
23:07:58	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:58	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Started container kube-rbac-proxy
23:07:58	openshift-monitoring	kubelet	prometheus-k8s-0	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:07:58	openshift-monitoring	kubelet	prometheus-k8s-0	Created	Created container: kube-rbac-proxy-thanos
23:07:58	openshift-monitoring	kubelet	prometheus-k8s-0	Started	Started container kube-rbac-proxy-thanos
23:07:59	openshift-console	kubelet	console-fd479bccb-8dszg	Killing	Stopping container console
23:07:59	openshift-console	replicaset-controller	console-fd479bccb	SuccessfulDelete	Deleted pod: console-fd479bccb-8dszg
23:07:59	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled down replica set console-fd479bccb from 1 to 0
23:08:09 (x2)	openshift-service-ca-operator	kubelet	service-ca-operator-57cdc4b768-g6ngg	Created	Created container: service-ca-operator
23:08:09	openshift-service-ca-operator	service-ca-operator	service-ca-operator-lock	LeaderElection	service-ca-operator-57cdc4b768-g6ngg_522f7905-c154-4c67-a0d7-721524207f77 became leader
23:08:09 (x2)	openshift-kube-storage-version-migrator-operator	kubelet	kube-storage-version-migrator-operator-55889f7b47-4gmns	Started	Started container kube-storage-version-migrator-operator
23:08:09	openshift-service-ca-operator	kubelet	service-ca-operator-57cdc4b768-g6ngg	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c030b660bee8debb47feae355ad21ca87984abf181de93e6a0bb3750cab88c4f" already present on machine
23:08:09	openshift-kube-storage-version-migrator-operator	kubelet	kube-storage-version-migrator-operator-55889f7b47-4gmns	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:19f97ecb88e6cbef776b9ec3c20fde1b9bf3e3584afdd21ed2dab9d4b0541102" already present on machine
23:08:09 (x2)	openshift-kube-storage-version-migrator-operator	kubelet	kube-storage-version-migrator-operator-55889f7b47-4gmns	Created	Created container: kube-storage-version-migrator-operator
23:08:09	openshift-service-ca-operator	service-ca-operator	service-ca-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "GatewayAPIWithoutOLM", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
23:08:09 (x2)	openshift-service-ca-operator	kubelet	service-ca-operator-57cdc4b768-g6ngg	Started	Started container service-ca-operator
23:08:09	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator	openshift-kube-storage-version-migrator-operator-lock	LeaderElection	kube-storage-version-migrator-operator-55889f7b47-4gmns_a2cacae3-b180-4628-bff2-0267c496b802 became leader
23:08:24	openshift-insights	kubelet	insights-operator-6f9c644dd9-gw259	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9c8b813e74034164c1abfb26369b76f4b6d24f3d46e277b08f72ddcbc369c7d8" already present on machine
23:08:24 (x2)	openshift-insights	kubelet	insights-operator-6f9c644dd9-gw259	Started	Started container insights-operator
23:08:24 (x2)	openshift-insights	kubelet	insights-operator-6f9c644dd9-gw259	Created	Created container: insights-operator
23:08:25	openshift-insights	openshift-insights-operator	insights-operator	FeatureGatesInitialized	FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "EventTTL", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "GatewayAPIWithoutOLM", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
23:08:25	openshift-insights	openshift-insights-operator	insights-operator	DaemonSetUpdated	Updated DaemonSet.apps/insights-runtime-extractor -n openshift-insights because it changed
23:08:25	openshift-insights	openshift-insights-operator	insights-operator	DaemonSet Updated	Runtime extractor DaemonSet openshift-insights/insights-runtime-extractor was created or updated
23:08:29	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	APIServiceCreated	Created APIService.apiregistration.k8s.io/v1beta1.metrics.k8s.io because it was missing
23:09:01	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ValidatingWebhookConfigurationUpdated	Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/alertmanagerconfigs.openshift.io because it changed
23:09:01	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ValidatingWebhookConfigurationUpdated	Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/prometheusrules.openshift.io because it changed
23:09:03	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ServiceCreated	Created Service/telemeter-client -n openshift-monitoring because it was missing
23:09:03	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/telemeter-client-kube-rbac-proxy-config -n openshift-monitoring because it was missing
23:09:03	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	SecretCreated	Created Secret/telemeter-client -n openshift-monitoring because it was missing
23:09:03	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/telemeter-client-view because it was missing
23:09:08	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/telemeter-trusted-ca-bundle-8i12ta5c71j38 -n openshift-monitoring because it was missing
23:09:08	openshift-monitoring	replicaset-controller	telemeter-client-7f785bf9cb	SuccessfulCreate	Created pod: telemeter-client-7f785bf9cb-nf4rh
23:09:08	openshift-monitoring	deployment-controller	telemeter-client	ScalingReplicaSet	Scaled up replica set telemeter-client-7f785bf9cb from 0 to 1
23:09:08	openshift-monitoring	kubelet	telemeter-client-7f785bf9cb-nf4rh	Pulling	Pulling image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0214bbb7c4d0bc4386ef421e03c00f4fc1d0fffa2806e4b0ef2c3715c983e1d2"
23:09:08	openshift-monitoring	multus	telemeter-client-7f785bf9cb-nf4rh	AddedInterface	Add eth0 [10.133.0.14/23] from ovn-kubernetes
23:09:10	openshift-monitoring	kubelet	telemeter-client-7f785bf9cb-nf4rh	Created	Created container: telemeter-client
23:09:10	openshift-monitoring	kubelet	telemeter-client-7f785bf9cb-nf4rh	Pulled	Successfully pulled image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0214bbb7c4d0bc4386ef421e03c00f4fc1d0fffa2806e4b0ef2c3715c983e1d2" in 1.695s (1.695s including waiting). Image size: 303406607 bytes.
23:09:10	openshift-monitoring	kubelet	telemeter-client-7f785bf9cb-nf4rh	Started	Started container kube-rbac-proxy
23:09:10	openshift-monitoring	kubelet	telemeter-client-7f785bf9cb-nf4rh	Created	Created container: kube-rbac-proxy
23:09:10	openshift-monitoring	kubelet	telemeter-client-7f785bf9cb-nf4rh	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:beacea521116b2422086941236135068766b54396a322e81fd4104d55c0282df" already present on machine
23:09:10	openshift-monitoring	kubelet	telemeter-client-7f785bf9cb-nf4rh	Started	Started container reload
23:09:10	openshift-monitoring	kubelet	telemeter-client-7f785bf9cb-nf4rh	Created	Created container: reload
23:09:10	openshift-monitoring	kubelet	telemeter-client-7f785bf9cb-nf4rh	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:edde5b490bb367e2ca2c39ae1ec08032e0511c9ad83bda8c7e5e3f52faef71dc" already present on machine
23:09:10	openshift-monitoring	kubelet	telemeter-client-7f785bf9cb-nf4rh	Started	Started container telemeter-client
23:09:11	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled up replica set console-7c6f7b5ddb from 0 to 1
23:09:11	openshift-console	replicaset-controller	console-7c6f7b5ddb	SuccessfulCreate	Created pod: console-7c6f7b5ddb-jjlhc
23:09:11	openshift-console	kubelet	console-7c6f7b5ddb-jjlhc	Started	Started container console
23:09:11	openshift-console-operator	console-operator-console-operator-consoleoperator	console-operator	DeploymentUpdateFailed	Failed to update Deployment.apps/console -n openshift-console: Operation cannot be fulfilled on deployments.apps "console": the object has been modified; please apply your changes to the latest version and try again
23:09:11	openshift-console	kubelet	console-7c6f7b5ddb-jjlhc	Created	Created container: console
23:09:11	openshift-console	kubelet	console-7c6f7b5ddb-jjlhc	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c48957842946a7846a4b0aade93e6ab20f483c51200957ae5daec4f7624a8828" already present on machine
23:09:11	openshift-console	multus	console-7c6f7b5ddb-jjlhc	AddedInterface	Add eth0 [10.133.0.15/23] from ovn-kubernetes
23:09:11	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "All is well" to "DeploymentSyncDegraded: Operation cannot be fulfilled on deployments.apps \"console\": the object has been modified; please apply your changes to the latest version and try again",Progressing changed from True to False ("All is well")
23:09:12	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Degraded message changed from "DeploymentSyncDegraded: Operation cannot be fulfilled on deployments.apps \"console\": the object has been modified; please apply your changes to the latest version and try again" to "All is well",Progressing changed from False to True ("SyncLoopRefreshProgressing: working toward version 4.21.34, 1 replicas available")
23:09:18	openshift-monitoring	cluster-monitoring-operator	cluster-monitoring-operator	ConfigMapCreated	Created ConfigMap/monitoring-shared-config -n openshift-config-managed because it was missing
23:09:22	openshift-console	multus	console-8649477db9-p4q7n	AddedInterface	Add eth0 [10.133.0.16/23] from ovn-kubernetes
23:09:22	openshift-console	kubelet	console-8649477db9-p4q7n	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c48957842946a7846a4b0aade93e6ab20f483c51200957ae5daec4f7624a8828" already present on machine
23:09:22	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled down replica set console-695bd4fb54 from 1 to 0
23:09:22	openshift-console	kubelet	console-695bd4fb54-cktj7	Killing	Stopping container console
23:09:22	openshift-console	replicaset-controller	console-695bd4fb54	SuccessfulDelete	Deleted pod: console-695bd4fb54-cktj7
23:09:22	openshift-console	replicaset-controller	console-8649477db9	SuccessfulCreate	Created pod: console-8649477db9-p4q7n
23:09:22	openshift-console	kubelet	console-8649477db9-p4q7n	Started	Started container console
23:09:22	openshift-console	kubelet	console-8649477db9-p4q7n	Created	Created container: console
23:09:22	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled up replica set console-8649477db9 from 0 to 1
23:09:33	openshift-console	kubelet	console-7c6f7b5ddb-jjlhc	Killing	Stopping container console
23:09:33	openshift-console	replicaset-controller	console-7c6f7b5ddb	SuccessfulDelete	Deleted pod: console-7c6f7b5ddb-jjlhc
23:09:33	openshift-console	deployment-controller	console	ScalingReplicaSet	Scaled down replica set console-7c6f7b5ddb from 1 to 0
23:09:33 (x2)	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Progressing message changed from "SyncLoopRefreshProgressing: working toward version 4.21.34, 1 replicas available" to "SyncLoopRefreshProgressing: working toward version 4.21.34, 2 replicas available"
23:10:10	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for cert-manager-operator namespace
23:10:36	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-lws-operator namespace
23:10:37	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for cert-manager namespace
23:10:46	kube-system	cert-manager-cainjector-559cdd8c87-brhr5_d9f0ecfc-ca82-4e24-b4a7-37d6be615e99	cert-manager-cainjector-leader-election	LeaderElection	cert-manager-cainjector-559cdd8c87-brhr5_d9f0ecfc-ca82-4e24-b4a7-37d6be615e99 became leader
23:10:48	openshift-lws-operator	operator-lifecycle-manager	leader-worker-set.v1.0.0	RequirementsUnknown	requirements not yet checked
23:10:48 (x2)	openshift-lws-operator	operator-lifecycle-manager	leader-worker-set.v1.0.0	RequirementsNotMet	one or more requirements couldn't be found
23:10:50	openshift-lws-operator	replicaset-controller	openshift-lws-operator-fd8ccff4c	SuccessfulCreate	Created pod: openshift-lws-operator-fd8ccff4c-8w9cg
23:10:50 (x2)	openshift-lws-operator	operator-lifecycle-manager	leader-worker-set.v1.0.0	InstallSucceeded	waiting for install components to report healthy
23:10:50	openshift-lws-operator	deployment-controller	openshift-lws-operator	ScalingReplicaSet	Scaled up replica set openshift-lws-operator-fd8ccff4c from 0 to 1
23:10:50	openshift-lws-operator	operator-lifecycle-manager	leader-worker-set.v1.0.0	AllRequirementsMet	all requirements found, attempting install
23:10:51 (x2)	openshift-lws-operator	operator-lifecycle-manager	leader-worker-set.v1.0.0	InstallWaiting	installing: waiting for deployment openshift-lws-operator to become ready: deployment "openshift-lws-operator" not available: Deployment does not have minimum availability.
23:10:51	openshift-lws-operator	multus	openshift-lws-operator-fd8ccff4c-8w9cg	AddedInterface	Add eth0 [10.134.0.17/23] from ovn-kubernetes
23:10:51	openshift-lws-operator	kubelet	openshift-lws-operator-fd8ccff4c-8w9cg	Pulling	Pulling image "registry.redhat.io/leader-worker-set/lws-rhel9-operator@sha256:c202bfa15626262ff22682b64ac57539d28dd35f5960c490f5afea75cef34309"
23:10:53	openshift-lws-operator	kubelet	openshift-lws-operator-fd8ccff4c-8w9cg	Pulled	Successfully pulled image "registry.redhat.io/leader-worker-set/lws-rhel9-operator@sha256:c202bfa15626262ff22682b64ac57539d28dd35f5960c490f5afea75cef34309" in 2.391s (2.391s including waiting). Image size: 215770828 bytes.
23:10:53	openshift-lws-operator	kubelet	openshift-lws-operator-fd8ccff4c-8w9cg	Created	Created container: openshift-lws-operator
23:10:53	openshift-lws-operator	kubelet	openshift-lws-operator-fd8ccff4c-8w9cg	Started	Started container openshift-lws-operator
23:10:54	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator-lock	LeaderElection	openshift-lws-operator-fd8ccff4c-8w9cg_a6addecd-7418-4a87-878b-4b9efd11b906 became leader
23:10:54	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/lws-manager-role because it was missing
23:10:54	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for opendatahub namespace
23:10:54	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	ControlPlaneTopology	unable to get control plane topology, using HA cluster values for leader election: infrastructures.config.openshift.io "cluster" is forbidden: User "system:serviceaccount:openshift-lws-operator:openshift-lws-operator" cannot get resource "infrastructures" in API group "config.openshift.io" at the cluster scope
23:10:54	openshift-lws-operator	operator-lifecycle-manager	leader-worker-set.v1.0.0	InstallSucceeded	install strategy completed with no errors
23:10:54	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/lws-metrics-reader because it was missing
23:10:55	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/lws-leader-election-role -n openshift-lws-operator because it was missing
23:10:55	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	ClusterRoleCreated	Created ClusterRole.rbac.authorization.k8s.io/lws-proxy-role because it was missing
23:10:55	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/lws-manager-rolebinding because it was missing
23:10:55	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/lws-proxy-rolebinding because it was missing
23:10:55	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	ClusterRoleBindingCreated	Created ClusterRoleBinding.rbac.authorization.k8s.io/lws-metrics-reader-rolebinding because it was missing
23:10:56	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	RoleCreated	Created Role.rbac.authorization.k8s.io/lws-prometheus-k8s -n openshift-lws-operator because it was missing
23:10:56	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/lws-leader-election-rolebinding -n openshift-lws-operator because it was missing
23:10:56	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	RoleBindingCreated	Created RoleBinding.rbac.authorization.k8s.io/lws-prometheus-k8s -n openshift-lws-operator because it was missing
23:10:56	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	ServiceCreated	Created Service/lws-webhook-service -n openshift-lws-operator because it was missing
23:10:56	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	IssuerCreated	Created Issuer.cert-manager.io/lws-selfsigned-issuer -n openshift-lws-operator because it was missing
23:10:56	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	CertificateCreated	Created Certificate.cert-manager.io/lws-serving-cert -n openshift-lws-operator because it was missing
23:11:02	openshift-lws-operator	cert-manager-certificaterequests-issuer-selfsigned	lws-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
23:11:02	openshift-lws-operator	cert-manager-certificaterequests-issuer-vault	lws-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
23:11:02	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	CertificateCreated	Created Certificate.cert-manager.io/lws-metrics-cert -n openshift-lws-operator because it was missing
23:11:02	openshift-lws-operator	cert-manager-certificates-request-manager	lws-metrics-cert	Requested	Created new CertificateRequest resource "lws-metrics-cert-1"
23:11:02	kube-system	cert-manager-leader-election	cert-manager-controller	LeaderElection	cert-manager-55b4d954d5-xrndf-external-cert-manager-controller became leader
23:11:02	openshift-lws-operator	cert-manager-certificates-issuing	lws-serving-cert	Issuing	The certificate has been successfully issued
23:11:02	openshift-lws-operator	cert-manager-certificates-request-manager	lws-serving-cert	Requested	Created new CertificateRequest resource "lws-serving-cert-1"
23:11:02	openshift-lws-operator	cert-manager-certificates-key-manager	lws-serving-cert	Generated	Stored new private key in temporary Secret resource "lws-serving-cert-xcxcs"
23:11:02	openshift-lws-operator	cert-manager-certificates-trigger	lws-serving-cert	Issuing	Issuing certificate as Secret does not exist
23:11:02	openshift-lws-operator	cert-manager-certificaterequests-issuer-selfsigned	lws-serving-cert-1	CertificateIssued	Certificate fetched from issuer successfully
23:11:02	openshift-lws-operator	cert-manager-certificaterequests-issuer-selfsigned	lws-serving-cert-1	BadConfig	Certificate will be issued with an empty Issuer DN, which contravenes RFC 5280 and could break some strict clients
23:11:02	openshift-lws-operator	cert-manager-certificaterequests-approver	lws-serving-cert-1	cert-manager.io	Certificate request has been approved by cert-manager.io
23:11:02	openshift-lws-operator	cert-manager-certificaterequests-issuer-venafi	lws-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
23:11:02	openshift-lws-operator	cert-manager-certificates-key-manager	lws-metrics-cert	Generated	Stored new private key in temporary Secret resource "lws-metrics-cert-m7lxx"
23:11:02	openshift-lws-operator	cert-manager-certificaterequests-issuer-selfsigned	lws-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
23:11:02	openshift-lws-operator	cert-manager-certificaterequests-issuer-ca	lws-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
23:11:02	openshift-lws-operator	cert-manager-certificaterequests-issuer-vault	lws-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
23:11:02	openshift-lws-operator	cert-manager-certificaterequests-issuer-acme	lws-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
23:11:02	openshift-lws-operator	cert-manager-certificaterequests-issuer-ca	lws-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
23:11:02	openshift-lws-operator	cert-manager-certificaterequests-issuer-venafi	lws-metrics-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
23:11:02	openshift-lws-operator	cert-manager-certificaterequests-issuer-acme	lws-serving-cert-1	WaitingForApproval	Not signing CertificateRequest until it is Approved
23:11:02	openshift-lws-operator	cert-manager-certificates-trigger	lws-metrics-cert	Issuing	Issuing certificate as Secret does not exist
23:11:03	openshift-lws-operator	cert-manager-certificaterequests-issuer-selfsigned	lws-metrics-cert-1	CertificateIssued	Certificate fetched from issuer successfully
23:11:03	openshift-lws-operator	cert-manager-certificaterequests-approver	lws-metrics-cert-1	cert-manager.io	Certificate request has been approved by cert-manager.io
23:11:03	openshift-lws-operator	cert-manager-certificates-issuing	lws-metrics-cert	Issuing	The certificate has been successfully issued
23:11:04	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	ConfigMapCreated	Created ConfigMap/lws-manager-config -n openshift-lws-operator because it was missing
23:11:05	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	ServiceCreated	Created Service/lws-controller-manager-metrics-service -n openshift-lws-operator because it was missing
23:11:05	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	ServiceAccountCreated	Created ServiceAccount/lws-controller-manager -n openshift-lws-operator because it was missing
23:11:05	openshift-lws-operator	deployment-controller	lws-controller-manager	ScalingReplicaSet	Scaled up replica set lws-controller-manager-858688bfcc from 0 to 2
23:11:05	openshift-lws-operator	replicaset-controller	lws-controller-manager-858688bfcc	SuccessfulCreate	Created pod: lws-controller-manager-858688bfcc-fznkh
23:11:05	openshift-lws-operator	replicaset-controller	lws-controller-manager-858688bfcc	SuccessfulCreate	Created pod: lws-controller-manager-858688bfcc-xs7c6
23:11:05	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	ServiceMonitorCreated	Created ServiceMonitor.monitoring.coreos.com/lws-controller-manager-metrics-monitor -n openshift-lws-operator because it was missing
23:11:05	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	ValidatingWebhookConfigurationCreated	Created ValidatingWebhookConfiguration.admissionregistration.k8s.io/lws-validating-webhook-configuration because it was missing
23:11:05	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	MutatingWebhookConfigurationCreated	Created MutatingWebhookConfiguration.admissionregistration.k8s.io/lws-mutating-webhook-configuration because it was missing
23:11:05	openshift-lws-operator	kubelet	lws-controller-manager-858688bfcc-xs7c6	Pulling	Pulling image "registry.redhat.io/leader-worker-set/lws-rhel9@sha256:affb303b1173c273231bb50fef07310b0e220d2f08bfc0aa5912d0825e3e0d4f"
23:11:05	openshift-lws-operator	multus	lws-controller-manager-858688bfcc-fznkh	AddedInterface	Add eth0 [10.133.0.23/23] from ovn-kubernetes
23:11:05	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	DeploymentCreated	Created Deployment.apps/lws-controller-manager -n openshift-lws-operator because it was missing
23:11:05	openshift-lws-operator	kubelet	lws-controller-manager-858688bfcc-fznkh	Pulling	Pulling image "registry.redhat.io/leader-worker-set/lws-rhel9@sha256:affb303b1173c273231bb50fef07310b0e220d2f08bfc0aa5912d0825e3e0d4f"
23:11:05	openshift-lws-operator	multus	lws-controller-manager-858688bfcc-xs7c6	AddedInterface	Add eth0 [10.134.0.19/23] from ovn-kubernetes
23:11:05	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	CustomResourceDefinitionCreated	Created CustomResourceDefinition.apiextensions.k8s.io/leaderworkersets.leaderworkerset.x-k8s.io because it was missing
23:11:06 (x2)	opendatahub	operator-lifecycle-manager	opendatahub-operator.v3.5.0-ea.2	RequirementsNotMet	one or more requirements couldn't be found
23:11:06	opendatahub	operator-lifecycle-manager	opendatahub-operator.v3.5.0-ea.2	RequirementsUnknown	requirements not yet checked
23:11:07	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	MutatingWebhookConfigurationUpdated	Updated MutatingWebhookConfiguration.admissionregistration.k8s.io/lws-mutating-webhook-configuration because it changed
23:11:07	openshift-lws-operator	kubelet	lws-controller-manager-858688bfcc-fznkh	Pulled	Successfully pulled image "registry.redhat.io/leader-worker-set/lws-rhel9@sha256:affb303b1173c273231bb50fef07310b0e220d2f08bfc0aa5912d0825e3e0d4f" in 1.538s (1.538s including waiting). Image size: 181422385 bytes.
23:11:07	openshift-lws-operator	kubelet	lws-controller-manager-858688bfcc-xs7c6	Started	Started container manager
23:11:07	openshift-lws-operator	kubelet	lws-controller-manager-858688bfcc-xs7c6	Created	Created container: manager
23:11:07	openshift-lws-operator	kubelet	lws-controller-manager-858688bfcc-xs7c6	Pulled	Successfully pulled image "registry.redhat.io/leader-worker-set/lws-rhel9@sha256:affb303b1173c273231bb50fef07310b0e220d2f08bfc0aa5912d0825e3e0d4f" in 1.548s (1.548s including waiting). Image size: 181422385 bytes.
23:11:07	openshift-lws-operator	lws-controller-manager-858688bfcc-fznkh_38e08aca-7809-4a0e-8cac-8c6dd0280cba	b8b2488c.x-k8s.io	LeaderElection	lws-controller-manager-858688bfcc-fznkh_38e08aca-7809-4a0e-8cac-8c6dd0280cba became leader
23:11:07	openshift-lws-operator	kubelet	lws-controller-manager-858688bfcc-fznkh	Created	Created container: manager
23:11:07	openshift-lws-operator	openshift-lws-operator	openshift-lws-operator	ValidatingWebhookConfigurationUpdated	Updated ValidatingWebhookConfiguration.admissionregistration.k8s.io/lws-validating-webhook-configuration because it changed
23:11:07	openshift-lws-operator	kubelet	lws-controller-manager-858688bfcc-fznkh	Started	Started container manager
23:11:09	opendatahub	multus	opendatahub-operator-controller-manager-697bb5576d-qg2sc	AddedInterface	Add eth0 [10.133.0.25/23] from ovn-kubernetes
23:11:09	opendatahub	deployment-controller	opendatahub-operator-controller-manager	ScalingReplicaSet	Scaled up replica set opendatahub-operator-controller-manager-697bb5576d from 0 to 3
23:11:09	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qg2sc	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.5.0-ea.2"
23:11:09	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qqc9p	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.5.0-ea.2"
23:11:09	opendatahub	replicaset-controller	opendatahub-operator-controller-manager-697bb5576d	SuccessfulCreate	Created pod: opendatahub-operator-controller-manager-697bb5576d-qqc9p
23:11:09	opendatahub	replicaset-controller	opendatahub-operator-controller-manager-697bb5576d	SuccessfulCreate	Created pod: opendatahub-operator-controller-manager-697bb5576d-qg2sc
23:11:09	opendatahub	multus	opendatahub-operator-controller-manager-697bb5576d-qqc9p	AddedInterface	Add eth0 [10.132.0.26/23] from ovn-kubernetes
23:11:09	opendatahub	operator-lifecycle-manager	opendatahub-operator.v3.5.0-ea.2	InstallSucceeded	waiting for install components to report healthy
23:11:09	opendatahub	operator-lifecycle-manager	opendatahub-operator.v3.5.0-ea.2	AllRequirementsMet	all requirements found, attempting install
23:11:09	opendatahub	multus	opendatahub-operator-controller-manager-697bb5576d-484bm	AddedInterface	Add eth0 [10.134.0.20/23] from ovn-kubernetes
23:11:09	opendatahub	replicaset-controller	opendatahub-operator-controller-manager-697bb5576d	SuccessfulCreate	Created pod: opendatahub-operator-controller-manager-697bb5576d-484bm
23:11:09	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-484bm	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.5.0-ea.2"
23:11:10	opendatahub	operator-lifecycle-manager	opendatahub-operator.v3.5.0-ea.2	InstallWaiting	installing: waiting for deployment opendatahub-operator-controller-manager to become ready: deployment "opendatahub-operator-controller-manager" not available: Deployment does not have minimum availability.
23:11:12	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-484bm	Created	Created container: copy-manifests
23:11:12	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qg2sc	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.5.0-ea.2" in 2.756s (2.756s including waiting). Image size: 293036549 bytes.
23:11:12	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qqc9p	Created	Created container: copy-manifests
23:11:12	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qg2sc	Created	Created container: copy-manifests
23:11:12	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-484bm	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.5.0-ea.2" in 2.784s (2.784s including waiting). Image size: 293036549 bytes.
23:11:12	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qg2sc	Started	Started container copy-manifests
23:11:12	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qqc9p	Started	Started container copy-manifests
23:11:12	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qqc9p	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.5.0-ea.2" in 2.701s (2.701s including waiting). Image size: 293036549 bytes.
23:11:12	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-484bm	Started	Started container copy-manifests
23:11:13	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qqc9p	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.5.0-ea.2"
23:11:14	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qqc9p	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.5.0-ea.2" in 336ms (336ms including waiting). Image size: 293036549 bytes.
23:11:14	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-484bm	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.5.0-ea.2"
23:11:14	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qqc9p	Started	Started container manager
23:11:14	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qqc9p	Created	Created container: manager
23:11:14	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qg2sc	Pulling	Pulling image "quay.io/opendatahub/opendatahub-operator:v3.5.0-ea.2"
23:11:14	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-484bm	Created	Created container: manager
23:11:14	opendatahub	opendatahub-operator-controller-manager-697bb5576d-qqc9p_9e27e798-213c-4e67-9f20-4000dce24065	07ed84f7.opendatahub.io	LeaderElection	opendatahub-operator-controller-manager-697bb5576d-qqc9p_9e27e798-213c-4e67-9f20-4000dce24065 became leader
23:11:14	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-484bm	Started	Started container manager
23:11:14	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-484bm	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.5.0-ea.2" in 299ms (299ms including waiting). Image size: 293036549 bytes.
23:11:15	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qg2sc	Pulled	Successfully pulled image "quay.io/opendatahub/opendatahub-operator:v3.5.0-ea.2" in 358ms (358ms including waiting). Image size: 293036549 bytes.
23:11:15	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qg2sc	Created	Created container: manager
23:11:15	opendatahub	kubelet	opendatahub-operator-controller-manager-697bb5576d-qg2sc	Started	Started container manager
23:11:26	opendatahub	operator-lifecycle-manager	opendatahub-operator.v3.5.0-ea.2	InstallSucceeded	install strategy completed with no errors
23:11:28	openshift-ingress	replicaset-controller	kube-auth-proxy-65f4688f79	SuccessfulCreate	Created pod: kube-auth-proxy-65f4688f79-k7p9x
23:11:28 (x4)	openshift-ingress	replicaset-controller	kube-auth-proxy-65f4688f79	FailedCreate	Error creating: pods "kube-auth-proxy-65f4688f79-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found
23:11:28	openshift-ingress	deployment-controller	kube-auth-proxy	ScalingReplicaSet	Scaled up replica set kube-auth-proxy-65f4688f79 from 0 to 2
23:11:28	openshift-ingress	replicaset-controller	kube-auth-proxy-65f4688f79	SuccessfulCreate	Created pod: kube-auth-proxy-65f4688f79-d4v4q
23:11:28	openshift-ingress	replicaset-controller	kube-auth-proxy-65f4688f79	SuccessfulCreate	Created pod: kube-auth-proxy-65f4688f79-d4v4q
23:11:28	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for opendatahub-monitoring namespace
23:11:28 (x4)	openshift-ingress	replicaset-controller	kube-auth-proxy-65f4688f79	FailedCreate	Error creating: pods "kube-auth-proxy-65f4688f79-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found
23:11:28	openshift-ingress	deployment-controller	kube-auth-proxy	ScalingReplicaSet	Scaled up replica set kube-auth-proxy-65f4688f79 from 0 to 2
23:11:28	openshift-ingress	replicaset-controller	kube-auth-proxy-65f4688f79	SuccessfulCreate	Created pod: kube-auth-proxy-65f4688f79-k7p9x
23:11:29	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-k7p9x	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
23:11:29	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1
23:11:29	openshift-ingress	multus	kube-auth-proxy-65f4688f79-k7p9x	AddedInterface	Add eth0 [10.134.0.21/23] from ovn-kubernetes
23:11:29	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-d4v4q	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
23:11:29	openshift-ingress	multus	kube-auth-proxy-65f4688f79-d4v4q	AddedInterface	Add eth0 [10.132.0.27/23] from ovn-kubernetes
23:11:29	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-k7p9x	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
23:11:29	openshift-ingress	multus	kube-auth-proxy-65f4688f79-k7p9x	AddedInterface	Add eth0 [10.134.0.21/23] from ovn-kubernetes
23:11:29	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1
23:11:29	openshift-ingress	multus	kube-auth-proxy-65f4688f79-d4v4q	AddedInterface	Add eth0 [10.132.0.27/23] from ovn-kubernetes
23:11:29	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-d4v4q	Pulling	Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
23:11:30	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7b7995d5cd	SuccessfulCreate	Created pod: istiod-openshift-gateway-7b7995d5cd-vtckc
23:11:30	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7b7995d5cd	SuccessfulCreate	Created pod: istiod-openshift-gateway-7b7995d5cd-vtckc
23:11:31	openshift-ingress	multus	istiod-openshift-gateway-7b7995d5cd-vtckc	AddedInterface	Add eth0 [10.132.0.28/23] from ovn-kubernetes
23:11:31	openshift-ingress	kubelet	istiod-openshift-gateway-7b7995d5cd-vtckc	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"
23:11:31	openshift-ingress	kubelet	istiod-openshift-gateway-7b7995d5cd-vtckc	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"
23:11:31	openshift-ingress	multus	istiod-openshift-gateway-7b7995d5cd-vtckc	AddedInterface	Add eth0 [10.132.0.28/23] from ovn-kubernetes
23:11:31	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-d4v4q	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.448s (2.448s including waiting). Image size: 265120132 bytes.
23:11:31	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-d4v4q	Created	Created container: kube-auth-proxy
23:11:31	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-d4v4q	Started	Started container kube-auth-proxy
23:11:31	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-d4v4q	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.448s (2.448s including waiting). Image size: 265120132 bytes.
23:11:31	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-d4v4q	Created	Created container: kube-auth-proxy
23:11:31	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-d4v4q	Started	Started container kube-auth-proxy
23:11:32	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-k7p9x	Created	Created container: kube-auth-proxy
23:11:32	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-k7p9x	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.072s (3.072s including waiting). Image size: 265120132 bytes.
23:11:32	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-k7p9x	Started	Started container kube-auth-proxy
23:11:32	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-k7p9x	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.072s (3.072s including waiting). Image size: 265120132 bytes.
23:11:32	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-k7p9x	Created	Created container: kube-auth-proxy
23:11:32	openshift-ingress	kubelet	kube-auth-proxy-65f4688f79-k7p9x	Started	Started container kube-auth-proxy
23:11:33	openshift-ingress	kubelet	istiod-openshift-gateway-7b7995d5cd-vtckc	Created	Created container: discovery
23:11:33	openshift-ingress	kubelet	istiod-openshift-gateway-7b7995d5cd-vtckc	Created	Created container: discovery
23:11:33	openshift-ingress	kubelet	istiod-openshift-gateway-7b7995d5cd-vtckc	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.097s (2.097s including waiting). Image size: 181126104 bytes.
23:11:33	openshift-ingress	kubelet	istiod-openshift-gateway-7b7995d5cd-vtckc	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.097s (2.097s including waiting). Image size: 181126104 bytes.
23:11:34	openshift-ingress	kubelet	istiod-openshift-gateway-7b7995d5cd-vtckc	Started	Started container discovery
23:11:34	openshift-ingress	kubelet	istiod-openshift-gateway-7b7995d5cd-vtckc	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
23:11:34	openshift-ingress	kubelet	istiod-openshift-gateway-7b7995d5cd-vtckc	Started	Started container discovery
23:11:34	openshift-ingress	kubelet	istiod-openshift-gateway-7b7995d5cd-vtckc	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
23:11:34	openshift-ingress	kubelet	istiod-openshift-gateway-7b7995d5cd-vtckc	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:11:34	openshift-ingress	kubelet	istiod-openshift-gateway-7b7995d5cd-vtckc	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:11:35	openshift-ingress	replicaset-controller	data-science-gateway-data-science-gateway-class-68cf4d799c	SuccessfulCreate	Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cfh66k
23:11:35	openshift-ingress	deployment-controller	data-science-gateway-data-science-gateway-class	ScalingReplicaSet	Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1
23:11:35	openshift-ingress	deployment-controller	data-science-gateway-data-science-gateway-class	ScalingReplicaSet	Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1
23:11:35	openshift-ingress	replicaset-controller	data-science-gateway-data-science-gateway-class-68cf4d799c	SuccessfulCreate	Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cfh66k
23:11:36	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-68cf4d799cfh66k	FailedMount	MountVolume.SetUp failed for volume "kube-api-access-qmcch" : failed to sync configmap cache: timed out waiting for the condition
23:11:36	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-68cf4d799cfh66k	FailedMount	MountVolume.SetUp failed for volume "kube-api-access-qmcch" : failed to sync configmap cache: timed out waiting for the condition
23:11:37	openshift-ingress	multus	data-science-gateway-data-science-gateway-class-68cf4d799cfh66k	AddedInterface	Add eth0 [10.133.0.26/23] from ovn-kubernetes
23:11:37	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-68cf4d799cfh66k	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"
23:11:37	openshift-ingress	multus	data-science-gateway-data-science-gateway-class-68cf4d799cfh66k	AddedInterface	Add eth0 [10.133.0.26/23] from ovn-kubernetes
23:11:37	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-68cf4d799cfh66k	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"
23:11:39	opendatahub	replicaset-controller	model-serving-api-54d89bd5fc	SuccessfulCreate	Created pod: model-serving-api-54d89bd5fc-b8k4c
23:11:39	opendatahub	deployment-controller	odh-model-controller	ScalingReplicaSet	Scaled up replica set odh-model-controller-7998c67dc4 from 0 to 1
23:11:39	opendatahub	replicaset-controller	odh-model-controller-7998c67dc4	SuccessfulCreate	Created pod: odh-model-controller-7998c67dc4-ck4x6
23:11:39	opendatahub	kubelet	odh-model-controller-7998c67dc4-ck4x6	FailedMount	MountVolume.SetUp failed for volume "cert" : secret "odh-model-controller-webhook-cert" not found
23:11:39	opendatahub	deployment-controller	model-serving-api	ScalingReplicaSet	Scaled up replica set model-serving-api-54d89bd5fc from 0 to 1
23:11:39	opendatahub	kubelet	model-serving-api-54d89bd5fc-b8k4c	FailedMount	MountVolume.SetUp failed for volume "tls-certs" : secret "model-serving-api-tls" not found
23:11:39 (x2)	opendatahub	replicaset-controller	model-serving-api-54d89bd5fc	FailedCreate	Error creating: pods "model-serving-api-54d89bd5fc-" is forbidden: error looking up service account opendatahub/model-serving-api: serviceaccount "model-serving-api" not found
23:11:40	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-68cf4d799cfh66k	Created	Created container: istio-proxy
23:11:40	opendatahub	kubelet	odh-model-controller-7998c67dc4-ck4x6	Pulling	Pulling image "quay.io/opendatahub/odh-model-controller:odh-v3.5-EA2"
23:11:40	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-68cf4d799cfh66k	Created	Created container: istio-proxy
23:11:40	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-68cf4d799cfh66k	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.58s (2.58s including waiting). Image size: 181318953 bytes.
23:11:40	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-68cf4d799cfh66k	Started	Started container istio-proxy
23:11:40	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-68cf4d799cfh66k	Started	Started container istio-proxy
23:11:40	openshift-ingress	kubelet	data-science-gateway-data-science-gateway-class-68cf4d799cfh66k	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.58s (2.58s including waiting). Image size: 181318953 bytes.
23:11:40	opendatahub	multus	odh-model-controller-7998c67dc4-ck4x6	AddedInterface	Add eth0 [10.133.0.27/23] from ovn-kubernetes
23:11:40	opendatahub	kubelet	model-serving-api-54d89bd5fc-b8k4c	Pulling	Pulling image "quay.io/opendatahub/odh-model-serving-api:odh-v3.5-EA2"
23:11:40	opendatahub	multus	model-serving-api-54d89bd5fc-b8k4c	AddedInterface	Add eth0 [10.133.0.28/23] from ovn-kubernetes
23:11:43	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
23:11:43	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
23:11:43	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
23:11:43	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
23:11:44	opendatahub	kubelet	odh-model-controller-7998c67dc4-ck4x6	Started	Started container manager
23:11:44	opendatahub	kubelet	model-serving-api-54d89bd5fc-b8k4c	Created	Created container: server
23:11:44	opendatahub	kubelet	odh-model-controller-7998c67dc4-ck4x6	Pulled	Successfully pulled image "quay.io/opendatahub/odh-model-controller:odh-v3.5-EA2" in 3.683s (3.683s including waiting). Image size: 238576181 bytes.
23:11:44	opendatahub	kubelet	odh-model-controller-7998c67dc4-ck4x6	Created	Created container: manager
23:11:44	opendatahub	kubelet	model-serving-api-54d89bd5fc-b8k4c	Started	Started container server
23:11:44	opendatahub	kubelet	model-serving-api-54d89bd5fc-b8k4c	Pulled	Successfully pulled image "quay.io/opendatahub/odh-model-serving-api:odh-v3.5-EA2" in 3.17s (3.17s including waiting). Image size: 187479094 bytes.
23:11:44	opendatahub	odh-model-controller-7998c67dc4-ck4x6_9265dd16-b826-48b4-a510-a369b784bb1c	odh-model-controller.opendatahub.io	LeaderElection	odh-model-controller-7998c67dc4-ck4x6_9265dd16-b826-48b4-a510-a369b784bb1c became leader
23:11:46	openshift-ingress	kubelet	istiod-openshift-gateway-5677ccb49b-lvldr	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"
23:11:46	openshift-ingress	multus	istiod-openshift-gateway-5677ccb49b-lvldr	AddedInterface	Add eth0 [10.133.0.29/23] from ovn-kubernetes
23:11:46	openshift-ingress	replicaset-controller	istiod-openshift-gateway-5677ccb49b	SuccessfulCreate	Created pod: istiod-openshift-gateway-5677ccb49b-lvldr
23:11:46	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1
23:11:46	openshift-ingress	kubelet	istiod-openshift-gateway-5677ccb49b-lvldr	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"
23:11:46	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1
23:11:46	openshift-ingress	multus	istiod-openshift-gateway-5677ccb49b-lvldr	AddedInterface	Add eth0 [10.133.0.29/23] from ovn-kubernetes
23:11:46	openshift-ingress	replicaset-controller	istiod-openshift-gateway-5677ccb49b	SuccessfulCreate	Created pod: istiod-openshift-gateway-5677ccb49b-lvldr
23:11:48	opendatahub	replicaset-controller	llmisvc-controller-manager-777c6bd7d5	SuccessfulCreate	Created pod: llmisvc-controller-manager-777c6bd7d5-t7ncm
23:11:48	opendatahub	deployment-controller	llmisvc-controller-manager	ScalingReplicaSet	Scaled up replica set llmisvc-controller-manager-777c6bd7d5 from 0 to 1
23:11:48	opendatahub	deployment-controller	kserve-controller-manager	ScalingReplicaSet	Scaled up replica set kserve-controller-manager-d6f4b65b8 from 0 to 1
23:11:48	opendatahub	replicaset-controller	kserve-controller-manager-d6f4b65b8	SuccessfulCreate	Created pod: kserve-controller-manager-d6f4b65b8-z7jjw
23:11:49	opendatahub	multus	kserve-controller-manager-d6f4b65b8-z7jjw	AddedInterface	Add eth0 [10.132.0.29/23] from ovn-kubernetes
23:11:49	openshift-ingress	kubelet	istiod-openshift-gateway-5677ccb49b-lvldr	Created	Created container: discovery
23:11:49	openshift-ingress	kubelet	istiod-openshift-gateway-5677ccb49b-lvldr	Created	Created container: discovery
23:11:49	openshift-ingress	kubelet	istiod-openshift-gateway-5677ccb49b-lvldr	Started	Started container discovery
23:11:49	opendatahub	kubelet	kserve-controller-manager-d6f4b65b8-z7jjw	Pulling	Pulling image "quay.io/opendatahub/kserve-controller:odh-v3.5-EA2"
23:11:49	opendatahub	kubelet	llmisvc-controller-manager-777c6bd7d5-t7ncm	Pulling	Pulling image "quay.io/opendatahub/odh-kserve-llmisvc-controller:odh-v3.5-EA2"
23:11:49	opendatahub	multus	llmisvc-controller-manager-777c6bd7d5-t7ncm	AddedInterface	Add eth0 [10.132.0.30/23] from ovn-kubernetes
23:11:49	openshift-ingress	kubelet	istiod-openshift-gateway-5677ccb49b-lvldr	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.308s (2.308s including waiting). Image size: 181126104 bytes.
23:11:49	openshift-ingress	kubelet	istiod-openshift-gateway-5677ccb49b-lvldr	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.308s (2.308s including waiting). Image size: 181126104 bytes.
23:11:49	openshift-ingress	kubelet	istiod-openshift-gateway-5677ccb49b-lvldr	Started	Started container discovery
23:11:50	openshift-ingress	kubelet	istiod-openshift-gateway-7b7995d5cd-vtckc	Killing	Stopping container discovery
23:11:50	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7b7995d5cd	SuccessfulDelete	Deleted pod: istiod-openshift-gateway-7b7995d5cd-vtckc
23:11:50	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
23:11:50	openshift-ingress	replicaset-controller	istiod-openshift-gateway-7b7995d5cd	SuccessfulDelete	Deleted pod: istiod-openshift-gateway-7b7995d5cd-vtckc
23:11:50	openshift-ingress	deployment-controller	istiod-openshift-gateway	ScalingReplicaSet	Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
23:11:50	openshift-ingress	kubelet	istiod-openshift-gateway-7b7995d5cd-vtckc	Killing	Stopping container discovery
23:11:52	opendatahub	kubelet	kserve-controller-manager-d6f4b65b8-z7jjw	Pulled	Successfully pulled image "quay.io/opendatahub/kserve-controller:odh-v3.5-EA2" in 2.698s (2.698s including waiting). Image size: 241618392 bytes.
23:11:52	opendatahub	kubelet	kserve-controller-manager-d6f4b65b8-z7jjw	Started	Started container manager
23:11:52	opendatahub	kubelet	llmisvc-controller-manager-777c6bd7d5-t7ncm	Started	Started container manager
23:11:52	opendatahub	kserve-controller-manager-d6f4b65b8-z7jjw_fc9a0fe1-e8ce-49c5-a767-108645839abc	kserve-controller-manager-leader-lock	LeaderElection	kserve-controller-manager-d6f4b65b8-z7jjw_fc9a0fe1-e8ce-49c5-a767-108645839abc became leader
23:11:52	opendatahub	kubelet	llmisvc-controller-manager-777c6bd7d5-t7ncm	Created	Created container: manager
23:11:52	opendatahub	kubelet	llmisvc-controller-manager-777c6bd7d5-t7ncm	Pulled	Successfully pulled image "quay.io/opendatahub/odh-kserve-llmisvc-controller:odh-v3.5-EA2" in 2.686s (2.686s including waiting). Image size: 133973437 bytes.
23:11:52	opendatahub	kubelet	kserve-controller-manager-d6f4b65b8-z7jjw	Created	Created container: manager
23:11:53	opendatahub	llmisvc-controller-manager-777c6bd7d5-t7ncm_2665812d-7701-4309-a1e4-3099457978a5	llminferenceservice-kserve-controller-manager	LeaderElection	llmisvc-controller-manager-777c6bd7d5-t7ncm_2665812d-7701-4309-a1e4-3099457978a5 became leader
23:11:58	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
23:11:58	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
23:11:58	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
23:11:58	openshift-ingress	horizontal-pod-autoscaler	kube-auth-proxy	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
23:12:00 (x2)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
23:12:00 (x2)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
23:12:00 (x2)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
23:12:00 (x2)	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
23:12:15	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
23:12:15	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedComputeMetricsReplicas	invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
23:12:15	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
23:12:15	openshift-ingress	horizontal-pod-autoscaler	istiod-openshift-gateway	FailedGetResourceMetric	failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
23:12:28 (x3)	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Progressing changed from False to True ("SyncLoopRefreshProgressing: working toward version 4.21.34, 1 replicas available")
23:12:28 (x4)	openshift-console-operator	console-operator-console-operator-consoleoperator	console-operator	ConfigMapUpdated	Updated ConfigMap/console-config -n openshift-console: cause by changes in data.console-config.yaml
23:12:28	openshift-console	replicaset-controller	console-5f8d85b594	SuccessfulCreate	Created pod: console-5f8d85b594-78bzs
23:12:28 (x10)	openshift-console-operator	console-operator-console-operator-consoleoperator	console-operator	DeploymentUpdated	Updated Deployment.apps/console -n openshift-console because it changed
23:12:29	openshift-console	multus	console-5f8d85b594-78bzs	AddedInterface	Add eth0 [10.134.0.22/23] from ovn-kubernetes
23:12:29	openshift-console	kubelet	console-5f8d85b594-78bzs	Created	Created container: console
23:12:29	openshift-console	kubelet	console-5f8d85b594-78bzs	Pulled	Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c48957842946a7846a4b0aade93e6ab20f483c51200957ae5daec4f7624a8828" already present on machine
23:12:29	openshift-console	kubelet	console-5f8d85b594-78bzs	Started	Started container console
23:12:39 (x2)	openshift-console	deployment-controller	console	ScalingReplicaSet	(combined from similar events): Scaled down replica set console-8649477db9 from 1 to 0
23:12:39	openshift-console	kubelet	console-8649477db9-p4q7n	Killing	Stopping container console
23:12:39 (x4)	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: Progressing changed from True to False ("All is well")
23:12:39	openshift-console	replicaset-controller	console-8649477db9	SuccessfulDelete	Deleted pod: console-8649477db9-p4q7n
23:12:40	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for kuadrant-system namespace
23:12:53	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	RequirementsUnknown	requirements not yet checked
23:12:53	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	RequirementsNotMet	one or more requirements couldn't be found
23:12:57	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	InstallSucceeded	waiting for install components to report healthy
23:12:57	kuadrant-system	kubelet	dns-operator-controller-manager-7b84cd7c9c-pvmfp	Pulling	Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a"
23:12:57	kuadrant-system	multus	dns-operator-controller-manager-7b84cd7c9c-pvmfp	AddedInterface	Add eth0 [10.132.0.31/23] from ovn-kubernetes
23:12:57	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	InstallWaiting	installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.
23:12:57	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	AllRequirementsMet	all requirements found, attempting install
23:12:57	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	RequirementsUnknown	requirements not yet checked
23:12:57	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	RequirementsNotMet	one or more requirements couldn't be found
23:12:57	kuadrant-system	deployment-controller	dns-operator-controller-manager	ScalingReplicaSet	Scaled up replica set dns-operator-controller-manager-7b84cd7c9c from 0 to 1
23:12:57	kuadrant-system	replicaset-controller	dns-operator-controller-manager-7b84cd7c9c	SuccessfulCreate	Created pod: dns-operator-controller-manager-7b84cd7c9c-pvmfp
23:12:59	kuadrant-system	deployment-controller	limitador-operator-controller-manager	ScalingReplicaSet	Scaled up replica set limitador-operator-controller-manager-74495c69f8 from 0 to 1
23:12:59	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	RequirementsNotMet	one or more requirements couldn't be found
23:12:59	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	RequirementsUnknown	requirements not yet checked
23:12:59	kuadrant-system	replicaset-controller	limitador-operator-controller-manager-74495c69f8	SuccessfulCreate	Created pod: limitador-operator-controller-manager-74495c69f8-8llhd
23:13:00	kuadrant-system	multus	limitador-operator-controller-manager-74495c69f8-8llhd	AddedInterface	Add eth0 [10.132.0.32/23] from ovn-kubernetes
23:13:00	kuadrant-system	kubelet	limitador-operator-controller-manager-74495c69f8-8llhd	Pulling	Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e"
23:13:01	kuadrant-system	kubelet	dns-operator-controller-manager-7b84cd7c9c-pvmfp	Created	Created container: manager
23:13:01	kuadrant-system	kubelet	dns-operator-controller-manager-7b84cd7c9c-pvmfp	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:d82688172d312a44d9978eacf7bd9e0402e9ba2967daf70b2ef30707f41faf4a" in 3.43s (3.43s including waiting). Image size: 190804149 bytes.
23:13:01	kuadrant-system	kubelet	dns-operator-controller-manager-7b84cd7c9c-pvmfp	Started	Started container manager
23:13:01	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	AllRequirementsMet	all requirements found, attempting install
23:13:01	kuadrant-system	dns-operator-controller-manager-7b84cd7c9c-pvmfp_d2c40bed-853a-4beb-ad94-b6fc3347eb01	a3f98d6c.kuadrant.io	LeaderElection	dns-operator-controller-manager-7b84cd7c9c-pvmfp_d2c40bed-853a-4beb-ad94-b6fc3347eb01 became leader
23:13:02	kuadrant-system	kubelet	limitador-operator-controller-manager-74495c69f8-8llhd	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" in 1.921s (1.921s including waiting). Image size: 177967631 bytes.
23:13:02	kuadrant-system	limitador-operator-controller-manager-74495c69f8-8llhd_e6fd7a00-aed7-441f-aed3-0a2149fd6a71	3745a16e.kuadrant.io	LeaderElection	limitador-operator-controller-manager-74495c69f8-8llhd_e6fd7a00-aed7-441f-aed3-0a2149fd6a71 became leader
23:13:02	kuadrant-system	kubelet	limitador-operator-controller-manager-74495c69f8-8llhd	Created	Created container: manager
23:13:02	kuadrant-system	kubelet	limitador-operator-controller-manager-74495c69f8-8llhd	Started	Started container manager
23:13:02	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	InstallWaiting	installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.
23:13:02	kuadrant-system	multus	authorino-operator-76b478bd78-7jns7	AddedInterface	Add eth0 [10.132.0.33/23] from ovn-kubernetes
23:13:02	kuadrant-system	kubelet	authorino-operator-76b478bd78-7jns7	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589"
23:13:02	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	InstallSucceeded	waiting for install components to report healthy
23:13:02 (x2)	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	RequirementsNotMet	one or more requirements couldn't be found
23:13:02	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	RequirementsUnknown	requirements not yet checked
23:13:02	kuadrant-system	replicaset-controller	authorino-operator-76b478bd78	SuccessfulCreate	Created pod: authorino-operator-76b478bd78-7jns7
23:13:02	kuadrant-system	deployment-controller	authorino-operator	ScalingReplicaSet	Scaled up replica set authorino-operator-76b478bd78 from 0 to 1
23:13:03	kuadrant-system	kubelet	authorino-operator-76b478bd78-7jns7	Created	Created container: manager
23:13:03	kuadrant-system	kubelet	authorino-operator-76b478bd78-7jns7	Started	Started container manager
23:13:03	kuadrant-system	kubelet	authorino-operator-76b478bd78-7jns7	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:8a8cc5fb104032c23096f3c9cf2fbc3636d343ee7ee7974e51fe1f10d3a57589" in 1.019s (1.019s including waiting). Image size: 167738465 bytes.
23:13:03	kuadrant-system	authorino-operator-76b478bd78-7jns7_7aa3c3a6-c86a-474e-af0c-34f6a21fccf3	aac3a15d.authorino.kuadrant.io	LeaderElection	authorino-operator-76b478bd78-7jns7_7aa3c3a6-c86a-474e-af0c-34f6a21fccf3 became leader
23:13:06	kuadrant-system	replicaset-controller	kuadrant-operator-controller-manager-76f8f686bf	SuccessfulCreate	Created pod: kuadrant-operator-controller-manager-76f8f686bf-jqrmq
23:13:06	kuadrant-system	deployment-controller	kuadrant-operator-controller-manager	ScalingReplicaSet	Scaled up replica set kuadrant-operator-controller-manager-76f8f686bf from 0 to 1
23:13:07	kuadrant-system	multus	kuadrant-operator-controller-manager-76f8f686bf-jqrmq	AddedInterface	Add eth0 [10.132.0.34/23] from ovn-kubernetes
23:13:07	kuadrant-system	kubelet	kuadrant-operator-controller-manager-76f8f686bf-jqrmq	Pulling	Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"
23:13:10	kuadrant-system	kubelet	kuadrant-operator-controller-manager-76f8f686bf-jqrmq	Started	Started container manager
23:13:10	kuadrant-system	kubelet	kuadrant-operator-controller-manager-76f8f686bf-jqrmq	Created	Created container: manager
23:13:10	kuadrant-system	kubelet	kuadrant-operator-controller-manager-76f8f686bf-jqrmq	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 3.638s (3.638s including waiting). Image size: 424244516 bytes.
23:13:11	kuadrant-system	kuadrant-operator-controller-manager-76f8f686bf-jqrmq_d667d2d8-2f5f-4eab-9b20-7f8c5c5a0693	f139389e.kuadrant.io	LeaderElection	kuadrant-operator-controller-manager-76f8f686bf-jqrmq_d667d2d8-2f5f-4eab-9b20-7f8c5c5a0693 became leader
23:13:13	kuadrant-system	deployment-controller	kuadrant-console-plugin	ScalingReplicaSet	Scaled up replica set kuadrant-console-plugin-fbdd4f445 from 0 to 1
23:13:13	kuadrant-system	replicaset-controller	kuadrant-console-plugin-fbdd4f445	SuccessfulCreate	Created pod: kuadrant-console-plugin-fbdd4f445-9rnfc
23:13:13	kuadrant-system	kubelet	kuadrant-console-plugin-fbdd4f445-9rnfc	Pulling	Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044"
23:13:13	kuadrant-system	multus	kuadrant-console-plugin-fbdd4f445-9rnfc	AddedInterface	Add eth0 [10.134.0.23/23] from ovn-kubernetes
23:13:13	kuadrant-system	operator-lifecycle-manager	dns-operator.v1.4.2	InstallSucceeded	install strategy completed with no errors
23:13:15	kuadrant-system	operator-lifecycle-manager	authorino-operator.v1.4.3	InstallSucceeded	install strategy completed with no errors
23:13:18	kuadrant-system	kubelet	kuadrant-console-plugin-fbdd4f445-9rnfc	Started	Started container kuadrant-console-plugin
23:13:18	kuadrant-system	kubelet	kuadrant-console-plugin-fbdd4f445-9rnfc	Created	Created container: kuadrant-console-plugin
23:13:18	kuadrant-system	kubelet	kuadrant-console-plugin-fbdd4f445-9rnfc	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:c8550de6790d58c5fa993bf83d41ef693d99a5739fcc0eed3fcaa8d5a7658044" in 4.138s (4.138s including waiting). Image size: 342538866 bytes.
23:13:23	kuadrant-system	replicaset-controller	kuadrant-operator-controller-manager-5f685c496f	SuccessfulCreate	Created pod: kuadrant-operator-controller-manager-5f685c496f-gk89g
23:13:23	kuadrant-system	deployment-controller	kuadrant-operator-controller-manager	ScalingReplicaSet	Scaled up replica set kuadrant-operator-controller-manager-5f685c496f from 0 to 1
23:13:23	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	ComponentUnhealthy	installing: deployment changed old hash=ayDah9ICJkGSMd9EYucMQo1HymBhnLX8E8h2gy, new hash=3HajloN3cjWitGgxuJYCgrrsfXWrKp6ldelaUr
23:13:24	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5f685c496f-gk89g	Pulling	Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e"
23:13:24	kuadrant-system	replicaset-controller	kuadrant-operator-controller-manager-76f8f686bf	SuccessfulCreate	Created pod: kuadrant-operator-controller-manager-76f8f686bf-4wjc9
23:13:24	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	NeedsReinstall	installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.
23:13:24	kuadrant-system	kubelet	kuadrant-operator-controller-manager-76f8f686bf-jqrmq	Killing	Stopping container manager
23:13:24	kuadrant-system	kubelet	limitador-operator-controller-manager-74495c69f8-8llhd	Killing	Stopping container manager
23:13:24	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	ComponentUnhealthy	installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.
23:13:24	kuadrant-system	replicaset-controller	limitador-operator-controller-manager-74495c69f8	SuccessfulCreate	Created pod: limitador-operator-controller-manager-74495c69f8-v6tp5
23:13:24	kuadrant-system	replicaset-controller	kuadrant-operator-controller-manager-5f685c496f	SuccessfulCreate	Created pod: kuadrant-operator-controller-manager-5f685c496f-kbllb
23:13:24 (x2)	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	AllRequirementsMet	all requirements found, attempting install
23:13:24 (x2)	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	InstallSucceeded	waiting for install components to report healthy
23:13:24	kuadrant-system	multus	kuadrant-operator-controller-manager-5f685c496f-gk89g	AddedInterface	Add eth0 [10.134.0.24/23] from ovn-kubernetes
23:13:25	kuadrant-system	kubelet	kuadrant-operator-controller-manager-76f8f686bf-4wjc9	Created	Created container: manager
23:13:25	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5f685c496f-kbllb	Started	Started container manager
23:13:25	kuadrant-system	kubelet	limitador-operator-controller-manager-74495c69f8-v6tp5	Pulled	Container image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:7fdc92b22c7d74e68e71ebf54d1c680fc8dbd47198286dc4f7f87b3d4b31472e" already present on machine
23:13:25	kuadrant-system	multus	limitador-operator-controller-manager-74495c69f8-v6tp5	AddedInterface	Add eth0 [10.132.0.37/23] from ovn-kubernetes
23:13:25	kuadrant-system	kubelet	limitador-operator-controller-manager-74495c69f8-v6tp5	Created	Created container: manager
23:13:25	kuadrant-system	kubelet	limitador-operator-controller-manager-74495c69f8-v6tp5	Started	Started container manager
23:13:25	kuadrant-system	multus	kuadrant-operator-controller-manager-76f8f686bf-4wjc9	AddedInterface	Add eth0 [10.132.0.36/23] from ovn-kubernetes
23:13:25	kuadrant-system	kubelet	kuadrant-operator-controller-manager-76f8f686bf-4wjc9	Pulled	Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine
23:13:25 (x2)	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	InstallWaiting	installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.
23:13:25	kuadrant-system	kubelet	kuadrant-operator-controller-manager-76f8f686bf-4wjc9	Started	Started container manager
23:13:25	kuadrant-system	multus	kuadrant-operator-controller-manager-5f685c496f-kbllb	AddedInterface	Add eth0 [10.132.0.35/23] from ovn-kubernetes
23:13:25	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5f685c496f-kbllb	Pulled	Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine
23:13:25	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5f685c496f-kbllb	Created	Created container: manager
23:13:27	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5f685c496f-gk89g	Killing	Stopping container manager
23:13:27	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5f685c496f-gk89g	Started	Started container manager
23:13:27	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5f685c496f-gk89g	Created	Created container: manager
23:13:27	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5f685c496f-gk89g	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" in 3.613s (3.613s including waiting). Image size: 424244516 bytes.
23:13:36	kuadrant-system	kubelet	kuadrant-operator-controller-manager-76f8f686bf-4wjc9	Killing	Stopping container manager
23:13:36 (x2)	kuadrant-system	operator-lifecycle-manager	limitador-operator.v1.4.2	InstallSucceeded	install strategy completed with no errors
23:13:36	kuadrant-system	replicaset-controller	kuadrant-operator-controller-manager-5769f99d9f	SuccessfulCreate	Created pod: kuadrant-operator-controller-manager-5769f99d9f-brvgh
23:13:36	kuadrant-system	replicaset-controller	kuadrant-operator-controller-manager-76f8f686bf	SuccessfulDelete	Deleted pod: kuadrant-operator-controller-manager-76f8f686bf-4wjc9
23:13:36	kuadrant-system	deployment-controller	kuadrant-operator-controller-manager	ScalingReplicaSet	Scaled down replica set kuadrant-operator-controller-manager-76f8f686bf from 1 to 0
23:13:36	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	InstallWaiting	installing: deployment changed old hash=5iePPO15CkzoB42T8YH5epRm5rk1Lbosb0nJjD, new hash=7cgs1ZYgnyorni1SdrTzorBbS2Md81YnTLCMLe
23:13:37 (x2)	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	InstallWaiting	installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" waiting for 1 outdated replica(s) to be terminated
23:13:37	kuadrant-system	multus	kuadrant-operator-controller-manager-5769f99d9f-brvgh	AddedInterface	Add eth0 [10.132.0.38/23] from ovn-kubernetes
23:13:40	kuadrant-system	limitador-operator-controller-manager-74495c69f8-v6tp5_cd08b819-3883-478d-a7df-7519a421d49f	3745a16e.kuadrant.io	LeaderElection	limitador-operator-controller-manager-74495c69f8-v6tp5_cd08b819-3883-478d-a7df-7519a421d49f became leader
23:13:42	kuadrant-system	kuadrant-operator-controller-manager-5f685c496f-kbllb_85a9d6e4-ec8e-4a05-9ec8-4688d414766d	f139389e.kuadrant.io	LeaderElection	kuadrant-operator-controller-manager-5f685c496f-kbllb_85a9d6e4-ec8e-4a05-9ec8-4688d414766d became leader
23:13:49	kuadrant-system	deployment-controller	kuadrant-operator-controller-manager	ScalingReplicaSet	Scaled down replica set kuadrant-operator-controller-manager-5f685c496f from 1 to 0
23:13:49	kuadrant-system	replicaset-controller	kuadrant-operator-controller-manager-5f685c496f	SuccessfulDelete	Deleted pod: kuadrant-operator-controller-manager-5f685c496f-kbllb
23:13:49	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5f685c496f-kbllb	Killing	Stopping container manager
23:13:52	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-5ccb968c66	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-5ccb968c66-dxbq6
23:13:52	openshift-ingress	gateway_labeler_controller	maas-default-gateway	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway
23:13:52	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1
23:13:52	openshift-ingress	gateway_labeler_controller	maas-default-gateway	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway
23:13:52	openshift-ingress	deployment-controller	maas-default-gateway-openshift-default	ScalingReplicaSet	Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1
23:13:52	openshift-ingress	replicaset-controller	maas-default-gateway-openshift-default-5ccb968c66	SuccessfulCreate	Created pod: maas-default-gateway-openshift-default-5ccb968c66-dxbq6
23:13:53	openshift-ingress	multus	maas-default-gateway-openshift-default-5ccb968c66-dxbq6	AddedInterface	Add eth0 [10.133.0.34/23] from ovn-kubernetes
23:13:53	openshift-ingress	multus	maas-default-gateway-openshift-default-5ccb968c66-dxbq6	AddedInterface	Add eth0 [10.133.0.34/23] from ovn-kubernetes
23:14:06	kuadrant-system	kuadrant-operator-controller-manager-5769f99d9f-brvgh_67b68b00-d540-451e-8fa5-ddd4908c855b	f139389e.kuadrant.io	LeaderElection	kuadrant-operator-controller-manager-5769f99d9f-brvgh_67b68b00-d540-451e-8fa5-ddd4908c855b became leader
23:14:07	kuadrant-system	replicaset-controller	limitador-limitador-84994f7ffc	SuccessfulCreate	Created pod: limitador-limitador-84994f7ffc-rn8c6
23:14:07	kuadrant-system	deployment-controller	limitador-limitador	ScalingReplicaSet	Scaled up replica set limitador-limitador-84994f7ffc from 0 to 1
23:14:07	kuadrant-system	deployment-controller	limitador-limitador	ScalingReplicaSet	Scaled up replica set limitador-limitador-8588749977 from 0 to 1
23:14:07	kuadrant-system	replicaset-controller	limitador-limitador-8588749977	SuccessfulCreate	Created pod: limitador-limitador-8588749977-7ddsw
23:14:08	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-7bcfd8f9cd from 0 to 1
23:14:08	kuadrant-system	kubelet	limitador-limitador-84994f7ffc-rn8c6	Pulling	Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"
23:14:08	kuadrant-system	replicaset-controller	authorino-7bcfd8f9cd	SuccessfulCreate	Created pod: authorino-7bcfd8f9cd-mqd2t
23:14:08	kuadrant-system	multus	limitador-limitador-8588749977-7ddsw	AddedInterface	Add eth0 [10.134.0.25/23] from ovn-kubernetes
23:14:08	kuadrant-system	kubelet	limitador-limitador-8588749977-7ddsw	Pulling	Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751"
23:14:08	kuadrant-system	replicaset-controller	authorino-59c974bd48	SuccessfulCreate	Created pod: authorino-59c974bd48-2mr8d
23:14:08	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-59c974bd48 from 0 to 1
23:14:08	kuadrant-system	multus	limitador-limitador-84994f7ffc-rn8c6	AddedInterface	Add eth0 [10.132.0.39/23] from ovn-kubernetes
23:14:09	kuadrant-system	multus	authorino-59c974bd48-2mr8d	AddedInterface	Add eth0 [10.133.0.35/23] from ovn-kubernetes
23:14:09	kuadrant-system	kubelet	authorino-7bcfd8f9cd-mqd2t	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
23:14:09	kuadrant-system	kubelet	authorino-59c974bd48-2mr8d	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
23:14:09	kuadrant-system	kubelet	limitador-limitador-84994f7ffc-rn8c6	Started	Started container limitador
23:14:09	kuadrant-system	kubelet	limitador-limitador-8588749977-7ddsw	Started	Started container limitador
23:14:09	kuadrant-system	kubelet	limitador-limitador-8588749977-7ddsw	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 1.229s (1.229s including waiting). Image size: 133379307 bytes.
23:14:09	kuadrant-system	multus	authorino-7bcfd8f9cd-mqd2t	AddedInterface	Add eth0 [10.134.0.26/23] from ovn-kubernetes
23:14:09	kuadrant-system	kubelet	limitador-limitador-8588749977-7ddsw	Created	Created container: limitador
23:14:09	kuadrant-system	kubelet	limitador-limitador-84994f7ffc-rn8c6	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:793a38ce1b5690b99bc20fb7fca3304727d5fb21fcf440ab88f3e7af5778a751" in 972ms (972ms including waiting). Image size: 133379307 bytes.
23:14:09	kuadrant-system	kubelet	limitador-limitador-84994f7ffc-rn8c6	Created	Created container: limitador
23:14:10	kuadrant-system	kubelet	authorino-7bcfd8f9cd-mqd2t	Created	Created container: authorino
23:14:10	kuadrant-system	kubelet	authorino-7bcfd8f9cd-mqd2t	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 1.348s (1.348s including waiting). Image size: 204096810 bytes.
23:14:10	kuadrant-system	kubelet	authorino-7bcfd8f9cd-mqd2t	Started	Started container authorino
23:14:10	openshift-console-operator	console-operator-status-controller-statussyncer_console	console-operator	OperatorStatusChanged	Status for clusteroperator/console changed: status.relatedObjects changed from [{"console.openshift.io" "consoleplugins" "" "monitoring-plugin"} {"" "namespaces" "" "openshift-monitoring"} {"console.openshift.io" "consoleplugins" "" "networking-console-plugin"} {"" "namespaces" "" "openshift-network-console"} {"oauth.openshift.io" "oauthclients" "" "console"} {"operator.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "infrastructures" "" "cluster"} {"config.openshift.io" "proxies" "" "cluster"} {"config.openshift.io" "oauths" "" "cluster"} {"" "namespaces" "" "openshift-console-operator"} {"" "namespaces" "" "openshift-console"} {"" "configmaps" "openshift-config-managed" "console-public"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-operator"} {"rbac.authorization.k8s.io" "clusterroles" "" "console"} {"rbac.authorization.k8s.io" "clusterroles" "" "helm-chartrepos-viewer"} {"rbac.authorization.k8s.io" "clusterroles" "" "project-helm-chartrepository-editor"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-extensions-reader"}] to [{"console.openshift.io" "consoleplugins" "" "kuadrant-console-plugin"} {"" "namespaces" "" "kuadrant-system"} {"console.openshift.io" "consoleplugins" "" "monitoring-plugin"} {"" "namespaces" "" "openshift-monitoring"} {"console.openshift.io" "consoleplugins" "" "networking-console-plugin"} {"" "namespaces" "" "openshift-network-console"} {"oauth.openshift.io" "oauthclients" "" "console"} {"operator.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "consoles" "" "cluster"} {"config.openshift.io" "infrastructures" "" "cluster"} {"config.openshift.io" "proxies" "" "cluster"} {"config.openshift.io" "oauths" "" "cluster"} {"" "namespaces" "" "openshift-console-operator"} {"" "namespaces" "" "openshift-console"} {"" "configmaps" "openshift-config-managed" "console-public"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-operator"} {"rbac.authorization.k8s.io" "clusterroles" "" "console"} {"rbac.authorization.k8s.io" "clusterroles" "" "helm-chartrepos-viewer"} {"rbac.authorization.k8s.io" "clusterroles" "" "project-helm-chartrepository-editor"} {"rbac.authorization.k8s.io" "clusterroles" "" "console-extensions-reader"}]
23:14:11	kuadrant-system	kubelet	authorino-59c974bd48-2mr8d	Started	Started container authorino
23:14:11	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled down replica set authorino-7bcfd8f9cd from 1 to 0
23:14:11	kuadrant-system	replicaset-controller	authorino-7bcfd8f9cd	SuccessfulDelete	Deleted pod: authorino-7bcfd8f9cd-mqd2t
23:14:11	kuadrant-system	kubelet	authorino-59c974bd48-2mr8d	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 2.251s (2.251s including waiting). Image size: 204096810 bytes.
23:14:11	kuadrant-system	kubelet	authorino-59c974bd48-2mr8d	Created	Created container: authorino
23:14:13	kuadrant-system	kubelet	authorino-7bcfd8f9cd-mqd2t	Killing	Stopping container authorino
23:14:20	kuadrant-system	deployment-controller	limitador-limitador	ScalingReplicaSet	Scaled down replica set limitador-limitador-8588749977 from 1 to 0
23:14:20	kuadrant-system	kubelet	limitador-limitador-8588749977-7ddsw	Killing	Stopping container limitador
23:14:20	kuadrant-system	replicaset-controller	limitador-limitador-8588749977	SuccessfulDelete	Deleted pod: limitador-limitador-8588749977-7ddsw
23:14:25	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for odh-ai-gateway-infra namespace
23:14:38	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled down replica set authorino-557f876f69 from 1 to 0
23:14:38	kuadrant-system	replicaset-controller	authorino-557f876f69	SuccessfulDelete	Deleted pod: authorino-557f876f69-5dcqj
23:14:38	kuadrant-system	replicaset-controller	authorino-557f876f69	SuccessfulCreate	Created pod: authorino-557f876f69-5dcqj
23:14:38	kuadrant-system	replicaset-controller	authorino-ff99c8464	SuccessfulCreate	Created pod: authorino-ff99c8464-cnmqr
23:14:38	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-557f876f69 from 0 to 1
23:14:38	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-ff99c8464 from 0 to 1
23:14:39	kuadrant-system	multus	authorino-ff99c8464-cnmqr	AddedInterface	Add eth0 [10.134.0.29/23] from ovn-kubernetes
23:14:39	kuadrant-system	kubelet	authorino-ff99c8464-cnmqr	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
23:14:40	kuadrant-system	kubelet	authorino-ff99c8464-cnmqr	Started	Started container authorino
23:14:40	kuadrant-system	kubelet	authorino-6f8f6d7d6b-rlqdj	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
23:14:40	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled up replica set authorino-6f8f6d7d6b from 0 to 1
23:14:40	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled down replica set authorino-59c974bd48 from 1 to 0
23:14:40	kuadrant-system	kubelet	authorino-59c974bd48-2mr8d	Killing	Stopping container authorino
23:14:40	kuadrant-system	replicaset-controller	authorino-59c974bd48	SuccessfulDelete	Deleted pod: authorino-59c974bd48-2mr8d
23:14:40	kuadrant-system	multus	authorino-6f8f6d7d6b-rlqdj	AddedInterface	Add eth0 [10.134.0.30/23] from ovn-kubernetes
23:14:40	kuadrant-system	kubelet	authorino-ff99c8464-cnmqr	Created	Created container: authorino
23:14:40	kuadrant-system	kubelet	authorino-ff99c8464-cnmqr	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 550ms (550ms including waiting). Image size: 204096810 bytes.
23:14:40	kuadrant-system	replicaset-controller	authorino-6f8f6d7d6b	SuccessfulCreate	Created pod: authorino-6f8f6d7d6b-rlqdj
23:14:41	kuadrant-system	kubelet	authorino-6f8f6d7d6b-rlqdj	Created	Created container: authorino
23:14:41	kuadrant-system	kubelet	authorino-6f8f6d7d6b-rlqdj	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 723ms (723ms including waiting). Image size: 204096810 bytes.
23:14:41	kuadrant-system	kubelet	authorino-6f8f6d7d6b-rlqdj	Started	Started container authorino
23:14:42	kuadrant-system	kubelet	authorino-ff99c8464-cnmqr	Killing	Stopping container authorino
23:14:42	kuadrant-system	replicaset-controller	authorino-ff99c8464	SuccessfulDelete	Deleted pod: authorino-ff99c8464-cnmqr
23:14:42	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	Scaled down replica set authorino-ff99c8464 from 1 to 0
23:14:44	opendatahub	replicaset-controller	maas-controller-654fc8f547	SuccessfulCreate	Created pod: maas-controller-654fc8f547-p7t67
23:14:44	opendatahub	deployment-controller	maas-controller	ScalingReplicaSet	Scaled up replica set maas-controller-654fc8f547 from 0 to 1
23:14:45	opendatahub	replicaset-controller	maas-controller-947db468d	SuccessfulCreate	Created pod: maas-controller-947db468d-2qdk6
23:14:45	opendatahub	kubelet	maas-controller-654fc8f547-p7t67	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "maas-controller-metrics-tls" not found
23:14:45	opendatahub	kubelet	maas-controller-947db468d-2qdk6	FailedMount	MountVolume.SetUp failed for volume "metrics-certs" : secret "maas-controller-metrics-tls" not found
23:14:46	opendatahub	multus	maas-controller-947db468d-2qdk6	AddedInterface	Add eth0 [10.133.0.37/23] from ovn-kubernetes
23:14:46	opendatahub	kubelet	maas-controller-654fc8f547-p7t67	Pulling	Pulling image "quay.io/opendatahub/maas-controller@sha256:30a9b9205a9650717df2e18a15662ad01e050a58df1f818d6ef97e8ae29c7087"
23:14:46	opendatahub	multus	maas-controller-654fc8f547-p7t67	AddedInterface	Add eth0 [10.133.0.36/23] from ovn-kubernetes
23:14:46	opendatahub	kubelet	maas-controller-947db468d-2qdk6	Pulling	Pulling image "quay.io/opendatahub/maas-controller@sha256:30a9b9205a9650717df2e18a15662ad01e050a58df1f818d6ef97e8ae29c7087"
23:14:48	opendatahub	kubelet	maas-controller-947db468d-2qdk6	Pulled	Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:30a9b9205a9650717df2e18a15662ad01e050a58df1f818d6ef97e8ae29c7087" in 2.457s (2.457s including waiting). Image size: 198031682 bytes.
23:14:48	opendatahub	kubelet	maas-controller-654fc8f547-p7t67	Pulled	Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:30a9b9205a9650717df2e18a15662ad01e050a58df1f818d6ef97e8ae29c7087" in 2.635s (2.635s including waiting). Image size: 198031682 bytes.
23:14:48	opendatahub	kubelet	maas-controller-654fc8f547-p7t67	Started	Started container manager
23:14:48	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenants namespace
23:14:48	opendatahub	kubelet	maas-controller-947db468d-2qdk6	Created	Created container: manager
23:14:48	opendatahub	kubelet	maas-controller-947db468d-2qdk6	Started	Started container manager
23:14:48	opendatahub	kubelet	maas-controller-654fc8f547-p7t67	Created	Created container: manager
23:14:50	opendatahub	maas-controller-654fc8f547-p7t67_c8a2daa0-729f-4ab4-abd6-200ff8b72da5	maas-controller.models-as-a-service.opendatahub.io	LeaderElection	maas-controller-654fc8f547-p7t67_c8a2daa0-729f-4ab4-abd6-200ff8b72da5 became leader
23:14:59	opendatahub	replicaset-controller	maas-controller-654fc8f547	SuccessfulDelete	Deleted pod: maas-controller-654fc8f547-p7t67
23:14:59	opendatahub	kubelet	maas-controller-654fc8f547-p7t67	Killing	Stopping container manager
23:14:59	opendatahub	deployment-controller	maas-controller	ScalingReplicaSet	Scaled down replica set maas-controller-654fc8f547 from 1 to 0
23:15:16	opendatahub	maas-controller-947db468d-2qdk6_acaf6a2b-afc3-4b91-8113-a0f8522dcf1a	maas-controller.models-as-a-service.opendatahub.io	LeaderElection	maas-controller-947db468d-2qdk6_acaf6a2b-afc3-4b91-8113-a0f8522dcf1a became leader
23:15:19	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for models-as-a-service namespace
23:15:21	openshift-ingress	kubelet	payload-processing-5b54b7fbb7-x5r9q	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
23:15:21	openshift-ingress	deployment-controller	payload-processing	ScalingReplicaSet	Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
23:15:21	openshift-ingress	replicaset-controller	payload-processing-5b54b7fbb7	SuccessfulCreate	Created pod: payload-processing-5b54b7fbb7-x5r9q
23:15:21	openshift-ingress	kubelet	payload-pre-processing-59fbc47bf8-4gbbx	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
23:15:21	openshift-ingress	multus	payload-pre-processing-59fbc47bf8-4gbbx	AddedInterface	Add eth0 [10.133.0.38/23] from ovn-kubernetes
23:15:21 (x5)	openshift-ingress	replicaset-controller	payload-processing-5b54b7fbb7	FailedCreate	Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
23:15:21	openshift-ingress	multus	payload-processing-5b54b7fbb7-x5r9q	AddedInterface	Add eth0 [10.132.0.40/23] from ovn-kubernetes
23:15:21	openshift-ingress	multus	payload-pre-processing-59fbc47bf8-4gbbx	AddedInterface	Add eth0 [10.133.0.38/23] from ovn-kubernetes
23:15:21	openshift-ingress	kubelet	payload-pre-processing-59fbc47bf8-4gbbx	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
23:15:21	openshift-ingress	multus	payload-processing-5b54b7fbb7-x5r9q	AddedInterface	Add eth0 [10.132.0.40/23] from ovn-kubernetes
23:15:21	openshift-ingress	kubelet	payload-processing-5b54b7fbb7-x5r9q	Pulling	Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
23:15:21	openshift-ingress	deployment-controller	payload-pre-processing	ScalingReplicaSet	Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
23:15:21	openshift-ingress	replicaset-controller	payload-processing-5b54b7fbb7	SuccessfulCreate	Created pod: payload-processing-5b54b7fbb7-x5r9q
23:15:21 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-59fbc47bf8	FailedCreate	Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
23:15:21	openshift-ingress	replicaset-controller	payload-pre-processing-59fbc47bf8	SuccessfulCreate	Created pod: payload-pre-processing-59fbc47bf8-4gbbx
23:15:21 (x5)	openshift-ingress	replicaset-controller	payload-processing-5b54b7fbb7	FailedCreate	Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
23:15:21 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-59fbc47bf8	FailedCreate	Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
23:15:21	openshift-ingress	deployment-controller	payload-pre-processing	ScalingReplicaSet	Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
23:15:21	openshift-ingress	deployment-controller	payload-processing	ScalingReplicaSet	Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
23:15:21	openshift-ingress	replicaset-controller	payload-pre-processing-59fbc47bf8	SuccessfulCreate	Created pod: payload-pre-processing-59fbc47bf8-4gbbx
23:15:23	openshift-ingress	kubelet	payload-pre-processing-59fbc47bf8-4gbbx	Created	Created container: payload-pre-processing
23:15:23	openshift-ingress	kubelet	payload-pre-processing-59fbc47bf8-4gbbx	Started	Started container payload-pre-processing
23:15:23	openshift-ingress	kubelet	payload-pre-processing-59fbc47bf8-4gbbx	Created	Created container: payload-pre-processing
23:15:23	openshift-ingress	kubelet	payload-pre-processing-59fbc47bf8-4gbbx	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.264s (1.264s including waiting). Image size: 166449312 bytes.
23:15:23	openshift-ingress	kubelet	payload-pre-processing-59fbc47bf8-4gbbx	Started	Started container payload-pre-processing
23:15:23	openshift-ingress	kubelet	payload-pre-processing-59fbc47bf8-4gbbx	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.264s (1.264s including waiting). Image size: 166449312 bytes.
23:15:24	openshift-ingress	kubelet	payload-processing-5b54b7fbb7-x5r9q	Created	Created container: payload-processing
23:15:24	openshift-ingress	kubelet	payload-processing-5b54b7fbb7-x5r9q	Started	Started container payload-processing
23:15:24	openshift-ingress	kubelet	payload-processing-5b54b7fbb7-x5r9q	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.362s (2.362s including waiting). Image size: 166449312 bytes.
23:15:24	openshift-ingress	kubelet	payload-processing-5b54b7fbb7-x5r9q	Pulled	Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.362s (2.362s including waiting). Image size: 166449312 bytes.
23:15:24	openshift-ingress	kubelet	payload-processing-5b54b7fbb7-x5r9q	Created	Created container: payload-processing
23:15:24	openshift-ingress	kubelet	payload-processing-5b54b7fbb7-x5r9q	Started	Started container payload-processing
23:15:31 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5ccb968c66-dxbq6	Started	Started container istio-proxy
23:15:31	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for llm namespace
23:15:31 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5ccb968c66-dxbq6	Created	Created container: istio-proxy
23:15:31 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5ccb968c66-dxbq6	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:15:31 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5ccb968c66-dxbq6	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:15:31 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5ccb968c66-dxbq6	Created	Created container: istio-proxy
23:15:31 (x2)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5ccb968c66-dxbq6	Started	Started container istio-proxy
23:15:37 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5ccb968c66-dxbq6	ProbeError	Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
23:15:37 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5ccb968c66-dxbq6	Unhealthy	Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
23:15:37 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5ccb968c66-dxbq6	Unhealthy	Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
23:15:37 (x6)	openshift-ingress	kubelet	maas-default-gateway-openshift-default-5ccb968c66-dxbq6	ProbeError	Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
23:18:15	kuadrant-system	replicaset-controller	authorino-69c94896d7	SuccessfulCreate	Created pod: authorino-69c94896d7-d4tm6
23:18:16	kuadrant-system	kubelet	authorino-69c94896d7-d4tm6	Pulled	Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0" in 409ms (409ms including waiting). Image size: 204096810 bytes.
23:18:16	kuadrant-system	kubelet	authorino-69c94896d7-d4tm6	Started	Started container authorino
23:18:16	kuadrant-system	kubelet	authorino-69c94896d7-d4tm6	Created	Created container: authorino
23:18:16	kuadrant-system	replicaset-controller	authorino-6f8f6d7d6b	SuccessfulDelete	Deleted pod: authorino-6f8f6d7d6b-rlqdj
23:18:16	kuadrant-system	kubelet	authorino-69c94896d7-d4tm6	Pulling	Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c4a5a8f911a5097293de58dde320e9b8e51783b8fd92121de73bc60f6672cdf0"
23:18:16 (x2)	kuadrant-system	deployment-controller	authorino	ScalingReplicaSet	(combined from similar events): Scaled down replica set authorino-6f8f6d7d6b from 1 to 0
23:18:16	kuadrant-system	multus	authorino-69c94896d7-d4tm6	AddedInterface	Add eth0 [10.133.0.40/23] from ovn-kubernetes
23:18:16	kuadrant-system	kubelet	authorino-6f8f6d7d6b-rlqdj	Killing	Stopping container authorino
23:18:17	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for premium-users-namespace namespace
23:18:18	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for maas-admin namespace
23:18:34	openshift-ingress	replicaset-controller	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d	SuccessfulCreate	Created pod: e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq
23:18:34	openshift-ingress	replicaset-controller	e2e-worker-w0-736809-openshift-default-58bd7799bb	SuccessfulCreate	Created pod: e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw
23:18:34	openshift-ingress	deployment-controller	e2e-worker-w4-825f30-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w4-825f30-openshift-default-85558f6fd8 from 0 to 1
23:18:34	openshift-ingress	deployment-controller	e2e-inf-a-48d98f-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d from 0 to 1
23:18:34	openshift-ingress	deployment-controller	e2e-worker-w0-736809-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w0-736809-openshift-default-58bd7799bb from 0 to 1
23:18:34	openshift-ingress	gateway_labeler_controller	e2e-inf-a-48d98f	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-48d98f
23:18:34	openshift-ingress	deployment-controller	e2e-inf-a-48d98f-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d from 0 to 1
23:18:34	openshift-ingress	gateway_labeler_controller	e2e-worker-w4-825f30	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-825f30
23:18:34	openshift-ingress	gateway_labeler_controller	e2e-worker-w4-825f30	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-825f30
23:18:34	openshift-ingress	multus	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	AddedInterface	Add eth0 [10.133.0.41/23] from ovn-kubernetes
23:18:34	openshift-ingress	replicaset-controller	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d	SuccessfulCreate	Created pod: e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq
23:18:34	openshift-ingress	replicaset-controller	e2e-worker-w4-825f30-openshift-default-85558f6fd8	SuccessfulCreate	Created pod: e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z
23:18:34	openshift-ingress	deployment-controller	e2e-worker-w0-736809-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w0-736809-openshift-default-58bd7799bb from 0 to 1
23:18:34	openshift-ingress	gateway_labeler_controller	e2e-inf-a-48d98f	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-48d98f
23:18:34	openshift-ingress	gateway_labeler_controller	e2e-worker-w0-736809	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-736809
23:18:34	openshift-ingress	multus	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	AddedInterface	Add eth0 [10.133.0.42/23] from ovn-kubernetes
23:18:34	openshift-ingress	gateway_labeler_controller	e2e-worker-w0-736809	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-736809
23:18:34	openshift-ingress	multus	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	AddedInterface	Add eth0 [10.133.0.41/23] from ovn-kubernetes
23:18:34	openshift-ingress	multus	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	AddedInterface	Add eth0 [10.133.0.42/23] from ovn-kubernetes
23:18:34	openshift-ingress	replicaset-controller	e2e-worker-w0-736809-openshift-default-58bd7799bb	SuccessfulCreate	Created pod: e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw
23:18:34	openshift-ingress	replicaset-controller	e2e-worker-w4-825f30-openshift-default-85558f6fd8	SuccessfulCreate	Created pod: e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z
23:18:34	openshift-ingress	deployment-controller	e2e-worker-w4-825f30-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-worker-w4-825f30-openshift-default-85558f6fd8 from 0 to 1
23:18:34	default	endpoint-controller	e2e-worker-w4-825f30-openshift-default	FailedToCreateEndpoint	Failed to create endpoint for service openshift-ingress/e2e-worker-w4-825f30-openshift-default: endpoints "e2e-worker-w4-825f30-openshift-default" already exists
23:18:35	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-ait-wrong-de8fe27c namespace
23:18:35	openshift-ingress	multus	e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	AddedInterface	Add eth0 [10.133.0.43/23] from ovn-kubernetes
23:18:35	openshift-ingress	multus	e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	AddedInterface	Add eth0 [10.133.0.43/23] from ovn-kubernetes
23:18:36	opendatahub	kubelet	test-curl-7862-c8a2b7	Pulling	Pulling image "registry.access.redhat.com/ubi9/ubi-minimal:9.5"
23:18:36	opendatahub	multus	test-curl-7862-c8a2b7	AddedInterface	Add eth0 [10.132.0.42/23] from ovn-kubernetes
23:18:37	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-worker-w4-825f30 namespace
23:18:37	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-inf-a-48d98f namespace
23:18:38	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-worker-w0-736809 namespace
23:18:39	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd	SuccessfulCreate	Created pod: payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk
23:18:39	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd	SuccessfulCreate	Created pod: payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk
23:18:39	openshift-ingress	deployment-controller	payload-pre-processing-e2e-worker-w4-825f30	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd from 0 to 1
23:18:39	opendatahub	kubelet	test-curl-7862-c8a2b7	Started	Started container test-curl-7862-c8a2b7
23:18:39 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd	FailedCreate	Error creating: pods "payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-825f30: serviceaccount "payload-processing-e2e-worker-w4-825f30" not found
23:18:39	opendatahub	kubelet	test-curl-7862-c8a2b7	Created	Created container: test-curl-7862-c8a2b7
23:18:39	openshift-ingress	deployment-controller	payload-pre-processing-e2e-worker-w4-825f30	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd from 0 to 1
23:18:39	openshift-ingress	deployment-controller	payload-processing-e2e-worker-w4-825f30	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-worker-w4-825f30-85d7bd455 from 0 to 1
23:18:39 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd	FailedCreate	Error creating: pods "payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-825f30: serviceaccount "payload-processing-e2e-worker-w4-825f30" not found
23:18:39	openshift-ingress	deployment-controller	payload-processing-e2e-worker-w4-825f30	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-worker-w4-825f30-85d7bd455 from 0 to 1
23:18:39	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w4-825f30-85d7bd455	SuccessfulCreate	Created pod: payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc
23:18:39 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w4-825f30-85d7bd455	FailedCreate	Error creating: pods "payload-processing-e2e-worker-w4-825f30-85d7bd455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-825f30: serviceaccount "payload-processing-e2e-worker-w4-825f30" not found
23:18:39	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w4-825f30-85d7bd455	SuccessfulCreate	Created pod: payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc
23:18:39 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w4-825f30-85d7bd455	FailedCreate	Error creating: pods "payload-processing-e2e-worker-w4-825f30-85d7bd455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-825f30: serviceaccount "payload-processing-e2e-worker-w4-825f30" not found
23:18:39	opendatahub	kubelet	test-curl-7862-c8a2b7	Pulled	Successfully pulled image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" in 2.559s (2.559s including waiting). Image size: 106100986 bytes.
23:18:40	openshift-ingress	multus	payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk	AddedInterface	Add eth0 [10.132.0.43/23] from ovn-kubernetes
23:18:40	openshift-ingress	kubelet	payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc	Created	Created container: payload-processing
23:18:40	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-a-48d98f-6bcb4f8579	SuccessfulCreate	Created pod: payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j
23:18:40	openshift-ingress	multus	payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc	AddedInterface	Add eth0 [10.132.0.44/23] from ovn-kubernetes
23:18:40 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8	FailedCreate	Error creating: pods "payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-48d98f: serviceaccount "payload-processing-e2e-inf-a-48d98f" not found
23:18:40	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8	SuccessfulCreate	Created pod: payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx
23:18:40 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-a-48d98f-6bcb4f8579	FailedCreate	Error creating: pods "payload-processing-e2e-inf-a-48d98f-6bcb4f8579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-48d98f: serviceaccount "payload-processing-e2e-inf-a-48d98f" not found
23:18:40	openshift-ingress	kubelet	payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc	Started	Started container payload-processing
23:18:40	openshift-ingress	kubelet	payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc	Created	Created container: payload-processing
23:18:40	openshift-ingress	kubelet	payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:40	openshift-ingress	multus	payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc	AddedInterface	Add eth0 [10.132.0.44/23] from ovn-kubernetes
23:18:40	openshift-ingress	deployment-controller	payload-pre-processing-e2e-inf-a-48d98f	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8 from 0 to 1
23:18:40	openshift-ingress	deployment-controller	payload-pre-processing-e2e-inf-a-48d98f	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8 from 0 to 1
23:18:40	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8	SuccessfulCreate	Created pod: payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx
23:18:40 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8	FailedCreate	Error creating: pods "payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-48d98f: serviceaccount "payload-processing-e2e-inf-a-48d98f" not found
23:18:40	openshift-ingress	multus	payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk	AddedInterface	Add eth0 [10.132.0.43/23] from ovn-kubernetes
23:18:40	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:40	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk	Started	Started container payload-pre-processing
23:18:40	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk	Created	Created container: payload-pre-processing
23:18:40	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk	Created	Created container: payload-pre-processing
23:18:40	openshift-ingress	deployment-controller	payload-processing-e2e-inf-a-48d98f	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-inf-a-48d98f-6bcb4f8579 from 0 to 1
23:18:40	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-a-48d98f-6bcb4f8579	SuccessfulCreate	Created pod: payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j
23:18:40	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:40 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-a-48d98f-6bcb4f8579	FailedCreate	Error creating: pods "payload-processing-e2e-inf-a-48d98f-6bcb4f8579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-48d98f: serviceaccount "payload-processing-e2e-inf-a-48d98f" not found
23:18:40	openshift-ingress	kubelet	payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc	Started	Started container payload-processing
23:18:40	openshift-ingress	deployment-controller	payload-processing-e2e-inf-a-48d98f	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-inf-a-48d98f-6bcb4f8579 from 0 to 1
23:18:40	openshift-ingress	kubelet	payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:40	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk	Started	Started container payload-pre-processing
23:18:41	openshift-ingress	kubelet	payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j	Started	Started container payload-processing
23:18:41	openshift-ingress	kubelet	payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j	Created	Created container: payload-processing
23:18:41	openshift-ingress	kubelet	payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:41	openshift-ingress	multus	payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j	AddedInterface	Add eth0 [10.132.0.46/23] from ovn-kubernetes
23:18:41	openshift-ingress	multus	payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx	AddedInterface	Add eth0 [10.132.0.45/23] from ovn-kubernetes
23:18:41	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:41	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx	Created	Created container: payload-pre-processing
23:18:41	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx	Started	Started container payload-pre-processing
23:18:41	opendatahub	kubelet	test-curl-7862-c8a2b7	Killing	Stopping container test-curl-7862-c8a2b7
23:18:41	opendatahub	kubelet	test-curl-7862-9ee82a	Started	Started container test-curl-7862-9ee82a
23:18:41	openshift-ingress	kubelet	payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j	Started	Started container payload-processing
23:18:41	opendatahub	kubelet	test-curl-7862-9ee82a	Created	Created container: test-curl-7862-9ee82a
23:18:41	opendatahub	kubelet	test-curl-7862-9ee82a	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine
23:18:41	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx	Started	Started container payload-pre-processing
23:18:41	opendatahub	multus	test-curl-7862-9ee82a	AddedInterface	Add eth0 [10.132.0.47/23] from ovn-kubernetes
23:18:41	openshift-ingress	kubelet	payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j	Created	Created container: payload-processing
23:18:41	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx	Created	Created container: payload-pre-processing
23:18:41	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:41	openshift-ingress	multus	payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx	AddedInterface	Add eth0 [10.132.0.45/23] from ovn-kubernetes
23:18:41	openshift-ingress	multus	payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j	AddedInterface	Add eth0 [10.132.0.46/23] from ovn-kubernetes
23:18:41	openshift-ingress	kubelet	payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:42	openshift-ingress	kubelet	payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs	Created	Created container: payload-processing
23:18:42	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6	SuccessfulCreate	Created pod: payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc
23:18:42	openshift-ingress	kubelet	payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:42	openshift-ingress	multus	payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs	AddedInterface	Add eth0 [10.133.0.45/23] from ovn-kubernetes
23:18:42	openshift-ingress	kubelet	payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs	Started	Started container payload-processing
23:18:42	openshift-ingress	deployment-controller	payload-processing-e2e-worker-w0-736809	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-worker-w0-736809-68ddd69c57 from 0 to 1
23:18:42	openshift-ingress	deployment-controller	payload-pre-processing-e2e-worker-w0-736809	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6 from 0 to 1
23:18:42	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6	SuccessfulCreate	Created pod: payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc
23:18:42 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6	FailedCreate	Error creating: pods "payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-736809: serviceaccount "payload-processing-e2e-worker-w0-736809" not found
23:18:42	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc	Started	Started container payload-pre-processing
23:18:42	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc	Created	Created container: payload-pre-processing
23:18:42	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:42	openshift-ingress	multus	payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc	AddedInterface	Add eth0 [10.133.0.44/23] from ovn-kubernetes
23:18:42 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w0-736809-68ddd69c57	FailedCreate	Error creating: pods "payload-processing-e2e-worker-w0-736809-68ddd69c57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-736809: serviceaccount "payload-processing-e2e-worker-w0-736809" not found
23:18:42	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w0-736809-68ddd69c57	SuccessfulCreate	Created pod: payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs
23:18:42	openshift-ingress	deployment-controller	payload-processing-e2e-worker-w0-736809	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-worker-w0-736809-68ddd69c57 from 0 to 1
23:18:42	openshift-ingress	multus	payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs	AddedInterface	Add eth0 [10.133.0.45/23] from ovn-kubernetes
23:18:42	openshift-ingress	kubelet	payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:42	openshift-ingress	kubelet	payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs	Created	Created container: payload-processing
23:18:42	openshift-ingress	multus	payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc	AddedInterface	Add eth0 [10.133.0.44/23] from ovn-kubernetes
23:18:42	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:42	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc	Created	Created container: payload-pre-processing
23:18:42	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc	Started	Started container payload-pre-processing
23:18:42	openshift-ingress	kubelet	payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs	Started	Started container payload-processing
23:18:42 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6	FailedCreate	Error creating: pods "payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-736809: serviceaccount "payload-processing-e2e-worker-w0-736809" not found
23:18:42	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w0-736809-68ddd69c57	SuccessfulCreate	Created pod: payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs
23:18:42	openshift-ingress	deployment-controller	payload-pre-processing-e2e-worker-w0-736809	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6 from 0 to 1
23:18:42 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-worker-w0-736809-68ddd69c57	FailedCreate	Error creating: pods "payload-processing-e2e-worker-w0-736809-68ddd69c57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-736809: serviceaccount "payload-processing-e2e-worker-w0-736809" not found
23:18:43	openshift-ingress	multus	e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	AddedInterface	Add eth0 [10.133.0.46/23] from ovn-kubernetes
23:18:43	openshift-ingress	replicaset-controller	e2e-autores-61e623-openshift-default-5c49548b8d	SuccessfulCreate	Created pod: e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd
23:18:43	openshift-ingress	deployment-controller	e2e-autores-61e623-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-autores-61e623-openshift-default-5c49548b8d from 0 to 1
23:18:43	openshift-ingress	multus	e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	AddedInterface	Add eth0 [10.133.0.46/23] from ovn-kubernetes
23:18:43	openshift-ingress	replicaset-controller	e2e-autores-61e623-openshift-default-5c49548b8d	SuccessfulCreate	Created pod: e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd
23:18:43	opendatahub	kubelet	test-curl-7862-9ee82a	Killing	Stopping container test-curl-7862-9ee82a
23:18:43	openshift-ingress	gateway_labeler_controller	e2e-autores-61e623	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-autores-61e623
23:18:43	openshift-ingress	gateway_labeler_controller	e2e-ait-54be2504	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-54be2504
23:18:43	openshift-ingress	gateway_labeler_controller	e2e-ait-54be2504	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-54be2504
23:18:43	openshift-ingress	replicaset-controller	e2e-ait-54be2504-openshift-default-6b896c678b	SuccessfulCreate	Created pod: e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r
23:18:43	openshift-ingress	deployment-controller	e2e-autores-61e623-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-autores-61e623-openshift-default-5c49548b8d from 0 to 1
23:18:43	openshift-ingress	deployment-controller	e2e-ait-54be2504-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-54be2504-openshift-default-6b896c678b from 0 to 1
23:18:43	openshift-ingress	gateway_labeler_controller	e2e-autores-61e623	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-autores-61e623
23:18:43	openshift-ingress	deployment-controller	e2e-ait-54be2504-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-54be2504-openshift-default-6b896c678b from 0 to 1
23:18:43	openshift-ingress	replicaset-controller	e2e-ait-54be2504-openshift-default-6b896c678b	SuccessfulCreate	Created pod: e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r
23:18:44	openshift-ingress	multus	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	AddedInterface	Add eth0 [10.132.0.48/23] from ovn-kubernetes
23:18:44	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"
23:18:44	openshift-ingress	multus	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	AddedInterface	Add eth0 [10.132.0.48/23] from ovn-kubernetes
23:18:44	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Pulling	Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"
23:18:45	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-autores-61e623 namespace
23:18:46	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.53s (2.53s including waiting). Image size: 181318953 bytes.
23:18:46	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Pulled	Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.53s (2.53s including waiting). Image size: 181318953 bytes.
23:18:48	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ait-54be2504 namespace
23:18:51	openshift-ingress	deployment-controller	payload-processing-e2e-autores-61e623	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-autores-61e623-54fc96f859 from 0 to 1
23:18:51	openshift-ingress	replicaset-controller	payload-processing-e2e-autores-61e623-54fc96f859	SuccessfulCreate	Created pod: payload-processing-e2e-autores-61e623-54fc96f859-lxvv4
23:18:51	openshift-ingress	replicaset-controller	payload-processing-e2e-autores-61e623-54fc96f859	SuccessfulCreate	Created pod: payload-processing-e2e-autores-61e623-54fc96f859-lxvv4
23:18:51 (x6)	openshift-ingress	replicaset-controller	payload-processing-e2e-autores-61e623-54fc96f859	FailedCreate	Error creating: pods "payload-processing-e2e-autores-61e623-54fc96f859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-61e623: serviceaccount "payload-processing-e2e-autores-61e623" not found
23:18:51 (x6)	openshift-ingress	replicaset-controller	payload-processing-e2e-autores-61e623-54fc96f859	FailedCreate	Error creating: pods "payload-processing-e2e-autores-61e623-54fc96f859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-61e623: serviceaccount "payload-processing-e2e-autores-61e623" not found
23:18:51	openshift-ingress	deployment-controller	payload-processing-e2e-autores-61e623	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-autores-61e623-54fc96f859 from 0 to 1
23:18:51 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-autores-61e623-7d5b4749fd	FailedCreate	Error creating: pods "payload-pre-processing-e2e-autores-61e623-7d5b4749fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-61e623: serviceaccount "payload-processing-e2e-autores-61e623" not found
23:18:51	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-autores-61e623-7d5b4749fd	SuccessfulCreate	Created pod: payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl
23:18:51	openshift-ingress	deployment-controller	payload-pre-processing-e2e-autores-61e623	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-autores-61e623-7d5b4749fd from 0 to 1
23:18:51	openshift-ingress	deployment-controller	payload-pre-processing-e2e-autores-61e623	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-autores-61e623-7d5b4749fd from 0 to 1
23:18:51 (x6)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-autores-61e623-7d5b4749fd	FailedCreate	Error creating: pods "payload-pre-processing-e2e-autores-61e623-7d5b4749fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-61e623: serviceaccount "payload-processing-e2e-autores-61e623" not found
23:18:51	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-autores-61e623-7d5b4749fd	SuccessfulCreate	Created pod: payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl
23:18:52	openshift-ingress	kubelet	payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl	Started	Started container payload-pre-processing
23:18:52	openshift-ingress	kubelet	payload-processing-e2e-autores-61e623-54fc96f859-lxvv4	Started	Started container payload-processing
23:18:52	openshift-ingress	kubelet	payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl	Started	Started container payload-pre-processing
23:18:52	openshift-ingress	kubelet	payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl	Created	Created container: payload-pre-processing
23:18:52	openshift-ingress	kubelet	payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:52	openshift-ingress	multus	payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl	AddedInterface	Add eth0 [10.133.0.47/23] from ovn-kubernetes
23:18:52	openshift-ingress	kubelet	payload-processing-e2e-autores-61e623-54fc96f859-lxvv4	Created	Created container: payload-processing
23:18:52	openshift-ingress	multus	payload-processing-e2e-autores-61e623-54fc96f859-lxvv4	AddedInterface	Add eth0 [10.132.0.49/23] from ovn-kubernetes
23:18:52	openshift-ingress	kubelet	payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:52	openshift-ingress	multus	payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl	AddedInterface	Add eth0 [10.133.0.47/23] from ovn-kubernetes
23:18:52	openshift-ingress	kubelet	payload-processing-e2e-autores-61e623-54fc96f859-lxvv4	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:52	openshift-ingress	kubelet	payload-processing-e2e-autores-61e623-54fc96f859-lxvv4	Started	Started container payload-processing
23:18:52	openshift-ingress	kubelet	payload-processing-e2e-autores-61e623-54fc96f859-lxvv4	Created	Created container: payload-processing
23:18:52	openshift-ingress	kubelet	payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl	Created	Created container: payload-pre-processing
23:18:52	openshift-ingress	kubelet	payload-processing-e2e-autores-61e623-54fc96f859-lxvv4	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:52	openshift-ingress	multus	payload-processing-e2e-autores-61e623-54fc96f859-lxvv4	AddedInterface	Add eth0 [10.132.0.49/23] from ovn-kubernetes
23:18:53	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-models-e2e-worker-w0-736809 namespace
23:18:55 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-54be2504-5bd7cc4c7	FailedCreate	Error creating: pods "payload-processing-e2e-ait-54be2504-5bd7cc4c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-54be2504: serviceaccount "payload-processing-e2e-ait-54be2504" not found
23:18:55	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ait-54be2504	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ait-54be2504-7979c6d9d6 from 0 to 1
23:18:55	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ait-54be2504	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ait-54be2504-7979c6d9d6 from 0 to 1
23:18:55	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-54be2504-7979c6d9d6	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp
23:18:55 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-54be2504-5bd7cc4c7	FailedCreate	Error creating: pods "payload-processing-e2e-ait-54be2504-5bd7cc4c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-54be2504: serviceaccount "payload-processing-e2e-ait-54be2504" not found
23:18:55	openshift-ingress	deployment-controller	payload-processing-e2e-ait-54be2504	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ait-54be2504-5bd7cc4c7 from 0 to 1
23:18:55	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-54be2504-7979c6d9d6	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp
23:18:55 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-54be2504-7979c6d9d6	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-54be2504: serviceaccount "payload-processing-e2e-ait-54be2504" not found
23:18:55	openshift-ingress	deployment-controller	payload-processing-e2e-ait-54be2504	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ait-54be2504-5bd7cc4c7 from 0 to 1
23:18:55	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-54be2504-5bd7cc4c7	SuccessfulCreate	Created pod: payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49
23:18:55 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-54be2504-7979c6d9d6	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-54be2504: serviceaccount "payload-processing-e2e-ait-54be2504" not found
23:18:55	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-54be2504-5bd7cc4c7	SuccessfulCreate	Created pod: payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49
23:18:56	openshift-ingress	multus	payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp	AddedInterface	Add eth0 [10.132.0.50/23] from ovn-kubernetes
23:18:56	openshift-ingress	kubelet	payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:56	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp	Created	Created container: payload-pre-processing
23:18:56	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:56	openshift-ingress	multus	payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49	AddedInterface	Add eth0 [10.132.0.51/23] from ovn-kubernetes
23:18:56	openshift-ingress	multus	payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp	AddedInterface	Add eth0 [10.132.0.50/23] from ovn-kubernetes
23:18:56	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp	Started	Started container payload-pre-processing
23:18:56	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp	Created	Created container: payload-pre-processing
23:18:56	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:56	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp	Started	Started container payload-pre-processing
23:18:56	openshift-ingress	kubelet	payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49	Created	Created container: payload-processing
23:18:56	openshift-ingress	kubelet	payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49	Started	Started container payload-processing
23:18:56	openshift-ingress	kubelet	payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49	Started	Started container payload-processing
23:18:56	openshift-ingress	multus	payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49	AddedInterface	Add eth0 [10.132.0.51/23] from ovn-kubernetes
23:18:56	openshift-ingress	kubelet	payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:18:56	openshift-ingress	kubelet	payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49	Created	Created container: payload-processing
23:18:57	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-models-e2e-worker-w4-825f30 namespace
23:18:59 (x2)	openshift-ingress	kubelet	e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	Created	Created container: istio-proxy
23:18:59 (x2)	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:18:59 (x2)	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	Started	Started container istio-proxy
23:18:59 (x2)	openshift-ingress	kubelet	e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:18:59 (x2)	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	Created	Created container: istio-proxy
23:18:59 (x2)	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:18:59 (x2)	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	Started	Started container istio-proxy
23:18:59 (x2)	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	Created	Created container: istio-proxy
23:18:59 (x2)	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	Started	Started container istio-proxy
23:18:59 (x2)	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	Created	Created container: istio-proxy
23:18:59 (x2)	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:18:59 (x2)	openshift-ingress	kubelet	e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	Started	Started container istio-proxy
23:18:59 (x2)	openshift-ingress	kubelet	e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	Created	Created container: istio-proxy
23:18:59 (x2)	openshift-ingress	kubelet	e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:18:59 (x2)	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	Started	Started container istio-proxy
23:18:59 (x2)	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	Created	Created container: istio-proxy
23:18:59 (x2)	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:18:59 (x2)	openshift-ingress	kubelet	e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	Started	Started container istio-proxy
23:19:02	openshift-ingress	deployment-controller	e2e-inf-b-f38e68-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-b-f38e68-openshift-default-9dff74fb8 from 0 to 1
23:19:02	openshift-ingress	replicaset-controller	e2e-inf-b-f38e68-openshift-default-9dff74fb8	SuccessfulCreate	Created pod: e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4
23:19:02	openshift-ingress	replicaset-controller	e2e-inf-b-f38e68-openshift-default-9dff74fb8	SuccessfulCreate	Created pod: e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4
23:19:02	openshift-ingress	gateway_labeler_controller	e2e-inf-b-f38e68	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-f38e68
23:19:02	openshift-ingress	gateway_labeler_controller	e2e-inf-b-f38e68	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-f38e68
23:19:02	openshift-ingress	deployment-controller	e2e-inf-b-f38e68-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-inf-b-f38e68-openshift-default-9dff74fb8 from 0 to 1
23:19:03	openshift-ingress	multus	e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	AddedInterface	Add eth0 [10.133.0.48/23] from ovn-kubernetes
23:19:03	openshift-ingress	multus	e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	AddedInterface	Add eth0 [10.133.0.48/23] from ovn-kubernetes
23:19:05 (x6)	openshift-ingress	kubelet	e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	Unhealthy	Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
23:19:05 (x6)	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	Unhealthy	Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
23:19:05 (x6)	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	ProbeError	Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
23:19:05 (x6)	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	ProbeError	Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
23:19:05 (x6)	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	Unhealthy	Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
23:19:05 (x6)	openshift-ingress	kubelet	e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	ProbeError	Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
23:19:05 (x6)	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	ProbeError	Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
23:19:05 (x6)	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	Unhealthy	Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
23:19:05 (x6)	openshift-ingress	kubelet	e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	ProbeError	Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
23:19:05 (x6)	openshift-ingress	kubelet	e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	Unhealthy	Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
23:19:05 (x6)	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	Unhealthy	Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
23:19:05 (x6)	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	ProbeError	Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
23:19:06	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-inf-b-f38e68 namespace
23:19:09	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-b-f38e68-5d4f46496c	SuccessfulCreate	Created pod: payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv
23:19:09	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-b-f38e68-5df67f69db	SuccessfulCreate	Created pod: payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg
23:19:09 (x2)	openshift-ingress	kubelet	e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:19:09	openshift-ingress	deployment-controller	payload-pre-processing-e2e-inf-b-f38e68	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-inf-b-f38e68-5df67f69db from 0 to 1
23:19:09	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-b-f38e68-5df67f69db	SuccessfulCreate	Created pod: payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg
23:19:09 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-b-f38e68-5df67f69db	FailedCreate	Error creating: pods "payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f38e68: serviceaccount "payload-processing-e2e-inf-b-f38e68" not found
23:19:09	openshift-ingress	deployment-controller	payload-processing-e2e-inf-b-f38e68	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-inf-b-f38e68-5d4f46496c from 0 to 1
23:19:09 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-b-f38e68-5d4f46496c	FailedCreate	Error creating: pods "payload-processing-e2e-inf-b-f38e68-5d4f46496c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f38e68: serviceaccount "payload-processing-e2e-inf-b-f38e68" not found
23:19:09 (x2)	openshift-ingress	kubelet	e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	Created	Created container: istio-proxy
23:19:09	openshift-ingress	deployment-controller	payload-processing-e2e-inf-b-f38e68	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-inf-b-f38e68-5d4f46496c from 0 to 1
23:19:09	openshift-ingress	deployment-controller	payload-pre-processing-e2e-inf-b-f38e68	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-inf-b-f38e68-5df67f69db from 0 to 1
23:19:09 (x2)	openshift-ingress	kubelet	e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:19:09 (x2)	openshift-ingress	kubelet	e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	Created	Created container: istio-proxy
23:19:09 (x2)	openshift-ingress	kubelet	e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	Started	Started container istio-proxy
23:19:09 (x2)	openshift-ingress	kubelet	e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	Started	Started container istio-proxy
23:19:09 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-b-f38e68-5d4f46496c	FailedCreate	Error creating: pods "payload-processing-e2e-inf-b-f38e68-5d4f46496c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f38e68: serviceaccount "payload-processing-e2e-inf-b-f38e68" not found
23:19:09 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-inf-b-f38e68-5df67f69db	FailedCreate	Error creating: pods "payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-f38e68: serviceaccount "payload-processing-e2e-inf-b-f38e68" not found
23:19:09	openshift-ingress	replicaset-controller	payload-processing-e2e-inf-b-f38e68-5d4f46496c	SuccessfulCreate	Created pod: payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv
23:19:10	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:19:10	openshift-ingress	multus	payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv	AddedInterface	Add eth0 [10.132.0.52/23] from ovn-kubernetes
23:19:10	openshift-ingress	multus	payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv	AddedInterface	Add eth0 [10.132.0.52/23] from ovn-kubernetes
23:19:10	openshift-ingress	kubelet	payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:19:10	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg	Started	Started container payload-pre-processing
23:19:10	openshift-ingress	kubelet	payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv	Started	Started container payload-processing
23:19:10	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg	Created	Created container: payload-pre-processing
23:19:10	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:19:10	openshift-ingress	multus	payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg	AddedInterface	Add eth0 [10.133.0.49/23] from ovn-kubernetes
23:19:10	openshift-ingress	kubelet	payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv	Created	Created container: payload-processing
23:19:10	openshift-ingress	kubelet	payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:19:10	openshift-ingress	kubelet	payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv	Created	Created container: payload-processing
23:19:10	openshift-ingress	kubelet	payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv	Started	Started container payload-processing
23:19:10	openshift-ingress	multus	payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg	AddedInterface	Add eth0 [10.133.0.49/23] from ovn-kubernetes
23:19:10	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg	Started	Started container payload-pre-processing
23:19:10	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg	Created	Created container: payload-pre-processing
23:19:12	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-webhook-test-3a44fd namespace
23:19:15 (x6)	openshift-ingress	kubelet	e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	ProbeError	Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
23:19:15 (x6)	openshift-ingress	kubelet	e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	Unhealthy	Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
23:19:15 (x6)	openshift-ingress	kubelet	e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	ProbeError	Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
23:19:15 (x6)	openshift-ingress	kubelet	e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	Unhealthy	Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
23:19:18	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Unhealthy	Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": read tcp 10.132.0.2:45764->10.132.0.48:15021: read: connection reset by peer
23:19:18	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	ProbeError	Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": read tcp 10.132.0.2:45764->10.132.0.48:15021: read: connection reset by peer body:
23:19:18	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	ProbeError	Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": read tcp 10.132.0.2:45764->10.132.0.48:15021: read: connection reset by peer body:
23:19:18	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Unhealthy	Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": read tcp 10.132.0.2:45764->10.132.0.48:15021: read: connection reset by peer
23:19:19 (x2)	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Created	Created container: istio-proxy
23:19:19	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:19:19 (x2)	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Started	Started container istio-proxy
23:19:19	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-webhook-test-3819af namespace
23:19:19	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:19:19 (x2)	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Created	Created container: istio-proxy
23:19:19 (x2)	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Started	Started container istio-proxy
23:19:24 (x5)	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	ProbeError	Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
23:19:24 (x5)	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Unhealthy	Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
23:19:24 (x5)	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Unhealthy	Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
23:19:24 (x5)	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	ProbeError	Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
23:19:30 (x2)	openshift-ingress	kubelet	e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:19:30	openshift-ingress	endpoint-controller	payload-pre-processing-e2e-ait-54be2504	FailedToUpdateEndpoint	Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-54be2504: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-54be2504": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-54be2504, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f738c83e-aaf7-4539-8fa3-1bdc2fb23dfe, UID in object meta:
23:19:30	openshift-ingress	endpoint-controller	payload-pre-processing-e2e-ait-54be2504	FailedToUpdateEndpoint	Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-54be2504: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-54be2504": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-54be2504, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f738c83e-aaf7-4539-8fa3-1bdc2fb23dfe, UID in object meta:
23:19:30	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Killing	Stopping container istio-proxy
23:19:30	openshift-ingress	kubelet	payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49	Killing	Stopping container payload-processing
23:19:30	openshift-ingress	kubelet	payload-processing-e2e-ait-54be2504-5bd7cc4c7-bdq49	Killing	Stopping container payload-processing
23:19:30	openshift-ingress	kubelet	e2e-ait-54be2504-openshift-default-6b896c678b-zvb6r	Killing	Stopping container istio-proxy
23:19:30	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp	Killing	Stopping container payload-pre-processing
23:19:30 (x2)	openshift-ingress	kubelet	e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	Created	Created container: istio-proxy
23:19:30 (x2)	openshift-ingress	kubelet	e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:19:30 (x2)	openshift-ingress	kubelet	e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	Created	Created container: istio-proxy
23:19:30 (x2)	openshift-ingress	kubelet	e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	Started	Started container istio-proxy
23:19:30 (x2)	openshift-ingress	kubelet	e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	Started	Started container istio-proxy
23:19:30	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-54be2504-7979c6d9d6-6pwmp	Killing	Stopping container payload-pre-processing
23:19:31	openshift-ingress	replicaset-controller	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48	SuccessfulCreate	Created pod: e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs
23:19:31	openshift-ingress	replicaset-controller	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48	SuccessfulCreate	Created pod: e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs
23:19:31	openshift-ingress	gateway_labeler_controller	e2e-migrate-eb3352f3-gw	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-eb3352f3-gw
23:19:31	openshift-ingress	gateway_labeler_controller	e2e-migrate-eb3352f3-gw	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-eb3352f3-gw
23:19:31	openshift-ingress	deployment-controller	e2e-migrate-eb3352f3-gw-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48 from 0 to 1
23:19:31	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-migrate-eb3352f3 namespace
23:19:31	openshift-ingress	deployment-controller	e2e-migrate-eb3352f3-gw-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48 from 0 to 1
23:19:32	openshift-ingress	multus	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	AddedInterface	Add eth0 [10.132.0.53/23] from ovn-kubernetes
23:19:32	openshift-ingress	multus	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	AddedInterface	Add eth0 [10.132.0.53/23] from ovn-kubernetes
23:19:36 (x6)	openshift-ingress	kubelet	e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	Unhealthy	Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
23:19:36 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-migrate-eb3352f3-5fc8458b6b	FailedCreate	Error creating: pods "payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-eb3352f3: serviceaccount "payload-processing-e2e-migrate-eb3352f3" not found
23:19:36	openshift-ingress	deployment-controller	payload-pre-processing-e2e-migrate-eb3352f3	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d from 0 to 1
23:19:36	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d	SuccessfulCreate	Created pod: payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r
23:19:36 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d	FailedCreate	Error creating: pods "payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-eb3352f3: serviceaccount "payload-processing-e2e-migrate-eb3352f3" not found
23:19:36 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-migrate-eb3352f3-5fc8458b6b	FailedCreate	Error creating: pods "payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-eb3352f3: serviceaccount "payload-processing-e2e-migrate-eb3352f3" not found
23:19:36	openshift-ingress	replicaset-controller	payload-processing-e2e-migrate-eb3352f3-5fc8458b6b	SuccessfulCreate	Created pod: payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc
23:19:36 (x6)	openshift-ingress	kubelet	e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	ProbeError	Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
23:19:36 (x6)	openshift-ingress	kubelet	e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	ProbeError	Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
23:19:36 (x6)	openshift-ingress	kubelet	e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	Unhealthy	Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
23:19:36	openshift-ingress	deployment-controller	payload-processing-e2e-migrate-eb3352f3	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-migrate-eb3352f3-5fc8458b6b from 0 to 1
23:19:36	openshift-ingress	deployment-controller	payload-processing-e2e-migrate-eb3352f3	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-migrate-eb3352f3-5fc8458b6b from 0 to 1
23:19:36	openshift-ingress	replicaset-controller	payload-processing-e2e-migrate-eb3352f3-5fc8458b6b	SuccessfulCreate	Created pod: payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc
23:19:36	openshift-ingress	deployment-controller	payload-pre-processing-e2e-migrate-eb3352f3	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d from 0 to 1
23:19:36	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d	SuccessfulCreate	Created pod: payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r
23:19:36 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d	FailedCreate	Error creating: pods "payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-eb3352f3: serviceaccount "payload-processing-e2e-migrate-eb3352f3" not found
23:19:37	openshift-ingress	kubelet	payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:19:37	openshift-ingress	kubelet	payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc	Started	Started container payload-processing
23:19:37	openshift-ingress	kubelet	payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r	Created	Created container: payload-pre-processing
23:19:37	openshift-ingress	kubelet	payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:19:37	openshift-ingress	multus	payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r	AddedInterface	Add eth0 [10.132.0.54/23] from ovn-kubernetes
23:19:37	openshift-ingress	kubelet	payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc	Started	Started container payload-processing
23:19:37	openshift-ingress	kubelet	payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r	Started	Started container payload-pre-processing
23:19:37	openshift-ingress	kubelet	payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r	Created	Created container: payload-pre-processing
23:19:37	openshift-ingress	kubelet	payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc	Created	Created container: payload-processing
23:19:37	openshift-ingress	kubelet	payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:19:37	openshift-ingress	multus	payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc	AddedInterface	Add eth0 [10.132.0.55/23] from ovn-kubernetes
23:19:37	openshift-ingress	multus	payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc	AddedInterface	Add eth0 [10.132.0.55/23] from ovn-kubernetes
23:19:37	openshift-ingress	multus	payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r	AddedInterface	Add eth0 [10.132.0.54/23] from ovn-kubernetes
23:19:37	openshift-ingress	kubelet	payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:19:37	openshift-ingress	kubelet	payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc	Created	Created container: payload-processing
23:19:37	openshift-ingress	kubelet	payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r	Started	Started container payload-pre-processing
23:19:53 (x2)	openshift-ingress	kubelet	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	Started	Started container istio-proxy
23:19:53 (x2)	openshift-ingress	kubelet	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	Created	Created container: istio-proxy
23:19:53 (x2)	openshift-ingress	kubelet	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:19:53 (x2)	openshift-ingress	kubelet	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	Started	Started container istio-proxy
23:19:53 (x2)	openshift-ingress	kubelet	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:19:53 (x2)	openshift-ingress	kubelet	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	Created	Created container: istio-proxy
23:19:59 (x5)	openshift-ingress	kubelet	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	ProbeError	Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
23:19:59 (x5)	openshift-ingress	kubelet	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	ProbeError	Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
23:19:59 (x5)	openshift-ingress	kubelet	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	Unhealthy	Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
23:19:59 (x5)	openshift-ingress	kubelet	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	Unhealthy	Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
23:20:06	openshift-ingress	kubelet	payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r	Killing	Stopping container payload-pre-processing
23:20:06	openshift-ingress	kubelet	payload-pre-processing-e2e-migrate-eb3352f3-76cfbbb57d-z487r	Killing	Stopping container payload-pre-processing
23:20:06	openshift-ingress	kubelet	payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc	Killing	Stopping container payload-processing
23:20:06	openshift-ingress	kubelet	payload-processing-e2e-migrate-eb3352f3-5fc8458b6b-nvgrc	Killing	Stopping container payload-processing
23:20:07	openshift-ingress	gateway_labeler_controller	e2e-ait-5ab8e6b6	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5ab8e6b6
23:20:07	openshift-ingress	replicaset-controller	e2e-ait-5ab8e6b6-openshift-default-cfbb585d	SuccessfulCreate	Created pod: e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh
23:20:07	openshift-ingress	gateway_labeler_controller	e2e-ait-5ab8e6b6	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5ab8e6b6
23:20:07	openshift-ingress	replicaset-controller	e2e-ait-5ab8e6b6-openshift-default-cfbb585d	SuccessfulCreate	Created pod: e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh
23:20:07	openshift-ingress	deployment-controller	e2e-ait-5ab8e6b6-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-5ab8e6b6-openshift-default-cfbb585d from 0 to 1
23:20:07	openshift-ingress	deployment-controller	e2e-ait-5ab8e6b6-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ait-5ab8e6b6-openshift-default-cfbb585d from 0 to 1
23:20:07	openshift-ingress	kubelet	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	Killing	Stopping container istio-proxy
23:20:07	openshift-ingress	kubelet	e2e-migrate-eb3352f3-gw-openshift-default-86dc568c48-qm7hs	Killing	Stopping container istio-proxy
23:20:08	openshift-ingress	multus	e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	AddedInterface	Add eth0 [10.132.0.56/23] from ovn-kubernetes
23:20:08	openshift-ingress	multus	e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	AddedInterface	Add eth0 [10.132.0.56/23] from ovn-kubernetes
23:20:10	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ait-5ab8e6b6 namespace
23:20:12	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ait-5ab8e6b6	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b from 0 to 1
23:20:12 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7	FailedCreate	Error creating: pods "payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5ab8e6b6: serviceaccount "payload-processing-e2e-ait-5ab8e6b6" not found
23:20:12	openshift-ingress	deployment-controller	payload-processing-e2e-ait-5ab8e6b6	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7 from 0 to 1
23:20:12 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5ab8e6b6: serviceaccount "payload-processing-e2e-ait-5ab8e6b6" not found
23:20:12	openshift-ingress	deployment-controller	payload-processing-e2e-ait-5ab8e6b6	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7 from 0 to 1
23:20:12	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ait-5ab8e6b6	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b from 0 to 1
23:20:12 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7	FailedCreate	Error creating: pods "payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5ab8e6b6: serviceaccount "payload-processing-e2e-ait-5ab8e6b6" not found
23:20:12 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5ab8e6b6: serviceaccount "payload-processing-e2e-ait-5ab8e6b6" not found
23:20:13	openshift-ingress	multus	payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg	AddedInterface	Add eth0 [10.132.0.57/23] from ovn-kubernetes
23:20:13	openshift-ingress	kubelet	payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr	Created	Created container: payload-processing
23:20:13	openshift-ingress	multus	payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg	AddedInterface	Add eth0 [10.132.0.57/23] from ovn-kubernetes
23:20:13	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:20:13	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg	Started	Started container payload-pre-processing
23:20:13	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg
23:20:13	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7	SuccessfulCreate	Created pod: payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr
23:20:13	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg	Created	Created container: payload-pre-processing
23:20:13	openshift-ingress	replicaset-controller	payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7	SuccessfulCreate	Created pod: payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr
23:20:13	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg
23:20:13	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:20:13	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg	Created	Created container: payload-pre-processing
23:20:13	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg	Started	Started container payload-pre-processing
23:20:13	openshift-ingress	kubelet	payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr	Started	Started container payload-processing
23:20:13	openshift-ingress	kubelet	payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:20:13	openshift-ingress	multus	payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr	AddedInterface	Add eth0 [10.132.0.58/23] from ovn-kubernetes
23:20:13	openshift-ingress	multus	payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr	AddedInterface	Add eth0 [10.132.0.58/23] from ovn-kubernetes
23:20:13	openshift-ingress	kubelet	payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:20:13	openshift-ingress	kubelet	payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr	Created	Created container: payload-processing
23:20:13	openshift-ingress	kubelet	payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr	Started	Started container payload-processing
23:20:33 (x2)	openshift-ingress	kubelet	e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	Started	Started container istio-proxy
23:20:33 (x2)	openshift-ingress	kubelet	e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	Created	Created container: istio-proxy
23:20:33 (x2)	openshift-ingress	kubelet	e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:20:33 (x2)	openshift-ingress	kubelet	e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	Created	Created container: istio-proxy
23:20:33 (x2)	openshift-ingress	kubelet	e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:20:33 (x2)	openshift-ingress	kubelet	e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	Started	Started container istio-proxy
23:20:39 (x5)	openshift-ingress	kubelet	e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	ProbeError	Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
23:20:39 (x5)	openshift-ingress	kubelet	e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	ProbeError	Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
23:20:39 (x5)	openshift-ingress	kubelet	e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	Unhealthy	Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
23:20:39 (x5)	openshift-ingress	kubelet	e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	Unhealthy	Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
23:20:42	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg	Killing	Stopping container payload-pre-processing
23:20:42	openshift-ingress	kubelet	payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr	Killing	Stopping container payload-processing
23:20:42	openshift-ingress	kubelet	payload-processing-e2e-ait-5ab8e6b6-7d55d8f5c7-c6wpr	Killing	Stopping container payload-processing
23:20:42	openshift-ingress	kubelet	payload-pre-processing-e2e-ait-5ab8e6b6-fb9bbd6b-d4qdg	Killing	Stopping container payload-pre-processing
23:20:43	openshift-ingress	kubelet	e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	Killing	Stopping container istio-proxy
23:20:43	openshift-ingress	kubelet	e2e-ait-5ab8e6b6-openshift-default-cfbb585d-r2tlh	Killing	Stopping container istio-proxy
23:20:44	openshift-ingress	gateway_labeler_controller	e2e-derive-46ccf8cf	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-derive-46ccf8cf
23:20:44	openshift-ingress	replicaset-controller	e2e-derive-46ccf8cf-openshift-default-6859757964	SuccessfulCreate	Created pod: e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m
23:20:44	openshift-ingress	multus	e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	AddedInterface	Add eth0 [10.132.0.59/23] from ovn-kubernetes
23:20:44	openshift-ingress	gateway_labeler_controller	e2e-derive-46ccf8cf	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-derive-46ccf8cf
23:20:44	openshift-ingress	deployment-controller	e2e-derive-46ccf8cf-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-derive-46ccf8cf-openshift-default-6859757964 from 0 to 1
23:20:44	openshift-ingress	replicaset-controller	e2e-derive-46ccf8cf-openshift-default-6859757964	SuccessfulCreate	Created pod: e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m
23:20:44	openshift-ingress	deployment-controller	e2e-derive-46ccf8cf-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-derive-46ccf8cf-openshift-default-6859757964 from 0 to 1
23:20:44	openshift-ingress	multus	e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	AddedInterface	Add eth0 [10.132.0.59/23] from ovn-kubernetes
23:20:47	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-derive-46ccf8cf namespace
23:20:52	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-derive-46ccf8cf-94944b954	SuccessfulCreate	Created pod: payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9
23:20:52	openshift-ingress	multus	payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9	AddedInterface	Add eth0 [10.132.0.60/23] from ovn-kubernetes
23:20:52 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-derive-46ccf8cf-75bd986b65	FailedCreate	Error creating: pods "payload-processing-e2e-derive-46ccf8cf-75bd986b65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-46ccf8cf: serviceaccount "payload-processing-e2e-derive-46ccf8cf" not found
23:20:52	openshift-ingress	replicaset-controller	payload-processing-e2e-derive-46ccf8cf-75bd986b65	SuccessfulCreate	Created pod: payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g
23:20:52	openshift-ingress	kubelet	payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g	Created	Created container: payload-processing
23:20:52	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-derive-46ccf8cf-94944b954	SuccessfulCreate	Created pod: payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9
23:20:52	openshift-ingress	deployment-controller	payload-pre-processing-e2e-derive-46ccf8cf	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-derive-46ccf8cf-94944b954 from 0 to 1
23:20:52	openshift-ingress	kubelet	payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:20:52	openshift-ingress	kubelet	payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9	Started	Started container payload-pre-processing
23:20:52	openshift-ingress	kubelet	payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9	Created	Created container: payload-pre-processing
23:20:52	openshift-ingress	kubelet	payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:20:52	openshift-ingress	multus	payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9	AddedInterface	Add eth0 [10.132.0.60/23] from ovn-kubernetes
23:20:52	openshift-ingress	deployment-controller	payload-processing-e2e-derive-46ccf8cf	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-derive-46ccf8cf-75bd986b65 from 0 to 1
23:20:52	openshift-ingress	replicaset-controller	payload-processing-e2e-derive-46ccf8cf-75bd986b65	SuccessfulCreate	Created pod: payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g
23:20:52 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-derive-46ccf8cf-75bd986b65	FailedCreate	Error creating: pods "payload-processing-e2e-derive-46ccf8cf-75bd986b65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-46ccf8cf: serviceaccount "payload-processing-e2e-derive-46ccf8cf" not found
23:20:52	openshift-ingress	kubelet	payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g	Started	Started container payload-processing
23:20:52	openshift-ingress	kubelet	payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g	Created	Created container: payload-processing
23:20:52	openshift-ingress	kubelet	payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:20:52	openshift-ingress	multus	payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g	AddedInterface	Add eth0 [10.132.0.61/23] from ovn-kubernetes
23:20:52	openshift-ingress	kubelet	payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g	Started	Started container payload-processing
23:20:52	openshift-ingress	kubelet	payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:20:52	openshift-ingress	kubelet	payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9	Created	Created container: payload-pre-processing
23:20:52	openshift-ingress	kubelet	payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9	Started	Started container payload-pre-processing
23:20:52 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-derive-46ccf8cf-94944b954	FailedCreate	Error creating: pods "payload-pre-processing-e2e-derive-46ccf8cf-94944b954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-46ccf8cf: serviceaccount "payload-processing-e2e-derive-46ccf8cf" not found
23:20:52 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-derive-46ccf8cf-94944b954	FailedCreate	Error creating: pods "payload-pre-processing-e2e-derive-46ccf8cf-94944b954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-46ccf8cf: serviceaccount "payload-processing-e2e-derive-46ccf8cf" not found
23:20:52	openshift-ingress	deployment-controller	payload-processing-e2e-derive-46ccf8cf	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-derive-46ccf8cf-75bd986b65 from 0 to 1
23:20:52	openshift-ingress	deployment-controller	payload-pre-processing-e2e-derive-46ccf8cf	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-derive-46ccf8cf-94944b954 from 0 to 1
23:20:52	openshift-ingress	multus	payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g	AddedInterface	Add eth0 [10.132.0.61/23] from ovn-kubernetes
23:21:07 (x2)	openshift-ingress	kubelet	e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	Created	Created container: istio-proxy
23:21:07 (x2)	openshift-ingress	kubelet	e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:21:07 (x2)	openshift-ingress	kubelet	e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	Started	Started container istio-proxy
23:21:07 (x2)	openshift-ingress	kubelet	e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	Created	Created container: istio-proxy
23:21:07 (x2)	openshift-ingress	kubelet	e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	Started	Started container istio-proxy
23:21:07 (x2)	openshift-ingress	kubelet	e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:21:13 (x5)	openshift-ingress	kubelet	e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	Unhealthy	Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
23:21:13 (x5)	openshift-ingress	kubelet	e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	ProbeError	Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
23:21:13 (x5)	openshift-ingress	kubelet	e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	Unhealthy	Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
23:21:13 (x5)	openshift-ingress	kubelet	e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	ProbeError	Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
23:21:21	openshift-ingress	kubelet	payload-processing-e2e-autores-61e623-54fc96f859-lxvv4	Killing	Stopping container payload-processing
23:21:21	openshift-ingress	kubelet	payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl	Killing	Stopping container payload-pre-processing
23:21:21	openshift-ingress	kubelet	payload-processing-e2e-autores-61e623-54fc96f859-lxvv4	Killing	Stopping container payload-processing
23:21:21	openshift-ingress	kubelet	payload-pre-processing-e2e-autores-61e623-7d5b4749fd-qpghl	Killing	Stopping container payload-pre-processing
23:21:21	openshift-ingress	endpoint-controller	payload-pre-processing-e2e-autores-61e623	FailedToUpdateEndpoint	Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-61e623: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-61e623": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-61e623, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9ec9efe3-6512-470f-aac2-34800dae30b4, UID in object meta:
23:21:21	openshift-ingress	endpoint-controller	payload-pre-processing-e2e-autores-61e623	FailedToUpdateEndpoint	Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-61e623: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-61e623": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-61e623, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9ec9efe3-6512-470f-aac2-34800dae30b4, UID in object meta:
23:21:29	openshift-ingress	kubelet	payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9	Killing	Stopping container payload-pre-processing
23:21:29	openshift-ingress	kubelet	e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	Killing	Stopping container istio-proxy
23:21:29	openshift-ingress	kubelet	payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g	Killing	Stopping container payload-processing
23:21:29	openshift-ingress	kubelet	payload-pre-processing-e2e-derive-46ccf8cf-94944b954-4bbb9	Killing	Stopping container payload-pre-processing
23:21:29	openshift-ingress	kubelet	e2e-derive-46ccf8cf-openshift-default-6859757964-2q88m	Killing	Stopping container istio-proxy
23:21:29	openshift-ingress	kubelet	payload-processing-e2e-derive-46ccf8cf-75bd986b65-qkb4g	Killing	Stopping container payload-processing
23:21:30	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-87cce84d namespace
23:21:37	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-cbff1fe6 namespace
23:22:04	openshift-ingress	gateway_labeler_controller	e2e-explicit-35df6d	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-35df6d
23:22:04	openshift-ingress	kubelet	e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	Killing	Stopping container istio-proxy
23:22:04	openshift-ingress	gateway_labeler_controller	e2e-explicit-35df6d	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-35df6d
23:22:04	openshift-ingress	kubelet	e2e-autores-61e623-openshift-default-5c49548b8d-jnzxd	Killing	Stopping container istio-proxy
23:22:05	openshift-ingress	multus	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	AddedInterface	Add eth0 [10.132.0.63/23] from ovn-kubernetes
23:22:05	openshift-ingress	replicaset-controller	e2e-explicit-35df6d-openshift-default-6cccb6d8dd	SuccessfulCreate	Created pod: e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz
23:22:05	openshift-ingress	deployment-controller	e2e-explicit-35df6d-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-explicit-35df6d-openshift-default-6cccb6d8dd from 0 to 1
23:22:05	openshift-ingress	replicaset-controller	e2e-explicit-35df6d-openshift-default-6cccb6d8dd	SuccessfulCreate	Created pod: e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz
23:22:05	openshift-ingress	multus	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	AddedInterface	Add eth0 [10.132.0.63/23] from ovn-kubernetes
23:22:05	openshift-ingress	deployment-controller	e2e-explicit-35df6d-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-explicit-35df6d-openshift-default-6cccb6d8dd from 0 to 1
23:22:08	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-explicit-35df6d namespace
23:22:10	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-unlabeled-d43aa542 namespace
23:22:12	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-explicit-35df6d-c96747fc4	SuccessfulCreate	Created pod: payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w
23:22:12	openshift-ingress	replicaset-controller	payload-processing-e2e-explicit-35df6d-66f95dfccc	SuccessfulCreate	Created pod: payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4
23:22:12	openshift-ingress	deployment-controller	payload-processing-e2e-explicit-35df6d	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-explicit-35df6d-66f95dfccc from 0 to 1
23:22:12	openshift-ingress	deployment-controller	payload-pre-processing-e2e-explicit-35df6d	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-explicit-35df6d-c96747fc4 from 0 to 1
23:22:12	openshift-ingress	deployment-controller	payload-processing-e2e-explicit-35df6d	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-explicit-35df6d-66f95dfccc from 0 to 1
23:22:12 (x5)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-explicit-35df6d-c96747fc4	FailedCreate	Error creating: pods "payload-pre-processing-e2e-explicit-35df6d-c96747fc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-35df6d: serviceaccount "payload-processing-e2e-explicit-35df6d" not found
23:22:12	openshift-ingress	deployment-controller	payload-pre-processing-e2e-explicit-35df6d	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-explicit-35df6d-c96747fc4 from 0 to 1
23:22:12 (x5)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-explicit-35df6d-c96747fc4	FailedCreate	Error creating: pods "payload-pre-processing-e2e-explicit-35df6d-c96747fc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-35df6d: serviceaccount "payload-processing-e2e-explicit-35df6d" not found
23:22:12 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-explicit-35df6d-66f95dfccc	FailedCreate	Error creating: pods "payload-processing-e2e-explicit-35df6d-66f95dfccc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-35df6d: serviceaccount "payload-processing-e2e-explicit-35df6d" not found
23:22:12	openshift-ingress	replicaset-controller	payload-processing-e2e-explicit-35df6d-66f95dfccc	SuccessfulCreate	Created pod: payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4
23:22:12 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-explicit-35df6d-66f95dfccc	FailedCreate	Error creating: pods "payload-processing-e2e-explicit-35df6d-66f95dfccc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-35df6d: serviceaccount "payload-processing-e2e-explicit-35df6d" not found
23:22:12	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-explicit-35df6d-c96747fc4	SuccessfulCreate	Created pod: payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w
23:22:13	openshift-ingress	kubelet	payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:22:13	openshift-ingress	kubelet	payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:22:13	openshift-ingress	kubelet	payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4	Created	Created container: payload-processing
23:22:13	openshift-ingress	multus	payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4	AddedInterface	Add eth0 [10.132.0.65/23] from ovn-kubernetes
23:22:13	openshift-ingress	kubelet	payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:22:13	openshift-ingress	kubelet	payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4	Started	Started container payload-processing
23:22:13	openshift-ingress	kubelet	payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w	Created	Created container: payload-pre-processing
23:22:13	openshift-ingress	kubelet	payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w	Started	Started container payload-pre-processing
23:22:13	openshift-ingress	kubelet	payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4	Started	Started container payload-processing
23:22:13	openshift-ingress	kubelet	payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4	Created	Created container: payload-processing
23:22:13	openshift-ingress	kubelet	payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w	Started	Started container payload-pre-processing
23:22:13	openshift-ingress	multus	payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4	AddedInterface	Add eth0 [10.132.0.65/23] from ovn-kubernetes
23:22:13	openshift-ingress	multus	payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w	AddedInterface	Add eth0 [10.132.0.66/23] from ovn-kubernetes
23:22:13	openshift-ingress	multus	payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w	AddedInterface	Add eth0 [10.132.0.66/23] from ovn-kubernetes
23:22:13	openshift-ingress	kubelet	payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:22:13	openshift-ingress	kubelet	payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w	Created	Created container: payload-pre-processing
23:22:32 (x2)	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:22:32	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-acaf2ad6 namespace
23:22:32 (x2)	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	Started	Started container istio-proxy
23:22:32 (x2)	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	Created	Created container: istio-proxy
23:22:32 (x2)	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:22:32 (x2)	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	Created	Created container: istio-proxy
23:22:32 (x2)	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	Started	Started container istio-proxy
23:22:37 (x4)	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	Unhealthy	Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
23:22:37 (x4)	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	Unhealthy	Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
23:22:37 (x4)	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	ProbeError	Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
23:22:37 (x4)	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	ProbeError	Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
23:22:49	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-27ac9fa4 namespace
23:22:50	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-64952d0e namespace
23:23:04	openshift-ingress	replicaset-controller	e2e-mt-85682bb8-openshift-default-9677fcd68	SuccessfulCreate	Created pod: e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq
23:23:04	openshift-ingress	GatewayAuthBootstrap	e2e-mt-85682bb8	ReconcileError	Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-85682bb8-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-85682bb8-authn-ssl" already exists
23:23:04	openshift-ingress	gateway_labeler_controller	e2e-mt-85682bb8	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-mt-85682bb8
23:23:04	openshift-ingress	deployment-controller	e2e-mt-85682bb8-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-85682bb8-openshift-default-9677fcd68 from 0 to 1
23:23:04	openshift-ingress	replicaset-controller	e2e-mt-85682bb8-openshift-default-9677fcd68	SuccessfulCreate	Created pod: e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq
23:23:04	openshift-ingress	GatewayAuthBootstrap	e2e-mt-85682bb8	ReconcileError	Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-85682bb8-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-85682bb8-authn-ssl" already exists
23:23:04	openshift-ingress	gateway_labeler_controller	e2e-mt-85682bb8	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-mt-85682bb8
23:23:04	openshift-ingress	deployment-controller	e2e-mt-85682bb8-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-85682bb8-openshift-default-9677fcd68 from 0 to 1
23:23:05	openshift-ingress	multus	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	AddedInterface	Add eth0 [10.133.0.58/23] from ovn-kubernetes
23:23:05	openshift-ingress	multus	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	AddedInterface	Add eth0 [10.133.0.58/23] from ovn-kubernetes
23:23:10	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-85682bb8 namespace
23:23:15	openshift-ingress	replicaset-controller	payload-processing-e2e-mt-85682bb8-6bd9558b45	SuccessfulCreate	Created pod: payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8
23:23:15	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b	SuccessfulCreate	Created pod: payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg
23:23:15	openshift-ingress	deployment-controller	payload-pre-processing-e2e-mt-85682bb8	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b from 0 to 1
23:23:15	openshift-ingress	deployment-controller	payload-pre-processing-e2e-mt-85682bb8	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b from 0 to 1
23:23:15 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b	FailedCreate	Error creating: pods "payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-85682bb8: serviceaccount "payload-processing-e2e-mt-85682bb8" not found
23:23:15	openshift-ingress	deployment-controller	payload-processing-e2e-mt-85682bb8	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-mt-85682bb8-6bd9558b45 from 0 to 1
23:23:15	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b	SuccessfulCreate	Created pod: payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg
23:23:15 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b	FailedCreate	Error creating: pods "payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-85682bb8: serviceaccount "payload-processing-e2e-mt-85682bb8" not found
23:23:15	openshift-ingress	deployment-controller	payload-processing-e2e-mt-85682bb8	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-mt-85682bb8-6bd9558b45 from 0 to 1
23:23:15	openshift-ingress	replicaset-controller	payload-processing-e2e-mt-85682bb8-6bd9558b45	SuccessfulCreate	Created pod: payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8
23:23:15 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-mt-85682bb8-6bd9558b45	FailedCreate	Error creating: pods "payload-processing-e2e-mt-85682bb8-6bd9558b45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-85682bb8: serviceaccount "payload-processing-e2e-mt-85682bb8" not found
23:23:15 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-mt-85682bb8-6bd9558b45	FailedCreate	Error creating: pods "payload-processing-e2e-mt-85682bb8-6bd9558b45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-85682bb8: serviceaccount "payload-processing-e2e-mt-85682bb8" not found
23:23:16	openshift-ingress	kubelet	payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8	Started	Started container payload-processing
23:23:16	openshift-ingress	kubelet	payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:23:16	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg	Started	Started container payload-pre-processing
23:23:16	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg	Started	Started container payload-pre-processing
23:23:16	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg	Created	Created container: payload-pre-processing
23:23:16	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:23:16	openshift-ingress	multus	payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg	AddedInterface	Add eth0 [10.132.0.68/23] from ovn-kubernetes
23:23:16	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg	Created	Created container: payload-pre-processing
23:23:16	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:23:16	openshift-ingress	kubelet	payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8	Started	Started container payload-processing
23:23:16	openshift-ingress	multus	payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg	AddedInterface	Add eth0 [10.132.0.68/23] from ovn-kubernetes
23:23:16	openshift-ingress	kubelet	payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8	Created	Created container: payload-processing
23:23:16	openshift-ingress	kubelet	payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:23:16	openshift-ingress	multus	payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8	AddedInterface	Add eth0 [10.133.0.59/23] from ovn-kubernetes
23:23:16	openshift-ingress	kubelet	payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8	Created	Created container: payload-processing
23:23:16	openshift-ingress	multus	payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8	AddedInterface	Add eth0 [10.133.0.59/23] from ovn-kubernetes
23:23:41	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-mt-other-85682bb8 namespace
23:23:42	default	endpoint-controller	explicit-model-35df6d-kserve-workload-svc	FailedToCreateEndpoint	Failed to create endpoint for service ai-tenant-e2e-explicit-35df6d/explicit-model-35df6d-kserve-workload-svc: endpoints "explicit-model-35df6d-kserve-workload-svc" already exists
23:23:44 (x2)	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	Created	Created container: istio-proxy
23:23:44 (x2)	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:23:44 (x2)	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:23:44 (x2)	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	Started	Started container istio-proxy
23:23:44 (x2)	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	Started	Started container istio-proxy
23:23:44 (x2)	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	Created	Created container: istio-proxy
23:23:50 (x5)	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	ProbeError	Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
23:23:50 (x5)	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	Unhealthy	Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
23:23:50 (x5)	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	Unhealthy	Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
23:23:50 (x5)	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	ProbeError	Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
23:23:58	openshift-ingress	kubelet	payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8	Killing	Stopping container payload-processing
23:23:58	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg	Killing	Stopping container payload-pre-processing
23:23:58	openshift-ingress	kubelet	payload-processing-e2e-mt-85682bb8-6bd9558b45-w27t8	Killing	Stopping container payload-processing
23:23:58	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-85682bb8-77d8b6d74b-52nbg	Killing	Stopping container payload-pre-processing
23:24:05	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	Killing	Stopping container istio-proxy
23:24:05	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-webhook-sub-ef11cacf namespace
23:24:05	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	Killing	Stopping container istio-proxy
23:24:06	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:24:06	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
23:24:06	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:24:06	openshift-ingress	kubelet	e2e-mt-85682bb8-openshift-default-9677fcd68-kpdnq	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
23:24:11	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for e2e-webhook-auth-90aa1393 namespace
23:24:18	openshift-ingress	gateway_labeler_controller	e2e-shared-a-w2-b52922	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-b52922
23:24:18	openshift-ingress	gateway_labeler_controller	e2e-shared-a-w2-b52922	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-b52922
23:24:19	openshift-ingress	replicaset-controller	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666	SuccessfulCreate	Created pod: e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd
23:24:19	openshift-ingress	deployment-controller	e2e-shared-a-w2-b52922-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-w2-b52922-openshift-default-76f7cc4666 from 0 to 1
23:24:19	openshift-ingress	multus	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	AddedInterface	Add eth0 [10.132.0.69/23] from ovn-kubernetes
23:24:19	openshift-ingress	multus	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	AddedInterface	Add eth0 [10.132.0.69/23] from ovn-kubernetes
23:24:19	openshift-ingress	deployment-controller	e2e-shared-a-w2-b52922-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-w2-b52922-openshift-default-76f7cc4666 from 0 to 1
23:24:19	openshift-ingress	replicaset-controller	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666	SuccessfulCreate	Created pod: e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd
23:24:21	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-shared-a-w2-b52922 namespace
23:24:26	openshift-ingress	kubelet	payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w	Killing	Stopping container payload-pre-processing
23:24:26	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-a-w2-b52922	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58 from 0 to 1
23:24:26	openshift-ingress	kubelet	payload-pre-processing-e2e-explicit-35df6d-c96747fc4-bh96w	Killing	Stopping container payload-pre-processing
23:24:26 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b52922: serviceaccount "payload-processing-e2e-shared-a-w2-b52922" not found
23:24:26 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945	FailedCreate	Error creating: pods "payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b52922: serviceaccount "payload-processing-e2e-shared-a-w2-b52922" not found
23:24:26 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b52922: serviceaccount "payload-processing-e2e-shared-a-w2-b52922" not found
23:24:26 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945	FailedCreate	Error creating: pods "payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b52922: serviceaccount "payload-processing-e2e-shared-a-w2-b52922" not found
23:24:26	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-a-w2-b52922	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58 from 0 to 1
23:24:26	openshift-ingress	deployment-controller	payload-processing-e2e-shared-a-w2-b52922	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945 from 0 to 1
23:24:26	openshift-ingress	kubelet	payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4	Killing	Stopping container payload-processing
23:24:26	openshift-ingress	deployment-controller	payload-processing-e2e-shared-a-w2-b52922	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945 from 0 to 1
23:24:26	openshift-ingress	kubelet	payload-processing-e2e-explicit-35df6d-66f95dfccc-gttn4	Killing	Stopping container payload-processing
23:24:27	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:24:27	openshift-ingress	multus	payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh	AddedInterface	Add eth0 [10.132.0.70/23] from ovn-kubernetes
23:24:27	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945	SuccessfulCreate	Created pod: payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv
23:24:27	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945	SuccessfulCreate	Created pod: payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv
23:24:27	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv	Started	Started container payload-processing
23:24:27	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv	Created	Created container: payload-processing
23:24:27	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:24:27	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh
23:24:27	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh	Created	Created container: payload-pre-processing
23:24:27	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh	Started	Started container payload-pre-processing
23:24:27	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh	Created	Created container: payload-pre-processing
23:24:27	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:24:27	openshift-ingress	multus	payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh	AddedInterface	Add eth0 [10.132.0.70/23] from ovn-kubernetes
23:24:27	openshift-ingress	multus	payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv	AddedInterface	Add eth0 [10.132.0.71/23] from ovn-kubernetes
23:24:27	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv	Started	Started container payload-processing
23:24:27	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh	Started	Started container payload-pre-processing
23:24:27	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv	Created	Created container: payload-processing
23:24:27	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh
23:24:27	openshift-ingress	multus	payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv	AddedInterface	Add eth0 [10.132.0.71/23] from ovn-kubernetes
23:24:27	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:24:38	openshift-ingress	deployment-controller	e2e-noten-be3eb4-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-noten-be3eb4-openshift-default-684dc4b59d from 0 to 1
23:24:38	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	Killing	Stopping container istio-proxy
23:24:38	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:24:38	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
23:24:38	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:24:38	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
23:24:38	openshift-ingress	kubelet	e2e-explicit-35df6d-openshift-default-6cccb6d8dd-jq9dz	Killing	Stopping container istio-proxy
23:24:38	openshift-ingress	gateway_labeler_controller	e2e-noten-be3eb4	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-noten-be3eb4
23:24:38	openshift-ingress	deployment-controller	e2e-noten-be3eb4-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-noten-be3eb4-openshift-default-684dc4b59d from 0 to 1
23:24:38	openshift-ingress	replicaset-controller	e2e-noten-be3eb4-openshift-default-684dc4b59d	SuccessfulCreate	Created pod: e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d
23:24:38	openshift-ingress	replicaset-controller	e2e-noten-be3eb4-openshift-default-684dc4b59d	SuccessfulCreate	Created pod: e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d
23:24:38	openshift-ingress	gateway_labeler_controller	e2e-noten-be3eb4	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-noten-be3eb4
23:24:39	openshift-ingress	kubelet	e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:24:39	openshift-ingress	multus	e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	AddedInterface	Add eth0 [10.132.0.72/23] from ovn-kubernetes
23:24:39	openshift-ingress	kubelet	e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	Created	Created container: istio-proxy
23:24:39	openshift-ingress	multus	e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	AddedInterface	Add eth0 [10.132.0.72/23] from ovn-kubernetes
23:24:39	openshift-ingress	kubelet	e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	Started	Started container istio-proxy
23:24:39	openshift-ingress	kubelet	e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	Started	Started container istio-proxy
23:24:39	openshift-ingress	kubelet	e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	Created	Created container: istio-proxy
23:24:39	openshift-ingress	kubelet	e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:24:40	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-noten-be3eb4 namespace
23:24:52	openshift-ingress	gateway_labeler_controller	e2e-shared-b-w2-efffde	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-efffde
23:24:52	openshift-ingress	replicaset-controller	e2e-shared-b-w2-efffde-openshift-default-7bf694c556	SuccessfulCreate	Created pod: e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc
23:24:52	openshift-ingress	replicaset-controller	e2e-shared-b-w2-efffde-openshift-default-7bf694c556	SuccessfulCreate	Created pod: e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc
23:24:52	openshift-ingress	deployment-controller	e2e-shared-b-w2-efffde-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-b-w2-efffde-openshift-default-7bf694c556 from 0 to 1
23:24:52	openshift-ingress	gateway_labeler_controller	e2e-shared-b-w2-efffde	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-efffde
23:24:52	openshift-ingress	deployment-controller	e2e-shared-b-w2-efffde-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-b-w2-efffde-openshift-default-7bf694c556 from 0 to 1
23:24:53	openshift-ingress	multus	e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	AddedInterface	Add eth0 [10.132.0.73/23] from ovn-kubernetes
23:24:53	openshift-ingress	multus	e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	AddedInterface	Add eth0 [10.132.0.73/23] from ovn-kubernetes
23:24:56	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-shared-b-w2-efffde namespace
23:24:58 (x2)	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	Started	Started container istio-proxy
23:24:58 (x2)	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:24:58 (x2)	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	Created	Created container: istio-proxy
23:24:58 (x2)	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:24:58 (x2)	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	Created	Created container: istio-proxy
23:24:58 (x2)	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	Started	Started container istio-proxy
23:25:00	openshift-ingress	deployment-controller	payload-processing-e2e-shared-b-w2-efffde	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75 from 0 to 1
23:25:00	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-b-w2-efffde	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8 from 0 to 1
23:25:00 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75	FailedCreate	Error creating: pods "payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-efffde: serviceaccount "payload-processing-e2e-shared-b-w2-efffde" not found
23:25:00	openshift-ingress	deployment-controller	payload-processing-e2e-shared-b-w2-efffde	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75 from 0 to 1
23:25:00	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-b-w2-efffde	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8 from 0 to 1
23:25:00 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75	FailedCreate	Error creating: pods "payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-efffde: serviceaccount "payload-processing-e2e-shared-b-w2-efffde" not found
23:25:01	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484	Created	Created container: payload-processing
23:25:01	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7	Started	Started container payload-pre-processing
23:25:01	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7	Started	Started container payload-pre-processing
23:25:01	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:25:01	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7	Created	Created container: payload-pre-processing
23:25:01	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75	SuccessfulCreate	Created pod: payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484
23:25:01	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7
23:25:01	openshift-ingress	multus	payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484	AddedInterface	Add eth0 [10.133.0.64/23] from ovn-kubernetes
23:25:01	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484	Started	Started container payload-processing
23:25:01	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:25:01	openshift-ingress	multus	payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7	AddedInterface	Add eth0 [10.132.0.75/23] from ovn-kubernetes
23:25:01	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484	Created	Created container: payload-processing
23:25:01 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-efffde: serviceaccount "payload-processing-e2e-shared-b-w2-efffde" not found
23:25:01	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484	Started	Started container payload-processing
23:25:01	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7
23:25:01	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75	SuccessfulCreate	Created pod: payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484
23:25:01	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7	Created	Created container: payload-pre-processing
23:25:01	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:25:01	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:25:01	openshift-ingress	multus	payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7	AddedInterface	Add eth0 [10.132.0.75/23] from ovn-kubernetes
23:25:01 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-efffde: serviceaccount "payload-processing-e2e-shared-b-w2-efffde" not found
23:25:01	openshift-ingress	multus	payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484	AddedInterface	Add eth0 [10.133.0.64/23] from ovn-kubernetes
23:25:03 (x5)	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	ProbeError	Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
23:25:03 (x5)	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	ProbeError	Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
23:25:03 (x5)	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	Unhealthy	Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
23:25:03 (x5)	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	Unhealthy	Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
23:25:21 (x2)	openshift-ingress	kubelet	e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	Started	Started container istio-proxy
23:25:21 (x2)	openshift-ingress	kubelet	e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	Created	Created container: istio-proxy
23:25:21 (x2)	openshift-ingress	kubelet	e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:25:21 (x2)	openshift-ingress	kubelet	e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	Created	Created container: istio-proxy
23:25:21 (x2)	openshift-ingress	kubelet	e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	Started	Started container istio-proxy
23:25:21 (x2)	openshift-ingress	kubelet	e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:25:26 (x5)	openshift-ingress	kubelet	e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	ProbeError	Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
23:25:26 (x5)	openshift-ingress	kubelet	e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	Unhealthy	Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
23:25:26 (x5)	openshift-ingress	kubelet	e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	Unhealthy	Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
23:25:26 (x5)	openshift-ingress	kubelet	e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	ProbeError	Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
23:25:27	opendatahub	kubelet	test-curl-7850-9dba10	Created	Created container: test-curl-7850-9dba10
23:25:27	opendatahub	kubelet	test-curl-7850-9dba10	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine
23:25:27	opendatahub	multus	test-curl-7850-9dba10	AddedInterface	Add eth0 [10.132.0.76/23] from ovn-kubernetes
23:25:27	opendatahub	kubelet	test-curl-7850-9dba10	Started	Started container test-curl-7850-9dba10
23:25:29	opendatahub	kubelet	test-curl-7850-2dd76d	Created	Created container: test-curl-7850-2dd76d
23:25:29	opendatahub	kubelet	test-curl-7850-2dd76d	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine
23:25:29	opendatahub	kubelet	test-curl-7850-2dd76d	Started	Started container test-curl-7850-2dd76d
23:25:29	opendatahub	multus	test-curl-7850-2dd76d	AddedInterface	Add eth0 [10.132.0.77/23] from ovn-kubernetes
23:25:30	opendatahub	kubelet	test-curl-7850-9dba10	Killing	Stopping container test-curl-7850-9dba10
23:25:31	opendatahub	kubelet	test-curl-7850-57ba95	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine
23:25:31	opendatahub	multus	test-curl-7850-57ba95	AddedInterface	Add eth0 [10.132.0.78/23] from ovn-kubernetes
23:25:31	opendatahub	kubelet	test-curl-7850-57ba95	Started	Started container test-curl-7850-57ba95
23:25:31	opendatahub	kubelet	test-curl-7850-57ba95	Created	Created container: test-curl-7850-57ba95
23:25:32	opendatahub	kubelet	test-curl-7850-2dd76d	Killing	Stopping container test-curl-7850-2dd76d
23:25:33	opendatahub	kubelet	test-curl-7850-b3181f	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine
23:25:33	opendatahub	multus	test-curl-7850-b3181f	AddedInterface	Add eth0 [10.132.0.79/23] from ovn-kubernetes
23:25:33	opendatahub	kubelet	test-curl-7850-b3181f	Created	Created container: test-curl-7850-b3181f
23:25:33	opendatahub	kubelet	test-curl-7850-b3181f	Started	Started container test-curl-7850-b3181f
23:25:34	opendatahub	kubelet	test-curl-7850-57ba95	Killing	Stopping container test-curl-7850-57ba95
23:25:35	openshift-ingress	gateway_labeler_controller	e2e-mt-09450b8d	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-mt-09450b8d
23:25:35	openshift-ingress	replicaset-controller	e2e-mt-09450b8d-openshift-default-8579ff9cd4	SuccessfulCreate	Created pod: e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762
23:25:35	openshift-ingress	replicaset-controller	e2e-mt-09450b8d-openshift-default-8579ff9cd4	SuccessfulCreate	Created pod: e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762
23:25:35	openshift-ingress	deployment-controller	e2e-mt-09450b8d-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-09450b8d-openshift-default-8579ff9cd4 from 0 to 1
23:25:35	openshift-ingress	gateway_labeler_controller	e2e-mt-09450b8d	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-mt-09450b8d
23:25:35	openshift-ingress	deployment-controller	e2e-mt-09450b8d-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-mt-09450b8d-openshift-default-8579ff9cd4 from 0 to 1
23:25:36	openshift-ingress	kubelet	payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j	Killing	Stopping container payload-processing
23:25:36	openshift-ingress	kubelet	payload-processing-e2e-inf-a-48d98f-6bcb4f8579-xj62j	Killing	Stopping container payload-processing
23:25:36	openshift-ingress	multus	e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	AddedInterface	Add eth0 [10.132.0.80/23] from ovn-kubernetes
23:25:36	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx	Killing	Stopping container payload-pre-processing
23:25:36	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-a-48d98f-86f7687cf8-8dbhx	Killing	Stopping container payload-pre-processing
23:25:36	opendatahub	kubelet	test-curl-7850-b3181f	Killing	Stopping container test-curl-7850-b3181f
23:25:36	openshift-ingress	multus	e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	AddedInterface	Add eth0 [10.132.0.80/23] from ovn-kubernetes
23:25:39	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-09450b8d namespace
23:25:42	openshift-ingress	deployment-controller	payload-pre-processing-e2e-mt-09450b8d	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86 from 0 to 1
23:25:42	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86	SuccessfulCreate	Created pod: payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p
23:25:42 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-mt-09450b8d-58d8f68cb9	FailedCreate	Error creating: pods "payload-processing-e2e-mt-09450b8d-58d8f68cb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-09450b8d: serviceaccount "payload-processing-e2e-mt-09450b8d" not found
23:25:42	openshift-ingress	deployment-controller	payload-processing-e2e-mt-09450b8d	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-mt-09450b8d-58d8f68cb9 from 0 to 1
23:25:42	openshift-ingress	replicaset-controller	payload-processing-e2e-mt-09450b8d-58d8f68cb9	SuccessfulCreate	Created pod: payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg
23:25:42	openshift-ingress	replicaset-controller	payload-processing-e2e-mt-09450b8d-58d8f68cb9	SuccessfulCreate	Created pod: payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg
23:25:42 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86	FailedCreate	Error creating: pods "payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-09450b8d: serviceaccount "payload-processing-e2e-mt-09450b8d" not found
23:25:42	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86	SuccessfulCreate	Created pod: payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p
23:25:42 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86	FailedCreate	Error creating: pods "payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-09450b8d: serviceaccount "payload-processing-e2e-mt-09450b8d" not found
23:25:42 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-mt-09450b8d-58d8f68cb9	FailedCreate	Error creating: pods "payload-processing-e2e-mt-09450b8d-58d8f68cb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-09450b8d: serviceaccount "payload-processing-e2e-mt-09450b8d" not found
23:25:42	openshift-ingress	deployment-controller	payload-processing-e2e-mt-09450b8d	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-mt-09450b8d-58d8f68cb9 from 0 to 1
23:25:42	openshift-ingress	deployment-controller	payload-pre-processing-e2e-mt-09450b8d	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86 from 0 to 1
23:25:43	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p	Created	Created container: payload-pre-processing
23:25:43	openshift-ingress	kubelet	payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg	Started	Started container payload-processing
23:25:43	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:25:43	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p	Started	Started container payload-pre-processing
23:25:43	openshift-ingress	kubelet	payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg	Started	Started container payload-processing
23:25:43	openshift-ingress	kubelet	payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg	Created	Created container: payload-processing
23:25:43	openshift-ingress	multus	payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p	AddedInterface	Add eth0 [10.132.0.81/23] from ovn-kubernetes
23:25:43	openshift-ingress	kubelet	payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:25:43	openshift-ingress	multus	payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg	AddedInterface	Add eth0 [10.133.0.66/23] from ovn-kubernetes
23:25:43	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p	Started	Started container payload-pre-processing
23:25:43	openshift-ingress	kubelet	payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg	Created	Created container: payload-processing
23:25:43	openshift-ingress	multus	payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg	AddedInterface	Add eth0 [10.133.0.66/23] from ovn-kubernetes
23:25:43	openshift-ingress	kubelet	payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:25:43	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p	Created	Created container: payload-pre-processing
23:25:43	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:25:43	openshift-ingress	multus	payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p	AddedInterface	Add eth0 [10.132.0.81/23] from ovn-kubernetes
23:26:13 (x2)	openshift-ingress	kubelet	e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:26:13 (x2)	openshift-ingress	kubelet	e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:26:13 (x2)	openshift-ingress	kubelet	e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	Started	Started container istio-proxy
23:26:13 (x2)	openshift-ingress	kubelet	e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	Created	Created container: istio-proxy
23:26:13 (x2)	openshift-ingress	kubelet	e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	Started	Started container istio-proxy
23:26:13 (x2)	openshift-ingress	kubelet	e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	Created	Created container: istio-proxy
23:26:19	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	Killing	Stopping container istio-proxy
23:26:19	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	Killing	Stopping container istio-proxy
23:26:20 (x6)	openshift-ingress	kubelet	e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	ProbeError	Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
23:26:20 (x6)	openshift-ingress	kubelet	e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	Unhealthy	Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
23:26:20 (x6)	openshift-ingress	kubelet	e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	Unhealthy	Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
23:26:20 (x6)	openshift-ingress	kubelet	e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	ProbeError	Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
23:26:21	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
23:26:21	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
23:26:21	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:26:21	openshift-ingress	kubelet	e2e-inf-a-48d98f-openshift-default-5d6dbb4b8d-ktqlq	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:26:30	openshift-ingress	kubelet	payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv	Killing	Stopping container payload-processing
23:26:30	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg	Killing	Stopping container payload-pre-processing
23:26:30	openshift-ingress	kubelet	payload-processing-e2e-inf-b-f38e68-5d4f46496c-pgvsv	Killing	Stopping container payload-processing
23:26:30	openshift-ingress	kubelet	payload-pre-processing-e2e-inf-b-f38e68-5df67f69db-cfflg	Killing	Stopping container payload-pre-processing
23:26:41	openshift-ingress	kubelet	e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	Killing	Stopping container istio-proxy
23:26:41	openshift-ingress	kubelet	e2e-inf-b-f38e68-openshift-default-9dff74fb8-rhnk4	Killing	Stopping container istio-proxy
23:26:42	openshift-ingress	replicaset-controller	e2e-shared-a-w3-f80c49-openshift-default-5887749d84	SuccessfulCreate	Created pod: e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t
23:26:42	openshift-ingress	gateway_labeler_controller	e2e-shared-a-w3-f80c49	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-f80c49
23:26:42	openshift-ingress	deployment-controller	e2e-shared-a-w3-f80c49-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-w3-f80c49-openshift-default-5887749d84 from 0 to 1
23:26:42	openshift-ingress	gateway_labeler_controller	e2e-shared-a-w3-f80c49	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-f80c49
23:26:42	openshift-ingress	deployment-controller	e2e-shared-a-w3-f80c49-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-a-w3-f80c49-openshift-default-5887749d84 from 0 to 1
23:26:42	openshift-ingress	replicaset-controller	e2e-shared-a-w3-f80c49-openshift-default-5887749d84	SuccessfulCreate	Created pod: e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t
23:26:43	openshift-ingress	multus	e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	AddedInterface	Add eth0 [10.132.0.82/23] from ovn-kubernetes
23:26:43	openshift-ingress	multus	e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	AddedInterface	Add eth0 [10.132.0.82/23] from ovn-kubernetes
23:26:45	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-shared-a-w3-f80c49 namespace
23:26:50	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq
23:26:50 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79	FailedCreate	Error creating: pods "payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49: serviceaccount "payload-processing-e2e-shared-a-w3-f80c49" not found
23:26:50 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49: serviceaccount "payload-processing-e2e-shared-a-w3-f80c49" not found
23:26:50	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-a-w3-f80c49	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b from 0 to 1
23:26:50 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79	FailedCreate	Error creating: pods "payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49: serviceaccount "payload-processing-e2e-shared-a-w3-f80c49" not found
23:26:50	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq
23:26:50 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-f80c49: serviceaccount "payload-processing-e2e-shared-a-w3-f80c49" not found
23:26:50	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79	SuccessfulCreate	Created pod: payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6
23:26:50	openshift-ingress	deployment-controller	payload-processing-e2e-shared-a-w3-f80c49	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79 from 0 to 1
23:26:50	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-a-w3-f80c49	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b from 0 to 1
23:26:50	openshift-ingress	deployment-controller	payload-processing-e2e-shared-a-w3-f80c49	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79 from 0 to 1
23:26:50	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79	SuccessfulCreate	Created pod: payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6
23:26:51	openshift-ingress	multus	payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq	AddedInterface	Add eth0 [10.133.0.68/23] from ovn-kubernetes
23:26:51	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:26:51	openshift-ingress	multus	payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6	AddedInterface	Add eth0 [10.133.0.69/23] from ovn-kubernetes
23:26:51	openshift-ingress	multus	payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6	AddedInterface	Add eth0 [10.133.0.69/23] from ovn-kubernetes
23:26:51	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:26:51	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq	Started	Started container payload-pre-processing
23:26:51	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq	Created	Created container: payload-pre-processing
23:26:51	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6	Created	Created container: payload-processing
23:26:51	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6	Started	Started container payload-processing
23:26:51	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6	Created	Created container: payload-processing
23:26:51	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:26:51	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6	Started	Started container payload-processing
23:26:51	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq	Started	Started container payload-pre-processing
23:26:51	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq	Created	Created container: payload-pre-processing
23:26:51	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:26:51	openshift-ingress	multus	payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq	AddedInterface	Add eth0 [10.133.0.68/23] from ovn-kubernetes
23:26:54	openshift-ingress	kubelet	e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	Killing	Stopping container istio-proxy
23:26:54	openshift-ingress	kubelet	e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	Killing	Stopping container istio-proxy
23:26:56	openshift-ingress	kubelet	e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:26:56	openshift-ingress	kubelet	e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
23:26:56	openshift-ingress	kubelet	e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:26:56	openshift-ingress	kubelet	e2e-noten-be3eb4-openshift-default-684dc4b59d-qx67d	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
23:27:12	openshift-ingress	replicaset-controller	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b	SuccessfulCreate	Created pod: e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5
23:27:12	openshift-ingress	multus	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	AddedInterface	Add eth0 [10.133.0.70/23] from ovn-kubernetes
23:27:12	openshift-ingress	deployment-controller	e2e-shared-b-w3-f6ac6e-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b from 0 to 1
23:27:12	openshift-ingress	gateway_labeler_controller	e2e-shared-b-w3-f6ac6e	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-f6ac6e
23:27:12	openshift-ingress	gateway_labeler_controller	e2e-shared-b-w3-f6ac6e	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-f6ac6e
23:27:12	openshift-ingress	deployment-controller	e2e-shared-b-w3-f6ac6e-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b from 0 to 1
23:27:12	openshift-ingress	replicaset-controller	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b	SuccessfulCreate	Created pod: e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5
23:27:12	openshift-ingress	multus	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	AddedInterface	Add eth0 [10.133.0.70/23] from ovn-kubernetes
23:27:13 (x2)	openshift-ingress	kubelet	e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:27:13 (x2)	openshift-ingress	kubelet	e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:27:13 (x2)	openshift-ingress	kubelet	e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	Started	Started container istio-proxy
23:27:13 (x2)	openshift-ingress	kubelet	e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	Started	Started container istio-proxy
23:27:13 (x2)	openshift-ingress	kubelet	e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	Created	Created container: istio-proxy
23:27:13 (x2)	openshift-ingress	kubelet	e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	Created	Created container: istio-proxy
23:27:15	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-shared-b-w3-f6ac6e namespace
23:27:17	openshift-ingress	deployment-controller	payload-processing-e2e-shared-b-w3-f6ac6e	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467 from 0 to 1
23:27:17	openshift-ingress	deployment-controller	payload-processing-e2e-shared-b-w3-f6ac6e	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467 from 0 to 1
23:27:18 (x5)	openshift-ingress	kubelet	e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	Unhealthy	Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
23:27:18	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq
23:27:18 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467	FailedCreate	Error creating: pods "payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e: serviceaccount "payload-processing-e2e-shared-b-w3-f6ac6e" not found
23:27:18	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:27:18	openshift-ingress	multus	payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc	AddedInterface	Add eth0 [10.133.0.71/23] from ovn-kubernetes
23:27:18	openshift-ingress	multus	payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc	AddedInterface	Add eth0 [10.133.0.71/23] from ovn-kubernetes
23:27:18 (x5)	openshift-ingress	kubelet	e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	ProbeError	Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
23:27:18	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:27:18	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-b-w3-f6ac6e	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4 from 0 to 1
23:27:18	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc	Started	Started container payload-processing
23:27:18	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc	Created	Created container: payload-processing
23:27:18 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467	FailedCreate	Error creating: pods "payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e: serviceaccount "payload-processing-e2e-shared-b-w3-f6ac6e" not found
23:27:18	openshift-ingress	multus	payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq	AddedInterface	Add eth0 [10.132.0.84/23] from ovn-kubernetes
23:27:18 (x5)	openshift-ingress	kubelet	e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	Unhealthy	Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
23:27:18	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467	SuccessfulCreate	Created pod: payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc
23:27:18	openshift-ingress	multus	payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq	AddedInterface	Add eth0 [10.132.0.84/23] from ovn-kubernetes
23:27:18	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc	Created	Created container: payload-processing
23:27:18 (x5)	openshift-ingress	kubelet	e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	ProbeError	Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
23:27:18 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e: serviceaccount "payload-processing-e2e-shared-b-w3-f6ac6e" not found
23:27:18	openshift-ingress	replicaset-controller	payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467	SuccessfulCreate	Created pod: payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc
23:27:18	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq	Started	Started container payload-pre-processing
23:27:18	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc	Started	Started container payload-processing
23:27:18	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq	Created	Created container: payload-pre-processing
23:27:18	openshift-ingress	deployment-controller	payload-pre-processing-e2e-shared-b-w3-f6ac6e	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4 from 0 to 1
23:27:18	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4	SuccessfulCreate	Created pod: payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq
23:27:18 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4	FailedCreate	Error creating: pods "payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f6ac6e: serviceaccount "payload-processing-e2e-shared-b-w3-f6ac6e" not found
23:27:18	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:27:18	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq	Started	Started container payload-pre-processing
23:27:18	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq	Created	Created container: payload-pre-processing
23:27:18	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:27:48 (x2)	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:27:48 (x2)	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:27:49 (x2)	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	Created	Created container: istio-proxy
23:27:49 (x2)	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	Started	Started container istio-proxy
23:27:49 (x2)	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	Created	Created container: istio-proxy
23:27:49 (x2)	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	Started	Started container istio-proxy
23:27:54 (x5)	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	Unhealthy	Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
23:27:54 (x5)	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	ProbeError	Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
23:27:54 (x5)	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	Unhealthy	Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
23:27:54 (x5)	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	ProbeError	Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
23:28:17	openshift-ingress	kubelet	payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg	Killing	Stopping container payload-processing
23:28:17	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p	Killing	Stopping container payload-pre-processing
23:28:17	openshift-ingress	endpoint-controller	payload-pre-processing-e2e-mt-09450b8d	FailedToUpdateEndpoint	Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-09450b8d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-09450b8d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-09450b8d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2e8ed832-93c0-42cb-8b42-01c56dad4dba, UID in object meta:
23:28:17	openshift-ingress	endpoint-controller	payload-pre-processing-e2e-mt-09450b8d	FailedToUpdateEndpoint	Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-09450b8d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-09450b8d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-09450b8d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2e8ed832-93c0-42cb-8b42-01c56dad4dba, UID in object meta:
23:28:17	openshift-ingress	kubelet	payload-pre-processing-e2e-mt-09450b8d-84b8bc6f86-qhr6p	Killing	Stopping container payload-pre-processing
23:28:17	openshift-ingress	kubelet	payload-processing-e2e-mt-09450b8d-58d8f68cb9-nxtgg	Killing	Stopping container payload-processing
23:29:23	openshift-ingress	kubelet	e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	Killing	Stopping container istio-proxy
23:29:23	openshift-ingress	kubelet	e2e-mt-09450b8d-openshift-default-8579ff9cd4-p8762	Killing	Stopping container istio-proxy
23:29:25	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-9ee200d4 namespace
23:29:25	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-c15f52fb namespace
23:29:39	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-mt-493b5f97 namespace
23:30:18	openshift-ingress	multus	e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	AddedInterface	Add eth0 [10.132.0.88/23] from ovn-kubernetes
23:30:18	openshift-ingress	gateway_labeler_controller	e2e-api-a-9148ad	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-9148ad
23:30:18	openshift-ingress	deployment-controller	e2e-api-a-9148ad-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-a-9148ad-openshift-default-7c7df558c8 from 0 to 1
23:30:18	openshift-ingress	replicaset-controller	e2e-api-a-9148ad-openshift-default-7c7df558c8	SuccessfulCreate	Created pod: e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz
23:30:18	openshift-ingress	multus	e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	AddedInterface	Add eth0 [10.132.0.88/23] from ovn-kubernetes
23:30:18	openshift-ingress	replicaset-controller	e2e-api-a-9148ad-openshift-default-7c7df558c8	SuccessfulCreate	Created pod: e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz
23:30:18	openshift-ingress	deployment-controller	e2e-api-a-9148ad-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-a-9148ad-openshift-default-7c7df558c8 from 0 to 1
23:30:18	openshift-ingress	gateway_labeler_controller	e2e-api-a-9148ad	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-9148ad
23:30:21	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-api-a-9148ad namespace
23:30:27 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-api-a-9148ad-74c7fb57df	FailedCreate	Error creating: pods "payload-processing-e2e-api-a-9148ad-74c7fb57df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9148ad: serviceaccount "payload-processing-e2e-api-a-9148ad" not found
23:30:27	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:30:27	openshift-ingress	kubelet	payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:30:27	openshift-ingress	kubelet	payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw	Created	Created container: payload-processing
23:30:27	openshift-ingress	kubelet	payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw	Started	Started container payload-processing
23:30:27	openshift-ingress	deployment-controller	payload-pre-processing-e2e-api-a-9148ad	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-api-a-9148ad-85565d666b from 0 to 1
23:30:27	openshift-ingress	replicaset-controller	payload-processing-e2e-api-a-9148ad-74c7fb57df	SuccessfulCreate	Created pod: payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw
23:30:27	openshift-ingress	deployment-controller	payload-processing-e2e-api-a-9148ad	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-api-a-9148ad-74c7fb57df from 0 to 1
23:30:27	openshift-ingress	deployment-controller	payload-pre-processing-e2e-api-a-9148ad	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-api-a-9148ad-85565d666b from 0 to 1
23:30:27	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-a-9148ad-85565d666b	SuccessfulCreate	Created pod: payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk
23:30:27 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-a-9148ad-85565d666b	FailedCreate	Error creating: pods "payload-pre-processing-e2e-api-a-9148ad-85565d666b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9148ad: serviceaccount "payload-processing-e2e-api-a-9148ad" not found
23:30:27	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk	Started	Started container payload-pre-processing
23:30:27	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk	Created	Created container: payload-pre-processing
23:30:27	openshift-ingress	multus	payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw	AddedInterface	Add eth0 [10.133.0.79/23] from ovn-kubernetes
23:30:27	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-a-9148ad-85565d666b	SuccessfulCreate	Created pod: payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk
23:30:27	openshift-ingress	multus	payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk	AddedInterface	Add eth0 [10.133.0.78/23] from ovn-kubernetes
23:30:27	openshift-ingress	multus	payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw	AddedInterface	Add eth0 [10.133.0.79/23] from ovn-kubernetes
23:30:27 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-a-9148ad-85565d666b	FailedCreate	Error creating: pods "payload-pre-processing-e2e-api-a-9148ad-85565d666b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9148ad: serviceaccount "payload-processing-e2e-api-a-9148ad" not found
23:30:27	openshift-ingress	kubelet	payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:30:27	openshift-ingress	deployment-controller	payload-processing-e2e-api-a-9148ad	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-api-a-9148ad-74c7fb57df from 0 to 1
23:30:27	openshift-ingress	replicaset-controller	payload-processing-e2e-api-a-9148ad-74c7fb57df	SuccessfulCreate	Created pod: payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw
23:30:27	openshift-ingress	multus	payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk	AddedInterface	Add eth0 [10.133.0.78/23] from ovn-kubernetes
23:30:27 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-api-a-9148ad-74c7fb57df	FailedCreate	Error creating: pods "payload-processing-e2e-api-a-9148ad-74c7fb57df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9148ad: serviceaccount "payload-processing-e2e-api-a-9148ad" not found
23:30:27	openshift-ingress	kubelet	payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw	Started	Started container payload-processing
23:30:27	openshift-ingress	kubelet	payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw	Created	Created container: payload-processing
23:30:27	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:30:27	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk	Created	Created container: payload-pre-processing
23:30:27	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk	Started	Started container payload-pre-processing
23:30:29	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5769f99d9f-brvgh	Unhealthy	Readiness probe failed: Get "http://10.132.0.38:8081/readyz": dial tcp 10.132.0.38:8081: connect: connection refused
23:30:30 (x2)	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5769f99d9f-brvgh	Pulled	Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine
23:30:30 (x2)	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5769f99d9f-brvgh	Started	Started container manager
23:30:30 (x2)	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5769f99d9f-brvgh	Created	Created container: manager
23:30:46	kuadrant-system	kuadrant-operator-controller-manager-5769f99d9f-brvgh_a38ad193-46dd-4f02-87b3-72b3a6f6c288	f139389e.kuadrant.io	LeaderElection	kuadrant-operator-controller-manager-5769f99d9f-brvgh_a38ad193-46dd-4f02-87b3-72b3a6f6c288 became leader
23:30:51	openshift-ingress	replicaset-controller	e2e-api-b-b54c32-openshift-default-5f7c977d84	SuccessfulCreate	Created pod: e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv
23:30:51	openshift-ingress	deployment-controller	e2e-api-b-b54c32-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-b-b54c32-openshift-default-5f7c977d84 from 0 to 1
23:30:51	openshift-ingress	gateway_labeler_controller	e2e-api-b-b54c32	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b54c32
23:30:51	openshift-ingress	deployment-controller	e2e-api-b-b54c32-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-api-b-b54c32-openshift-default-5f7c977d84 from 0 to 1
23:30:51	openshift-ingress	replicaset-controller	e2e-api-b-b54c32-openshift-default-5f7c977d84	SuccessfulCreate	Created pod: e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv
23:30:51	openshift-ingress	gateway_labeler_controller	e2e-api-b-b54c32	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b54c32
23:30:52	openshift-ingress	multus	e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	AddedInterface	Add eth0 [10.132.0.90/23] from ovn-kubernetes
23:30:52	openshift-ingress	multus	e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	AddedInterface	Add eth0 [10.132.0.90/23] from ovn-kubernetes
23:30:55	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-api-b-b54c32 namespace
23:31:01	openshift-ingress	deployment-controller	payload-pre-processing-e2e-api-b-b54c32	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-api-b-b54c32-b689c786 from 0 to 1
23:31:01	openshift-ingress	deployment-controller	payload-processing-e2e-api-b-b54c32	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-api-b-b54c32-f695d495 from 0 to 1
23:31:01	openshift-ingress	deployment-controller	payload-pre-processing-e2e-api-b-b54c32	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-api-b-b54c32-b689c786 from 0 to 1
23:31:01	openshift-ingress	deployment-controller	payload-processing-e2e-api-b-b54c32	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-api-b-b54c32-f695d495 from 0 to 1
23:31:02	openshift-ingress	kubelet	payload-processing-e2e-api-b-b54c32-f695d495-vtwg5	Created	Created container: payload-processing
23:31:02	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-b-b54c32-b689c786	SuccessfulCreate	Created pod: payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88
23:31:02	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-b-b54c32-b689c786	SuccessfulCreate	Created pod: payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88
23:31:02	openshift-ingress	kubelet	payload-processing-e2e-api-b-b54c32-f695d495-vtwg5	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:31:02	openshift-ingress	multus	payload-processing-e2e-api-b-b54c32-f695d495-vtwg5	AddedInterface	Add eth0 [10.132.0.91/23] from ovn-kubernetes
23:31:02 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-b-b54c32-b689c786	FailedCreate	Error creating: pods "payload-pre-processing-e2e-api-b-b54c32-b689c786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b54c32: serviceaccount "payload-processing-e2e-api-b-b54c32" not found
23:31:02	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88	Started	Started container payload-pre-processing
23:31:02	openshift-ingress	kubelet	payload-processing-e2e-api-b-b54c32-f695d495-vtwg5	Started	Started container payload-processing
23:31:02	openshift-ingress	multus	payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88	AddedInterface	Add eth0 [10.133.0.80/23] from ovn-kubernetes
23:31:02	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88	Created	Created container: payload-pre-processing
23:31:02 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-api-b-b54c32-f695d495	FailedCreate	Error creating: pods "payload-processing-e2e-api-b-b54c32-f695d495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b54c32: serviceaccount "payload-processing-e2e-api-b-b54c32" not found
23:31:02	openshift-ingress	replicaset-controller	payload-processing-e2e-api-b-b54c32-f695d495	SuccessfulCreate	Created pod: payload-processing-e2e-api-b-b54c32-f695d495-vtwg5
23:31:02	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:31:02	openshift-ingress	multus	payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88	AddedInterface	Add eth0 [10.133.0.80/23] from ovn-kubernetes
23:31:02	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:31:02	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88	Created	Created container: payload-pre-processing
23:31:02	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88	Started	Started container payload-pre-processing
23:31:02	openshift-ingress	kubelet	payload-processing-e2e-api-b-b54c32-f695d495-vtwg5	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:31:02 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-api-b-b54c32-b689c786	FailedCreate	Error creating: pods "payload-pre-processing-e2e-api-b-b54c32-b689c786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b54c32: serviceaccount "payload-processing-e2e-api-b-b54c32" not found
23:31:02	openshift-ingress	multus	payload-processing-e2e-api-b-b54c32-f695d495-vtwg5	AddedInterface	Add eth0 [10.132.0.91/23] from ovn-kubernetes
23:31:02	openshift-ingress	kubelet	payload-processing-e2e-api-b-b54c32-f695d495-vtwg5	Created	Created container: payload-processing
23:31:02	openshift-ingress	kubelet	payload-processing-e2e-api-b-b54c32-f695d495-vtwg5	Started	Started container payload-processing
23:31:02 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-api-b-b54c32-f695d495	FailedCreate	Error creating: pods "payload-processing-e2e-api-b-b54c32-f695d495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b54c32: serviceaccount "payload-processing-e2e-api-b-b54c32" not found
23:31:02	openshift-ingress	replicaset-controller	payload-processing-e2e-api-b-b54c32-f695d495	SuccessfulCreate	Created pod: payload-processing-e2e-api-b-b54c32-f695d495-vtwg5
23:31:09 (x2)	openshift-ingress	kubelet	e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	Started	Started container istio-proxy
23:31:09 (x2)	openshift-ingress	kubelet	e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:31:09 (x2)	openshift-ingress	kubelet	e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	Created	Created container: istio-proxy
23:31:09 (x2)	openshift-ingress	kubelet	e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	Started	Started container istio-proxy
23:31:09 (x2)	openshift-ingress	kubelet	e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:31:09 (x2)	openshift-ingress	kubelet	e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	Created	Created container: istio-proxy
23:31:16 (x7)	openshift-ingress	kubelet	e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	ProbeError	Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
23:31:16 (x7)	openshift-ingress	kubelet	e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	Unhealthy	Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
23:31:16 (x7)	openshift-ingress	kubelet	e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	ProbeError	Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
23:31:16 (x7)	openshift-ingress	kubelet	e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	Unhealthy	Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
23:31:28 (x2)	openshift-ingress	kubelet	e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:31:28 (x2)	openshift-ingress	kubelet	e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	Created	Created container: istio-proxy
23:31:28 (x2)	openshift-ingress	kubelet	e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	Created	Created container: istio-proxy
23:31:28 (x2)	openshift-ingress	kubelet	e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	Started	Started container istio-proxy
23:31:28 (x2)	openshift-ingress	kubelet	e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	Started	Started container istio-proxy
23:31:28 (x2)	openshift-ingress	kubelet	e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:31:34 (x5)	openshift-ingress	kubelet	e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	ProbeError	Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:
23:31:34 (x5)	openshift-ingress	kubelet	e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	ProbeError	Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:
23:31:34 (x5)	openshift-ingress	kubelet	e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	Unhealthy	Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused
23:31:34 (x5)	openshift-ingress	kubelet	e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	Unhealthy	Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused
23:31:43	openshift-ingress	kubelet	payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw	Killing	Stopping container payload-processing
23:31:43	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk	Killing	Stopping container payload-pre-processing
23:31:43	openshift-ingress	kubelet	payload-processing-e2e-api-a-9148ad-74c7fb57df-stwcw	Killing	Stopping container payload-processing
23:31:43	openshift-ingress	kubelet	payload-pre-processing-e2e-api-a-9148ad-85565d666b-gc4fk	Killing	Stopping container payload-pre-processing
23:31:50	openshift-ingress	kubelet	e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	Killing	Stopping container istio-proxy
23:31:50	openshift-ingress	kubelet	e2e-api-a-9148ad-openshift-default-7c7df558c8-m8dbz	Killing	Stopping container istio-proxy
23:32:06	openshift-ingress	kubelet	payload-processing-e2e-api-b-b54c32-f695d495-vtwg5	Killing	Stopping container payload-processing
23:32:06	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88	Killing	Stopping container payload-pre-processing
23:32:06	openshift-ingress	kubelet	payload-pre-processing-e2e-api-b-b54c32-b689c786-x2h88	Killing	Stopping container payload-pre-processing
23:32:06	openshift-ingress	kubelet	payload-processing-e2e-api-b-b54c32-f695d495-vtwg5	Killing	Stopping container payload-processing
23:32:13	openshift-ingress	kubelet	e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	Killing	Stopping container istio-proxy
23:32:13	openshift-ingress	kubelet	e2e-api-b-b54c32-openshift-default-5f7c977d84-z85wv	Killing	Stopping container istio-proxy
23:32:24	openshift-ingress	endpoint-controller	payload-pre-processing-e2e-shared-a-w2-b52922	FailedToUpdateEndpoint	Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b52922: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-b52922": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b52922, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8e6e4899-182e-43a4-b574-389fe7290e3f, UID in object meta:
23:32:24	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh	Killing	Stopping container payload-pre-processing
23:32:24	openshift-ingress	endpoint-controller	payload-pre-processing-e2e-shared-a-w2-b52922	FailedToUpdateEndpoint	Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b52922: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-b52922": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b52922, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8e6e4899-182e-43a4-b574-389fe7290e3f, UID in object meta:
23:32:24	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w2-b52922-64b76f5f58-js8gh	Killing	Stopping container payload-pre-processing
23:32:24	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv	Killing	Stopping container payload-processing
23:32:24	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w2-b52922-5cdf4b5945-74njv	Killing	Stopping container payload-processing
23:32:30	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	Killing	Stopping container istio-proxy
23:32:30	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	Killing	Stopping container istio-proxy
23:32:34	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
23:32:34	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:32:34	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
23:32:34	openshift-ingress	kubelet	e2e-shared-a-w2-b52922-openshift-default-76f7cc4666-b2cvd	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:32:41	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484	Killing	Stopping container payload-processing
23:32:41	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w2-efffde-5c7c9f9f75-7w484	Killing	Stopping container payload-processing
23:32:41	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7	Killing	Stopping container payload-pre-processing
23:32:41	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w2-efffde-79c576d8f8-s2tr7	Killing	Stopping container payload-pre-processing
23:32:44	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk	Killing	Stopping container payload-pre-processing
23:32:44	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w4-825f30-55bbd6c5fd-bh7rk	Killing	Stopping container payload-pre-processing
23:32:44	openshift-ingress	kubelet	payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc	Killing	Stopping container payload-processing
23:32:44	openshift-ingress	kubelet	payload-processing-e2e-worker-w4-825f30-85d7bd455-jjvvc	Killing	Stopping container payload-processing
23:32:48	openshift-ingress	kubelet	e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	Killing	Stopping container istio-proxy
23:32:48	openshift-ingress	kubelet	e2e-shared-b-w2-efffde-openshift-default-7bf694c556-t5sjc	Killing	Stopping container istio-proxy
23:32:50	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc	Killing	Stopping container payload-pre-processing
23:32:50	openshift-ingress	endpoint-controller	payload-pre-processing-e2e-worker-w0-736809	FailedToUpdateEndpoint	Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-736809: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-736809": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-736809, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8eb4bd5c-99e8-4cd2-b7fb-7d5295e28848, UID in object meta:
23:32:50	openshift-ingress	kubelet	payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs	Killing	Stopping container payload-processing
23:32:50	openshift-ingress	kubelet	payload-pre-processing-e2e-worker-w0-736809-6b85fbdd6-vtccc	Killing	Stopping container payload-pre-processing
23:32:50	openshift-ingress	endpoint-controller	payload-pre-processing-e2e-worker-w0-736809	FailedToUpdateEndpoint	Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-736809: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-736809": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-736809, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8eb4bd5c-99e8-4cd2-b7fb-7d5295e28848, UID in object meta:
23:32:50	openshift-ingress	kubelet	payload-processing-e2e-worker-w0-736809-68ddd69c57-jvxfs	Killing	Stopping container payload-processing
23:32:51	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
23:32:51	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:32:51	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
23:32:51	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	Killing	Stopping container istio-proxy
23:32:51	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	Killing	Stopping container istio-proxy
23:32:51	openshift-ingress	kubelet	e2e-worker-w4-825f30-openshift-default-85558f6fd8-7r98z	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:32:57	openshift-ingress	kubelet	e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	Killing	Stopping container istio-proxy
23:32:57	openshift-ingress	kubelet	e2e-worker-w0-736809-openshift-default-58bd7799bb-5ktgw	Killing	Stopping container istio-proxy
23:33:12	opendatahub	kubelet	test-curl-7853-fd8981	Started	Started container test-curl-7853-fd8981
23:33:12	opendatahub	multus	test-curl-7853-fd8981	AddedInterface	Add eth0 [10.132.0.93/23] from ovn-kubernetes
23:33:12	opendatahub	kubelet	test-curl-7853-fd8981	Created	Created container: test-curl-7853-fd8981
23:33:12	opendatahub	kubelet	test-curl-7853-fd8981	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine
23:33:15	opendatahub	kubelet	test-curl-7853-fd8981	Killing	Stopping container test-curl-7853-fd8981
23:34:41	opendatahub	kubelet	test-curl-7853-a6a3d6	Started	Started container test-curl-7853-a6a3d6
23:34:41	opendatahub	multus	test-curl-7853-a6a3d6	AddedInterface	Add eth0 [10.132.0.94/23] from ovn-kubernetes
23:34:41	opendatahub	kubelet	test-curl-7853-a6a3d6	Created	Created container: test-curl-7853-a6a3d6
23:34:41	opendatahub	kubelet	test-curl-7853-a6a3d6	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine
23:34:43	opendatahub	kubelet	test-curl-7853-a6a3d6	Killing	Stopping container test-curl-7853-a6a3d6
23:34:43	opendatahub	kubelet	test-curl-7853-fb8638	Started	Started container test-curl-7853-fb8638
23:34:43	opendatahub	multus	test-curl-7853-fb8638	AddedInterface	Add eth0 [10.132.0.95/23] from ovn-kubernetes
23:34:43	opendatahub	kubelet	test-curl-7853-fb8638	Pulled	Container image "registry.access.redhat.com/ubi9/ubi-minimal:9.5" already present on machine
23:34:43	opendatahub	kubelet	test-curl-7853-fb8638	Created	Created container: test-curl-7853-fb8638
23:34:45	opendatahub	kubelet	test-curl-7853-fb8638	Killing	Stopping container test-curl-7853-fb8638
23:36:16	openshift-ingress	multus	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	AddedInterface	Add eth0 [10.132.0.96/23] from ovn-kubernetes
23:36:16	openshift-ingress	multus	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	AddedInterface	Add eth0 [10.132.0.96/23] from ovn-kubernetes
23:36:16	openshift-ingress	deployment-controller	e2e-ipp-a-36fb5c-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ipp-a-36fb5c-openshift-default-5cf8c45564 from 0 to 1
23:36:16	openshift-ingress	gateway_labeler_controller	e2e-ipp-a-36fb5c	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-36fb5c
23:36:16	openshift-ingress	replicaset-controller	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564	SuccessfulCreate	Created pod: e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq
23:36:16	openshift-ingress	gateway_labeler_controller	e2e-ipp-a-36fb5c	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-36fb5c
23:36:16	openshift-ingress	replicaset-controller	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564	SuccessfulCreate	Created pod: e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq
23:36:16	openshift-ingress	deployment-controller	e2e-ipp-a-36fb5c-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ipp-a-36fb5c-openshift-default-5cf8c45564 from 0 to 1
23:36:19	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ipp-a-36fb5c namespace
23:36:21	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-a-36fb5c	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-a-36fb5c-86ffd6687 from 0 to 1
23:36:21	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-a-36fb5c	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b from 0 to 1
23:36:21 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-36fb5c: serviceaccount "payload-processing-e2e-ipp-a-36fb5c" not found
23:36:21	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-a-36fb5c	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b from 0 to 1
23:36:21	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr
23:36:21	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-36fb5c-86ffd6687	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj
23:36:21	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-36fb5c-86ffd6687	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj
23:36:21	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr
23:36:21 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-36fb5c-86ffd6687	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-a-36fb5c-86ffd6687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-36fb5c: serviceaccount "payload-processing-e2e-ipp-a-36fb5c" not found
23:36:21	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-a-36fb5c	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-a-36fb5c-86ffd6687 from 0 to 1
23:36:21 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-36fb5c: serviceaccount "payload-processing-e2e-ipp-a-36fb5c" not found
23:36:21 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-a-36fb5c-86ffd6687	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-a-36fb5c-86ffd6687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-36fb5c: serviceaccount "payload-processing-e2e-ipp-a-36fb5c" not found
23:36:22	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj	Created	Created container: payload-processing
23:36:22	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr	Started	Started container payload-pre-processing
23:36:22	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:36:22	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:36:22	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj	Started	Started container payload-processing
23:36:22	openshift-ingress	multus	payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj	AddedInterface	Add eth0 [10.133.0.89/23] from ovn-kubernetes
23:36:22	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr	Created	Created container: payload-pre-processing
23:36:22	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr	Started	Started container payload-pre-processing
23:36:22	openshift-ingress	multus	payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr	AddedInterface	Add eth0 [10.133.0.88/23] from ovn-kubernetes
23:36:22	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:36:22	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr	Created	Created container: payload-pre-processing
23:36:22	openshift-ingress	multus	payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj	AddedInterface	Add eth0 [10.133.0.89/23] from ovn-kubernetes
23:36:22	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:36:22	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj	Created	Created container: payload-processing
23:36:22	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj	Started	Started container payload-processing
23:36:22	openshift-ingress	multus	payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr	AddedInterface	Add eth0 [10.133.0.88/23] from ovn-kubernetes
23:36:37 (x2)	openshift-ingress	kubelet	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	Created	Created container: istio-proxy
23:36:37 (x2)	openshift-ingress	kubelet	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:36:37 (x2)	openshift-ingress	kubelet	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:36:37 (x2)	openshift-ingress	kubelet	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	Started	Started container istio-proxy
23:36:37 (x2)	openshift-ingress	kubelet	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	Created	Created container: istio-proxy
23:36:37 (x2)	openshift-ingress	kubelet	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	Started	Started container istio-proxy
23:36:43 (x6)	openshift-ingress	kubelet	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	ProbeError	Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
23:36:43 (x6)	openshift-ingress	kubelet	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	Unhealthy	Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
23:36:43 (x6)	openshift-ingress	kubelet	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	Unhealthy	Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
23:36:43 (x6)	openshift-ingress	kubelet	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	ProbeError	Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
23:36:44	openshift-ingress	gateway_labeler_controller	e2e-ipp-b-3c1ddb	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-3c1ddb
23:36:44	openshift-ingress	gateway_labeler_controller	e2e-ipp-b-3c1ddb	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-3c1ddb
23:36:45	openshift-ingress	deployment-controller	e2e-ipp-b-3c1ddb-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6 from 0 to 1
23:36:45	openshift-ingress	multus	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	AddedInterface	Add eth0 [10.133.0.90/23] from ovn-kubernetes
23:36:45	openshift-ingress	replicaset-controller	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6	SuccessfulCreate	Created pod: e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2
23:36:45	openshift-ingress	multus	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	AddedInterface	Add eth0 [10.133.0.90/23] from ovn-kubernetes
23:36:45	openshift-ingress	replicaset-controller	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6	SuccessfulCreate	Created pod: e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2
23:36:45	openshift-ingress	deployment-controller	e2e-ipp-b-3c1ddb-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6 from 0 to 1
23:36:48	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ipp-b-3c1ddb namespace
23:36:51 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3c1ddb: serviceaccount "payload-processing-e2e-ipp-b-3c1ddb" not found
23:36:51	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685
23:36:51	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-b-3c1ddb	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5 from 0 to 1
23:36:51	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7
23:36:51 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3c1ddb: serviceaccount "payload-processing-e2e-ipp-b-3c1ddb" not found
23:36:51	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-b-3c1ddb	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5 from 0 to 1
23:36:51	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7
23:36:51 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3c1ddb: serviceaccount "payload-processing-e2e-ipp-b-3c1ddb" not found
23:36:51	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-b-3c1ddb	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6 from 0 to 1
23:36:51	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-b-3c1ddb	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6 from 0 to 1
23:36:51	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685
23:36:51 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-3c1ddb: serviceaccount "payload-processing-e2e-ipp-b-3c1ddb" not found
23:36:52	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685	Created	Created container: payload-pre-processing
23:36:52	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7	Started	Started container payload-processing
23:36:52	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685	Created	Created container: payload-pre-processing
23:36:52	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685	Started	Started container payload-pre-processing
23:36:52	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685	Started	Started container payload-pre-processing
23:36:52	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:36:52	openshift-ingress	multus	payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685	AddedInterface	Add eth0 [10.132.0.98/23] from ovn-kubernetes
23:36:52	openshift-ingress	multus	payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685	AddedInterface	Add eth0 [10.132.0.98/23] from ovn-kubernetes
23:36:52	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7	Started	Started container payload-processing
23:36:52	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7	Created	Created container: payload-processing
23:36:52	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:36:52	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:36:52	openshift-ingress	multus	payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7	AddedInterface	Add eth0 [10.132.0.99/23] from ovn-kubernetes
23:36:52	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:36:52	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7	Created	Created container: payload-processing
23:36:52	openshift-ingress	multus	payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7	AddedInterface	Add eth0 [10.132.0.99/23] from ovn-kubernetes
23:37:03	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	ProbeError	Readiness probe error: Get "http://10.133.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
23:37:03	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	Unhealthy	Readiness probe failed: Get "http://10.133.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
23:37:03	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	Unhealthy	Readiness probe failed: Get "http://10.133.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
23:37:03	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	ProbeError	Readiness probe error: Get "http://10.133.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
23:37:04 (x2)	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	Started	Started container istio-proxy
23:37:04 (x2)	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	Started	Started container istio-proxy
23:37:04 (x2)	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:37:04 (x2)	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	Created	Created container: istio-proxy
23:37:04 (x2)	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	Created	Created container: istio-proxy
23:37:04 (x2)	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:37:10 (x5)	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	ProbeError	Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:
23:37:10 (x5)	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	Unhealthy	Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
23:37:10 (x5)	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	ProbeError	Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:
23:37:10 (x5)	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	Unhealthy	Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
23:37:55	openshift-ingress	gateway_labeler_controller	e2e-ipp-cleanup-26b61a	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-26b61a
23:37:55	openshift-ingress	deployment-controller	e2e-ipp-cleanup-26b61a-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b from 0 to 1
23:37:55	openshift-ingress	replicaset-controller	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b	SuccessfulCreate	Created pod: e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv
23:37:55	openshift-ingress	deployment-controller	e2e-ipp-cleanup-26b61a-openshift-default	ScalingReplicaSet	Scaled up replica set e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b from 0 to 1
23:37:55	openshift-ingress	replicaset-controller	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b	SuccessfulCreate	Created pod: e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv
23:37:55	openshift-ingress	gateway_labeler_controller	e2e-ipp-cleanup-26b61a	AddedLabel	Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-26b61a
23:37:56	openshift-ingress	multus	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	AddedInterface	Add eth0 [10.133.0.91/23] from ovn-kubernetes
23:37:56	openshift-ingress	multus	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	AddedInterface	Add eth0 [10.133.0.91/23] from ovn-kubernetes
23:37:58	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for ai-tenant-e2e-ipp-cleanup-26b61a namespace
23:38:02 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a: serviceaccount "payload-processing-e2e-ipp-cleanup-26b61a" not found
23:38:02 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-cleanup-26b61a-b588c6499	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a: serviceaccount "payload-processing-e2e-ipp-cleanup-26b61a" not found
23:38:02	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-cleanup-26b61a-b588c6499	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7
23:38:02	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-cleanup-26b61a	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-cleanup-26b61a-b588c6499 from 0 to 1
23:38:02 (x4)	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8	FailedCreate	Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a: serviceaccount "payload-processing-e2e-ipp-cleanup-26b61a" not found
23:38:02	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn
23:38:02	openshift-ingress	replicaset-controller	payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8	SuccessfulCreate	Created pod: payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn
23:38:02	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-cleanup-26b61a	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8 from 0 to 1
23:38:02	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-cleanup-26b61a-b588c6499	SuccessfulCreate	Created pod: payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7
23:38:02	openshift-ingress	deployment-controller	payload-pre-processing-e2e-ipp-cleanup-26b61a	ScalingReplicaSet	Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8 from 0 to 1
23:38:02	openshift-ingress	deployment-controller	payload-processing-e2e-ipp-cleanup-26b61a	ScalingReplicaSet	Scaled up replica set payload-processing-e2e-ipp-cleanup-26b61a-b588c6499 from 0 to 1
23:38:02 (x5)	openshift-ingress	replicaset-controller	payload-processing-e2e-ipp-cleanup-26b61a-b588c6499	FailedCreate	Error creating: pods "payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-26b61a: serviceaccount "payload-processing-e2e-ipp-cleanup-26b61a" not found
23:38:03	openshift-ingress	kubelet	payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:38:03	openshift-ingress	kubelet	payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7	Started	Started container payload-processing
23:38:03	openshift-ingress	multus	payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7	AddedInterface	Add eth0 [10.133.0.92/23] from ovn-kubernetes
23:38:03	openshift-ingress	kubelet	payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:38:03	openshift-ingress	multus	payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7	AddedInterface	Add eth0 [10.133.0.92/23] from ovn-kubernetes
23:38:03	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:38:03	openshift-ingress	kubelet	payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7	Created	Created container: payload-processing
23:38:03	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn	Started	Started container payload-pre-processing
23:38:03	openshift-ingress	kubelet	payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7	Created	Created container: payload-processing
23:38:03	openshift-ingress	kubelet	payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7	Started	Started container payload-processing
23:38:03	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn	Created	Created container: payload-pre-processing
23:38:03	openshift-ingress	multus	payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn	AddedInterface	Add eth0 [10.132.0.100/23] from ovn-kubernetes
23:38:03	openshift-ingress	multus	payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn	AddedInterface	Add eth0 [10.132.0.100/23] from ovn-kubernetes
23:38:03	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn	Pulled	Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
23:38:03	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn	Created	Created container: payload-pre-processing
23:38:03	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn	Started	Started container payload-pre-processing
23:38:18 (x2)	openshift-ingress	kubelet	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	Started	Started container istio-proxy
23:38:18 (x2)	openshift-ingress	kubelet	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	Started	Started container istio-proxy
23:38:18 (x2)	openshift-ingress	kubelet	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	Created	Created container: istio-proxy
23:38:18 (x2)	openshift-ingress	kubelet	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:38:18 (x2)	openshift-ingress	kubelet	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	Created	Created container: istio-proxy
23:38:18 (x2)	openshift-ingress	kubelet	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	Pulled	Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
23:38:23 (x5)	openshift-ingress	kubelet	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	Unhealthy	Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
23:38:23 (x5)	openshift-ingress	kubelet	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	ProbeError	Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:
23:38:23 (x5)	openshift-ingress	kubelet	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	ProbeError	Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:
23:38:23 (x5)	openshift-ingress	kubelet	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	Unhealthy	Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
23:38:40	openshift-ingress	endpoint-controller	payload-pre-processing-e2e-ipp-cleanup-26b61a	FailedToUpdateEndpoint	Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-26b61a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-26b61a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-26b61a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fdc851b4-bb64-4d97-9a36-da6efb00c463, UID in object meta:
23:38:40	openshift-ingress	kubelet	payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7	Killing	Stopping container payload-processing
23:38:40	openshift-ingress	kubelet	payload-processing-e2e-ipp-cleanup-26b61a-b588c6499-hprm7	Killing	Stopping container payload-processing
23:38:40	openshift-ingress	endpoint-controller	payload-pre-processing-e2e-ipp-cleanup-26b61a	FailedToUpdateEndpoint	Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-26b61a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-26b61a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-26b61a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fdc851b4-bb64-4d97-9a36-da6efb00c463, UID in object meta:
23:38:40	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn	Killing	Stopping container payload-pre-processing
23:38:40	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-cleanup-26b61a-6f7d7494f8-sspvn	Killing	Stopping container payload-pre-processing
23:38:47	openshift-ingress	kubelet	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	Killing	Stopping container istio-proxy
23:38:47	openshift-ingress	kubelet	e2e-ipp-cleanup-26b61a-openshift-default-84fb4bcd9b-psbrv	Killing	Stopping container istio-proxy
23:39:06	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj	Killing	Stopping container payload-processing
23:39:06	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr	Killing	Stopping container payload-pre-processing
23:39:06	openshift-ingress	kubelet	payload-processing-e2e-ipp-a-36fb5c-86ffd6687-m84nj	Killing	Stopping container payload-processing
23:39:06	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-a-36fb5c-cfdc7774b-8q6zr	Killing	Stopping container payload-pre-processing
23:40:00	openshift-ingress	kubelet	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	Killing	Stopping container istio-proxy
23:40:00	openshift-ingress	kubelet	e2e-ipp-a-36fb5c-openshift-default-5cf8c45564-mgnvq	Killing	Stopping container istio-proxy
23:40:11	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685	Killing	Stopping container payload-pre-processing
23:40:11	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7	Killing	Stopping container payload-processing
23:40:11	openshift-ingress	kubelet	payload-pre-processing-e2e-ipp-b-3c1ddb-7bc95d6cb6-4f685	Killing	Stopping container payload-pre-processing
23:40:11	openshift-ingress	kubelet	payload-processing-e2e-ipp-b-3c1ddb-c4cd49bb5-944f7	Killing	Stopping container payload-processing
23:40:18	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	Killing	Stopping container istio-proxy
23:40:18	openshift-ingress	kubelet	e2e-ipp-b-3c1ddb-openshift-default-77fb4dd6-fdgw2	Killing	Stopping container istio-proxy
23:40:29	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq	Killing	Stopping container payload-pre-processing
23:40:29	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-a-w3-f80c49-7b77c9d76b-6zkkq	Killing	Stopping container payload-pre-processing
23:40:29	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6	Killing	Stopping container payload-processing
23:40:29	openshift-ingress	kubelet	payload-processing-e2e-shared-a-w3-f80c49-b4c6c4b79-5pdw6	Killing	Stopping container payload-processing
23:40:36	openshift-ingress	kubelet	e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	Killing	Stopping container istio-proxy
23:40:36	openshift-ingress	kubelet	e2e-shared-a-w3-f80c49-openshift-default-5887749d84-mz94t	Killing	Stopping container istio-proxy
23:40:47	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq	Killing	Stopping container payload-pre-processing
23:40:47	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc	Killing	Stopping container payload-processing
23:40:47	openshift-ingress	kubelet	payload-processing-e2e-shared-b-w3-f6ac6e-6c5847d467-9p8nc	Killing	Stopping container payload-processing
23:40:47	openshift-ingress	kubelet	payload-pre-processing-e2e-shared-b-w3-f6ac6e-66b668f9f4-26tvq	Killing	Stopping container payload-pre-processing
23:40:54	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	Killing	Stopping container istio-proxy
23:40:54	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	Killing	Stopping container istio-proxy
23:40:55	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:40:55	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
23:40:55	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	ProbeError	Readiness probe error: HTTP probe failed with statuscode: 503 body:
23:40:55	openshift-ingress	kubelet	e2e-shared-b-w3-f6ac6e-openshift-default-578dc9df7b-tb9z5	Unhealthy	Readiness probe failed: HTTP probe failed with statuscode: 503
23:40:56	opendatahub	replicaset-controller	maas-controller-947db468d	SuccessfulDelete	Deleted pod: maas-controller-947db468d-2qdk6
23:40:56	opendatahub	kubelet	maas-controller-947db468d-2qdk6	Killing	Stopping container manager
23:41:58	opendatahub	replicaset-controller	maas-controller-947db468d	SuccessfulCreate	Created pod: maas-controller-947db468d-hqknz
23:41:58	opendatahub	kubelet	maas-controller-947db468d-hqknz	Pulling	Pulling image "quay.io/opendatahub/maas-controller@sha256:30a9b9205a9650717df2e18a15662ad01e050a58df1f818d6ef97e8ae29c7087"
23:41:58	opendatahub	multus	maas-controller-947db468d-hqknz	AddedInterface	Add eth0 [10.133.0.98/23] from ovn-kubernetes
23:41:59	opendatahub	kubelet	maas-controller-947db468d-hqknz	Started	Started container manager
23:41:59	opendatahub	kubelet	maas-controller-947db468d-hqknz	Created	Created container: manager
23:41:59	opendatahub	kubelet	maas-controller-947db468d-hqknz	Pulled	Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:30a9b9205a9650717df2e18a15662ad01e050a58df1f818d6ef97e8ae29c7087" in 455ms (455ms including waiting). Image size: 198031682 bytes.
23:42:15	opendatahub	maas-controller-947db468d-hqknz_6b353e07-f730-4afb-82c1-83be2367dad3	maas-controller.models-as-a-service.opendatahub.io	LeaderElection	maas-controller-947db468d-hqknz_6b353e07-f730-4afb-82c1-83be2367dad3 became leader
23:42:19 (x2)	opendatahub	deployment-controller	maas-controller	ScalingReplicaSet	Scaled down replica set maas-controller-947db468d from 1 to 0
23:42:19	opendatahub	replicaset-controller	maas-controller-947db468d	SuccessfulDelete	Deleted pod: maas-controller-947db468d-hqknz
23:42:19	opendatahub	kubelet	maas-controller-947db468d-hqknz	Killing	Stopping container manager
23:42:21	opendatahub	multus	maas-controller-947db468d-2z9k2	AddedInterface	Add eth0 [10.133.0.99/23] from ovn-kubernetes
23:42:21	opendatahub	kubelet	maas-controller-947db468d-2z9k2	Pulling	Pulling image "quay.io/opendatahub/maas-controller@sha256:30a9b9205a9650717df2e18a15662ad01e050a58df1f818d6ef97e8ae29c7087"
23:42:21 (x3)	opendatahub	deployment-controller	maas-controller	ScalingReplicaSet	Scaled up replica set maas-controller-947db468d from 0 to 1
23:42:21	opendatahub	replicaset-controller	maas-controller-947db468d	SuccessfulCreate	Created pod: maas-controller-947db468d-2z9k2
23:42:22	opendatahub	kubelet	maas-controller-947db468d-2z9k2	Pulled	Successfully pulled image "quay.io/opendatahub/maas-controller@sha256:30a9b9205a9650717df2e18a15662ad01e050a58df1f818d6ef97e8ae29c7087" in 370ms (370ms including waiting). Image size: 198031682 bytes.
23:42:22	opendatahub	kubelet	maas-controller-947db468d-2z9k2	Created	Created container: manager
23:42:22	opendatahub	kubelet	maas-controller-947db468d-2z9k2	Started	Started container manager
23:42:38	opendatahub	maas-controller-947db468d-2z9k2_615c2927-8b1b-4a7e-8d7d-8f64d7cdf9e5	maas-controller.models-as-a-service.opendatahub.io	LeaderElection	maas-controller-947db468d-2z9k2_615c2927-8b1b-4a7e-8d7d-8f64d7cdf9e5 became leader
23:43:56	kuadrant-system	replicaset-controller	kuadrant-operator-controller-manager-5769f99d9f	SuccessfulDelete	Deleted pod: kuadrant-operator-controller-manager-5769f99d9f-brvgh
23:43:56	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5769f99d9f-brvgh	Killing	Stopping container manager
23:43:56	kuadrant-system	deployment-controller	kuadrant-operator-controller-manager	ScalingReplicaSet	Scaled down replica set kuadrant-operator-controller-manager-5769f99d9f from 1 to 0
23:44:56 (x2)	kuadrant-system	deployment-controller	kuadrant-operator-controller-manager	ScalingReplicaSet	Scaled up replica set kuadrant-operator-controller-manager-5769f99d9f from 0 to 1
23:44:56	kuadrant-system	replicaset-controller	kuadrant-operator-controller-manager-5769f99d9f	SuccessfulCreate	Created pod: kuadrant-operator-controller-manager-5769f99d9f-z9m8r
23:44:57	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5769f99d9f-z9m8r	Pulled	Container image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:cc2471e083a549afb80327aa87e1d32f05e40561c3f82275b0cdb88af5ee5e8e" already present on machine
23:44:57 (x3)	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	AllRequirementsMet	all requirements found, attempting install
23:44:57 (x5)	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	InstallSucceeded	waiting for install components to report healthy
23:44:57 (x3)	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	InstallWaiting	installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
23:44:57	kuadrant-system	multus	kuadrant-operator-controller-manager-5769f99d9f-z9m8r	AddedInterface	Add eth0 [10.132.0.101/23] from ovn-kubernetes
23:44:57	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5769f99d9f-z9m8r	Created	Created container: manager
23:44:57	kuadrant-system	kubelet	kuadrant-operator-controller-manager-5769f99d9f-z9m8r	Started	Started container manager
23:44:57 (x2)	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	ComponentUnhealthy	installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
23:44:57 (x2)	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	NeedsReinstall	installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.
23:45:08 (x4)	kuadrant-system	operator-lifecycle-manager	rhcl-operator.v1.4.3	InstallSucceeded	install strategy completed with no errors
23:45:13	kuadrant-system	kuadrant-operator-controller-manager-5769f99d9f-z9m8r_fa32cb87-2914-48aa-9b96-a78500187259	f139389e.kuadrant.io	LeaderElection	kuadrant-operator-controller-manager-5769f99d9f-z9m8r_fa32cb87-2914-48aa-9b96-a78500187259 became leader
23:47:20 (x5)	openshift-operator-lifecycle-manager	controllermanager	packageserver-pdb	NoPods	No matching pods found
23:47:22	openshift-kube-controller-manager	cluster-policy-controller-namespace-security-allocation-controller		CreatedSCCRanges	created SCC ranges for openshift-must-gather-7zwb4 namespace