Jun 09 12:28:58.359921 ip-10-0-133-167 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 12:28:58.359931 ip-10-0-133-167 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 12:28:58.359938 ip-10-0-133-167 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 12:28:58.360080 ip-10-0-133-167 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 12:29:08.433743 ip-10-0-133-167 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 12:29:08.433757 ip-10-0-133-167 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f7a794db65b445d68941cef362d6108d -- Jun 09 12:31:42.177832 ip-10-0-133-167 systemd[1]: Starting Kubernetes Kubelet... Jun 09 12:31:42.604639 ip-10-0-133-167 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:31:42.604639 ip-10-0-133-167 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 12:31:42.604639 ip-10-0-133-167 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:31:42.604639 ip-10-0-133-167 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 12:31:42.604639 ip-10-0-133-167 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:31:42.605933 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.605849 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 12:31:42.611842 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611825 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:42.611842 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611842 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611845 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611849 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611852 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611854 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611857 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611859 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611862 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611866 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611869 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611872 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611874 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611877 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611880 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611883 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611885 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611888 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611890 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611893 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611895 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:42.611914 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611905 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611908 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611910 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611913 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611915 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611918 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611921 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611924 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611927 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611930 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611933 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611935 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611939 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611943 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611946 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611950 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611952 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611955 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611958 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611961 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:42.612433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611964 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611967 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611970 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611972 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611974 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611977 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611980 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611982 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611985 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611987 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611990 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611992 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611994 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.611998 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612001 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612004 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612008 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612012 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612015 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612020 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:42.613188 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612022 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612025 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612027 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612030 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612033 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612035 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612038 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612041 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612044 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612046 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612049 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612052 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612054 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612057 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612060 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612062 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612065 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612067 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612070 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:42.613696 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612072 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612075 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612077 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612081 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612084 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612087 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612090 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612095 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612098 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612101 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612104 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612106 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612109 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612111 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612114 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612117 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612119 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612122 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:42.614151 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.612124 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614402 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614413 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614417 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614420 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614423 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614426 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614429 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614433 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614436 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614438 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614441 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614444 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614446 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614450 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614454 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614457 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614459 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614462 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:42.614627 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614466 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614469 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614472 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614475 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614477 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614480 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614482 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614485 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614488 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614493 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614495 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614498 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614501 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614503 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614506 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614510 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614514 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614516 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614519 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614522 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:42.615093 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614525 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614528 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614531 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614533 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614536 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614539 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614541 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614544 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614546 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614549 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614552 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614554 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614576 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614580 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614583 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614585 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614588 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614591 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614594 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614596 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:42.615591 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614599 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614601 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614604 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614607 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614609 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614612 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614614 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614617 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614620 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614623 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614626 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614628 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614631 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614633 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614636 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614639 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614641 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614644 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614646 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614649 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:42.616081 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614651 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614654 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614656 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614661 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614665 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614668 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614670 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614673 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614676 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614679 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614682 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614684 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614687 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614689 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614692 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614695 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614697 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614700 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614702 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:42.616579 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614705 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.614708 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615073 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615077 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615081 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615084 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615087 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615089 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615092 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615095 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615097 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615100 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615102 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615105 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615108 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615110 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615113 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615116 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615119 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615121 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:42.617031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615124 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615126 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615129 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615132 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615134 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615137 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615139 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615142 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615144 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615147 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615150 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615152 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615155 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615158 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615160 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615163 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615166 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615170 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615174 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:42.617510 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615177 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615180 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615183 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615186 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615188 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615191 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615193 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615196 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615198 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615201 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615213 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615216 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615219 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615224 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615227 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615231 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615233 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615236 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615239 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615241 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:42.617981 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615244 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615246 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615249 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615252 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615254 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615258 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615261 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615264 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615266 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615269 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615272 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615274 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615277 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615280 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615282 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615285 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615287 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615290 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615292 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615295 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:42.618457 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615297 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615300 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615302 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615305 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615307 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615312 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615315 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615318 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615323 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615326 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615328 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615331 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615333 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615337 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615339 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615342 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615344 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615347 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615349 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:42.618984 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615352 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615354 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.615357 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615428 2564 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615435 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615441 2564 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615446 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615450 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615453 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615457 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615461 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615464 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615466 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615470 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615473 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615476 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615479 2564 flags.go:64] FLAG: --cgroup-root="" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615482 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615485 2564 flags.go:64] FLAG: --client-ca-file="" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615488 2564 flags.go:64] FLAG: --cloud-provider="external" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615492 2564 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615497 2564 flags.go:64] FLAG: --cluster-domain="" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615499 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615502 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 12:31:42.619473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615506 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615509 2564 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615513 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615515 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615518 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615521 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615524 2564 flags.go:64] FLAG: --contention-profiling="false" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615527 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615530 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615534 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615536 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615541 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615543 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615546 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615549 2564 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615552 2564 flags.go:64] FLAG: --enable-server="true" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615555 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615571 2564 flags.go:64] FLAG: --event-burst="100" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615574 2564 flags.go:64] FLAG: --event-qps="50" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615577 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615580 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615583 2564 flags.go:64] FLAG: --eviction-hard="" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615587 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615590 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615593 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 12:31:42.620063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615596 2564 flags.go:64] FLAG: --eviction-soft="" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615599 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615602 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615605 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615609 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615612 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615615 2564 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615618 2564 flags.go:64] FLAG: --feature-gates="" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615622 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615625 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615627 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615631 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615633 2564 flags.go:64] FLAG: --healthz-port="10248" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615636 2564 flags.go:64] FLAG: --help="false" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615639 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615642 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615645 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615648 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615651 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615654 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615657 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615660 2564 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615663 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 12:31:42.620676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615666 2564 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615669 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615672 2564 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615675 2564 flags.go:64] FLAG: --kube-reserved="" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615677 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615680 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615683 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615686 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615689 2564 flags.go:64] FLAG: --lock-file="" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615691 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615694 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615697 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615705 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615708 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615711 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615713 2564 flags.go:64] FLAG: --logging-format="text" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615717 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615720 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615723 2564 flags.go:64] FLAG: --manifest-url="" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615726 2564 flags.go:64] FLAG: --manifest-url-header="" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615730 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615732 2564 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615736 2564 flags.go:64] FLAG: --max-pods="110" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615739 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615742 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 12:31:42.621294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615745 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615748 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615751 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615754 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615756 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615763 2564 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615766 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615769 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615772 2564 flags.go:64] FLAG: --pod-cidr="" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615775 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615781 2564 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615783 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615787 2564 flags.go:64] FLAG: --pods-per-core="0" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615790 2564 flags.go:64] FLAG: --port="10250" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615796 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615799 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09eac8fe3346e7617" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615802 2564 flags.go:64] FLAG: --qos-reserved="" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615805 2564 flags.go:64] FLAG: --read-only-port="10255" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615808 2564 flags.go:64] FLAG: --register-node="true" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615815 2564 flags.go:64] FLAG: --register-with-taints="" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615819 2564 flags.go:64] FLAG: --registry-burst="10" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615822 2564 flags.go:64] FLAG: --registry-qps="5" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615825 2564 flags.go:64] FLAG: --reserved-cpus="" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615828 2564 flags.go:64] FLAG: --reserved-memory="" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615832 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 12:31:42.621927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615835 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615838 2564 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615841 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615843 2564 flags.go:64] FLAG: --runonce="false" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615846 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615849 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615852 2564 flags.go:64] FLAG: --seccomp-default="false" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615855 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615858 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615861 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615863 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615866 2564 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615869 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615872 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615875 2564 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615877 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615880 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615883 2564 flags.go:64] FLAG: --system-cgroups="" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615886 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615892 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615894 2564 flags.go:64] FLAG: --tls-cert-file="" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615898 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615903 2564 flags.go:64] FLAG: --tls-min-version="" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615906 2564 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615908 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 12:31:42.622524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615911 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615915 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615918 2564 flags.go:64] FLAG: --v="2" Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615922 2564 flags.go:64] FLAG: --version="false" Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615927 2564 flags.go:64] FLAG: --vmodule="" Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615931 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.615934 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616045 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616049 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616054 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616057 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616060 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616064 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616066 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616069 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616072 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616074 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616077 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616080 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616084 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:42.623145 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616087 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616090 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616093 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616096 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616098 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616101 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616103 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616106 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616110 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616112 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616115 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616118 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616120 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616124 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616127 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616130 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616132 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616135 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616138 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:42.623656 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616141 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616145 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616148 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616150 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616153 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616155 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616158 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616160 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616163 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616165 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616168 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616170 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616173 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616175 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616178 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616181 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616183 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616186 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616189 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616191 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:42.624128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616194 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616198 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616201 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616203 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616206 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616208 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616212 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616215 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616217 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616220 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616223 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616233 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616236 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616238 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616241 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616243 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616246 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616248 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616251 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616253 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:42.624626 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616256 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616258 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616261 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616263 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616266 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616269 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616272 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616274 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616277 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616279 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616282 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616284 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616287 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616291 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616294 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616297 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616299 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616302 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616306 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616309 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:42.625124 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616312 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616314 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616317 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616319 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616323 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616325 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.616328 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.616903 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.623240 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.623257 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.623915 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.623922 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.623981 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.623986 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.623989 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:42.625630 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.623993 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.623996 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.623998 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624001 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624003 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624006 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624009 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624011 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624014 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624016 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624019 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624023 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624027 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624030 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624034 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624037 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624040 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624042 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624045 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:42.626013 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624047 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624050 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624052 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624055 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624057 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624060 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624063 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624067 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624070 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624073 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624075 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624078 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624080 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624083 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624085 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624088 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624090 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624093 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624095 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:42.626528 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624098 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624101 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624103 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624106 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624108 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624111 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624114 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624116 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624119 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624121 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624124 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624126 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624128 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624131 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624134 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624137 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624139 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624142 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624145 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624148 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:42.627589 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624150 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624154 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624156 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624159 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624162 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624164 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624167 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624169 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624172 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624174 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624177 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624179 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624181 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624184 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624186 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624189 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624191 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624194 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624196 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624200 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:42.628082 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624204 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624206 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624209 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624212 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624215 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624217 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624220 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624222 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624225 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624227 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624230 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624232 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624235 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624238 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624241 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624244 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624246 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:42.628639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624249 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.624254 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624363 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624367 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624370 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624373 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624376 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624379 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624382 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624384 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624387 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624389 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624392 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624394 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624397 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:31:42.629049 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624399 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624402 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624404 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624407 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624410 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624413 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624415 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624418 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624420 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624423 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624426 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624428 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624431 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624433 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624436 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624439 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624442 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624444 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624446 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624449 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:31:42.629418 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624451 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624454 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624456 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624459 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624461 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624464 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624466 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624468 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624471 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624473 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624476 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624478 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624481 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624483 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624486 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624489 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624491 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624494 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624498 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:31:42.629938 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624501 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624504 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624507 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624510 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624514 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624517 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624520 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624524 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624526 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624530 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624532 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624535 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624537 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624540 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624542 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624544 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624547 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624549 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624552 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:31:42.630396 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624556 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624575 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624577 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624580 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624582 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624585 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624587 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624590 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624593 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624596 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624599 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624602 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624604 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624607 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624610 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624612 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624615 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624617 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624620 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624622 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:31:42.630872 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624625 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:31:42.631368 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624628 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:31:42.631368 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624631 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:31:42.631368 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624635 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:31:42.631368 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624637 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:31:42.631368 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624640 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:31:42.631368 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624643 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:31:42.631368 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:42.624645 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:31:42.631368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.624650 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:31:42.631368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.624775 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 12:31:42.631368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.626743 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 12:31:42.631368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.628313 2564 server.go:1019] "Starting client certificate rotation" Jun 09 12:31:42.631368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.628404 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 12:31:42.631368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.628433 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 12:31:42.631751 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.631070 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 12:31:42.636128 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.636109 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 12:31:42.650953 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.650930 2564 log.go:25] "Validated CRI v1 runtime API" Jun 09 12:31:42.653364 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.653347 2564 log.go:25] "Validated CRI v1 image API" Jun 09 12:31:42.654140 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.654125 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 12:31:42.656658 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.656633 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 12:31:42.659698 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.659680 2564 fs.go:135] Filesystem UUIDs: map[5801592e-aa6d-4e42-a6af-c336515d65fc:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7df1aacd-eb0e-4961-939a-781f26db4dc8:/dev/nvme0n1p3] Jun 09 12:31:42.659755 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.659698 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 12:31:42.665813 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.665695 2564 manager.go:216] Machine: {Timestamp:2026-06-09 12:31:42.663365557 +0000 UTC m=+0.360852477 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3115248 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23d22a271872d9ddb487c274e16363 SystemUUID:ec23d22a-2718-72d9-ddb4-87c274e16363 BootID:f7a794db-65b4-45d6-8941-cef362d6108d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:82:5d:f5:1f:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:82:5d:f5:1f:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:ba:da:d8:a3:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 12:31:42.665813 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.665811 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 12:31:42.665930 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.665905 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 12:31:42.669400 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.669377 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 12:31:42.669542 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.669402 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-167.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 12:31:42.670266 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.670256 2564 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 12:31:42.670300 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.670269 2564 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 12:31:42.670300 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.670281 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 12:31:42.670928 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.670917 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 12:31:42.671803 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.671794 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 12:31:42.674891 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.674878 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 09 12:31:42.675016 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.675006 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 12:31:42.675051 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.675037 2564 kubelet.go:486] "Attempting to sync node with API server" Jun 09 12:31:42.675051 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.675048 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 12:31:42.675106 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.675062 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 12:31:42.675106 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.675074 2564 kubelet.go:398] "Adding apiserver pod source" Jun 09 12:31:42.675106 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.675083 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 12:31:42.675489 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.675463 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nvd6v" Jun 09 12:31:42.675489 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.675479 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 12:31:42.675617 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.675528 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 12:31:42.678471 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.678453 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 12:31:42.679919 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.679907 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 12:31:42.679959 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.679936 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 12:31:42.681122 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.681111 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 12:31:42.681174 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.681128 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 12:31:42.681174 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.681134 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 12:31:42.681174 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.681138 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 12:31:42.681174 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.681147 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 12:31:42.681174 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.681152 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 12:31:42.681174 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.681160 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 12:31:42.681174 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.681165 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 12:31:42.681174 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.681171 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 12:31:42.681174 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.681177 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 12:31:42.681394 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.681185 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 12:31:42.681394 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.681190 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 12:31:42.683035 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.683024 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 12:31:42.683035 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.683036 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 12:31:42.684551 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.684527 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nvd6v" Jun 09 12:31:42.687407 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.687385 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-167.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 12:31:42.687407 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.687394 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 12:31:42.688196 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.688175 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 12:31:42.688265 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.688210 2564 server.go:1268] "Started kubelet" Jun 09 12:31:42.688825 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.688799 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 12:31:42.689220 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.689166 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 12:31:42.689328 ip-10-0-133-167 systemd[1]: Started Kubernetes Kubelet. Jun 09 12:31:42.690002 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.689354 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 12:31:42.691228 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.691212 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 12:31:42.691427 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.691394 2564 server.go:310] "Adding debug handlers to kubelet server" Jun 09 12:31:42.696432 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.696416 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 12:31:42.696674 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.696425 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 12:31:42.696674 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.696669 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found" Jun 09 12:31:42.697469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.697251 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 12:31:42.697469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.697282 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 12:31:42.697469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.697374 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 12:31:42.697674 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.697524 2564 reconstruct.go:97] "Volume reconstruction finished" Jun 09 12:31:42.697674 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.697534 2564 reconciler.go:29] "Reconciler: start to sync state" Jun 09 12:31:42.697674 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.697579 2564 factory.go:153] Registering CRI-O factory Jun 09 12:31:42.697674 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.697593 2564 factory.go:223] Registration of the crio container factory successfully Jun 09 12:31:42.697674 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.697648 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 12:31:42.697674 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.697658 2564 factory.go:55] Registering systemd factory Jun 09 12:31:42.697674 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.697667 2564 factory.go:223] Registration of the systemd container factory successfully Jun 09 12:31:42.697944 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.697690 2564 factory.go:103] Registering Raw factory Jun 09 12:31:42.697944 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.697704 2564 manager.go:1196] Started watching for new ooms in manager Jun 09 12:31:42.698147 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.698135 2564 manager.go:349] Starting recovery of all containers Jun 09 12:31:42.698895 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.698860 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 12:31:42.699210 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.699187 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 12:31:42.699582 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.699549 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 12:31:42.699862 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.698914 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-167.ec2.internal.18b7699d77c01e8f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-167.ec2.internal,UID:ip-10-0-133-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-167.ec2.internal,},FirstTimestamp:2026-06-09 12:31:42.688181903 +0000 UTC m=+0.385668824,LastTimestamp:2026-06-09 12:31:42.688181903 +0000 UTC m=+0.385668824,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-167.ec2.internal,}" Jun 09 12:31:42.707169 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.707059 2564 manager.go:354] Recovery completed Jun 09 12:31:42.712309 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.712295 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:42.713998 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.713979 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:42.714081 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.714011 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:42.714081 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.714024 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:42.714535 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.714513 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 12:31:42.714535 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.714522 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:42.714634 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.714525 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 12:31:42.714634 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.714577 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 09 12:31:42.715193 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.715178 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:42.715259 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.715204 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:42.715259 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.715218 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:42.715906 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.715892 2564 policy_none.go:49] "None policy: Start" Jun 09 12:31:42.715973 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.715909 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 12:31:42.715973 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.715921 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 12:31:42.717024 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.717015 2564 policy_none.go:47] "Start" Jun 09 12:31:42.756156 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.756136 2564 manager.go:337] "Starting Device Plugin manager" Jun 09 12:31:42.756267 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.756174 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 12:31:42.756267 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.756187 2564 server.go:87] "Starting device plugin registration server" Jun 09 12:31:42.756474 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.756456 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 12:31:42.756734 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.756474 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 12:31:42.756734 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.756662 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 12:31:42.775946 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.756744 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 12:31:42.775946 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.756753 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 12:31:42.775946 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.757480 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 12:31:42.775946 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.757534 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-167.ec2.internal\" not found" Jun 09 12:31:42.775946 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.772473 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 12:31:42.775946 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.773706 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 12:31:42.775946 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.773753 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 12:31:42.775946 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.773778 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 12:31:42.775946 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.773812 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 12:31:42.776388 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.776073 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:42.857298 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.857211 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:42.860142 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.860125 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:42.860267 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.860160 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:42.860267 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.860175 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:42.860267 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.860204 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.874473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.874449 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal"] Jun 09 12:31:42.874595 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.874513 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:42.874595 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.874527 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.874595 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.874549 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-167.ec2.internal\": node \"ip-10-0-133-167.ec2.internal\" not found" Jun 09 12:31:42.875447 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.875431 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:42.875504 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.875460 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:42.875504 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.875470 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:42.876867 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.876855 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:42.877012 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.876998 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.877115 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.877032 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:42.877573 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.877535 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:42.877657 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.877581 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:42.877657 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.877617 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:42.877657 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.877627 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:42.877657 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.877646 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:42.877802 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.877661 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:42.878899 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.878881 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.878987 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.878912 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:31:42.879593 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.879555 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:31:42.879665 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.879609 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:31:42.879665 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.879623 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:31:42.892006 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.891982 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found" Jun 09 12:31:42.899257 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.899239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63c7b38b62446b7059ee929b7e5f5e83-config\") pod \"kube-apiserver-proxy-ip-10-0-133-167.ec2.internal\" (UID: \"63c7b38b62446b7059ee929b7e5f5e83\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.899309 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.899292 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b7b5983e41cb92616dd05e9b3cc9039-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal\" (UID: \"2b7b5983e41cb92616dd05e9b3cc9039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.899343 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.899321 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b7b5983e41cb92616dd05e9b3cc9039-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal\" (UID: \"2b7b5983e41cb92616dd05e9b3cc9039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.907148 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.907131 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-167.ec2.internal\" not found" node="ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.911512 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.911497 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-167.ec2.internal\" not found" node="ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.992052 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:42.992024 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found" Jun 09 12:31:42.999681 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.999659 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b7b5983e41cb92616dd05e9b3cc9039-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal\" (UID: \"2b7b5983e41cb92616dd05e9b3cc9039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.999778 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.999692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b7b5983e41cb92616dd05e9b3cc9039-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal\" (UID: \"2b7b5983e41cb92616dd05e9b3cc9039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.999778 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.999717 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63c7b38b62446b7059ee929b7e5f5e83-config\") pod \"kube-apiserver-proxy-ip-10-0-133-167.ec2.internal\" (UID: \"63c7b38b62446b7059ee929b7e5f5e83\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.999778 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.999759 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b7b5983e41cb92616dd05e9b3cc9039-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal\" (UID: \"2b7b5983e41cb92616dd05e9b3cc9039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.999778 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.999771 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b7b5983e41cb92616dd05e9b3cc9039-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal\" (UID: \"2b7b5983e41cb92616dd05e9b3cc9039\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" Jun 09 12:31:42.999908 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:42.999773 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63c7b38b62446b7059ee929b7e5f5e83-config\") pod \"kube-apiserver-proxy-ip-10-0-133-167.ec2.internal\" (UID: \"63c7b38b62446b7059ee929b7e5f5e83\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal" Jun 09 12:31:43.092527 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:43.092492 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found" Jun 09 12:31:43.193297 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:43.193230 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found" Jun 09 12:31:43.210685 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.210662 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" Jun 09 12:31:43.216082 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.216062 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal" Jun 09 12:31:43.293768 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:43.293731 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found" Jun 09 12:31:43.394296 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:43.394275 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found" Jun 09 12:31:43.494845 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:43.494772 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found" Jun 09 12:31:43.551950 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.551928 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:43.595427 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:43.595410 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found" Jun 09 12:31:43.627805 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.627780 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 12:31:43.628250 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.627890 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 12:31:43.628250 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.627934 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 12:31:43.690945 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.690904 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 12:26:42 +0000 UTC" deadline="2028-01-21 09:50:48.687371077 +0000 UTC" Jun 09 12:31:43.690945 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.690942 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14181h19m4.996433782s" Jun 09 12:31:43.695674 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:43.695650 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found" Jun 09 12:31:43.696715 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.696699 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:43.696833 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.696817 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 12:31:43.697409 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.697396 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" Jun 09 12:31:43.707781 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.707762 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 12:31:43.708599 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.708585 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 12:31:43.709532 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.709516 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal" Jun 09 12:31:43.710453 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.710435 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:43.715885 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.715866 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 12:31:43.730411 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.730393 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nbmw8" Jun 09 12:31:43.736210 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.736194 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nbmw8" Jun 09 12:31:43.772639 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:43.772607 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c7b38b62446b7059ee929b7e5f5e83.slice/crio-2650bbc4a4a57663c85c9849928fca4445ee1fa51bd8cb0994c4ab3f15fe6ef5 WatchSource:0}: Error finding container 2650bbc4a4a57663c85c9849928fca4445ee1fa51bd8cb0994c4ab3f15fe6ef5: Status 404 returned error can't find the container with id 2650bbc4a4a57663c85c9849928fca4445ee1fa51bd8cb0994c4ab3f15fe6ef5 Jun 09 12:31:43.773117 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:43.773104 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7b5983e41cb92616dd05e9b3cc9039.slice/crio-1db2ac3b60a2a001c7f34bc0e34fbc274e3a3f94f264e9c2e4b0981389323db4 WatchSource:0}: Error finding container 1db2ac3b60a2a001c7f34bc0e34fbc274e3a3f94f264e9c2e4b0981389323db4: Status 404 returned error can't find the container with id 1db2ac3b60a2a001c7f34bc0e34fbc274e3a3f94f264e9c2e4b0981389323db4 Jun 09 12:31:43.777430 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.777417 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:31:43.778603 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.778553 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal" event={"ID":"63c7b38b62446b7059ee929b7e5f5e83","Type":"ContainerStarted","Data":"2650bbc4a4a57663c85c9849928fca4445ee1fa51bd8cb0994c4ab3f15fe6ef5"} Jun 09 12:31:43.779772 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:43.779753 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" event={"ID":"2b7b5983e41cb92616dd05e9b3cc9039","Type":"ContainerStarted","Data":"1db2ac3b60a2a001c7f34bc0e34fbc274e3a3f94f264e9c2e4b0981389323db4"} Jun 09 12:31:44.589336 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.589298 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:44.676252 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.676210 2564 apiserver.go:52] "Watching apiserver" Jun 09 12:31:44.682130 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.682104 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 12:31:44.682502 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.682478 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal","openshift-multus/multus-s5bsx","openshift-multus/network-metrics-daemon-m7szl","openshift-network-diagnostics/network-check-target-827j9","openshift-network-operator/iptables-alerter-lrkgk","kube-system/global-pull-secret-syncer-2jgwm","kube-system/konnectivity-agent-6jc5n","kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx","openshift-cluster-node-tuning-operator/tuned-5n424","openshift-image-registry/node-ca-qlfnh","openshift-multus/multus-additional-cni-plugins-twwfm","openshift-ovn-kubernetes/ovnkube-node-tgb8g","openshift-dns/node-resolver-fcwvm"] Jun 09 12:31:44.684187 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.684170 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6jc5n" Jun 09 12:31:44.685417 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.685400 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qlfnh" Jun 09 12:31:44.686130 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.686110 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 12:31:44.686222 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.686140 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 12:31:44.686222 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.686140 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-phgdz\"" Jun 09 12:31:44.686573 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.686543 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:44.686661 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:44.686635 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:31:44.687201 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.687178 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 12:31:44.687294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.687223 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 12:31:44.687363 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.687322 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 12:31:44.687724 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.687706 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wmbxc\"" Jun 09 12:31:44.688206 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.688190 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:31:44.688288 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:44.688260 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:31:44.689374 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.689358 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fcwvm" Jun 09 12:31:44.690887 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.690871 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.692216 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.691442 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 12:31:44.692216 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.691524 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q9j9v\"" Jun 09 12:31:44.692216 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.691444 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 12:31:44.692216 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.692055 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.693151 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.692808 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 12:31:44.693151 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.692908 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gs8ct\"" Jun 09 12:31:44.693151 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.692961 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 12:31:44.693151 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.693080 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 12:31:44.693151 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.693134 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 12:31:44.693151 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.693135 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 12:31:44.693524 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.693508 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.693824 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.693799 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 12:31:44.694291 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.694105 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 12:31:44.694291 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.694215 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 12:31:44.694826 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.694806 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4v6q6\"" Jun 09 12:31:44.695952 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.695933 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.696103 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.696080 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 12:31:44.696366 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.696349 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 12:31:44.696507 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.696491 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-svcsw\"" Jun 09 12:31:44.697060 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.696935 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 12:31:44.697128 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.697085 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 12:31:44.698819 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.697511 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 12:31:44.698819 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.697670 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 12:31:44.698819 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.697734 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 12:31:44.699707 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.699267 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q5rr6\"" Jun 09 12:31:44.700643 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.699986 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.701656 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.701634 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 12:31:44.701740 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.701721 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:31:44.702163 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.702144 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:44.702245 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.702166 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dv5dc\"" Jun 09 12:31:44.702245 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:44.702214 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:31:44.703736 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.703718 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lrkgk" Jun 09 12:31:44.705513 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.705494 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:31:44.705684 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.705663 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 12:31:44.705779 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.705736 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fhhxn\"" Jun 09 12:31:44.705779 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.705736 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 12:31:44.711091 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711069 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-tuned\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.711195 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/593b1faa-5b02-4e90-b05c-d3b4724e8de9-ovnkube-config\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.711195 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711124 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:44.711195 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-systemd-units\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.711195 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711186 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-run-systemd\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.711388 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711234 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmhzj\" (UniqueName: \"kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj\") pod \"network-check-target-827j9\" (UID: \"d203da4c-dafa-49d8-8bcd-9caf517afbc1\") " pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:31:44.711388 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711261 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcq2h\" (UniqueName: \"kubernetes.io/projected/cf20c681-6757-49db-ac7a-3070a1d69d4c-kube-api-access-lcq2h\") pod \"node-resolver-fcwvm\" (UID: \"cf20c681-6757-49db-ac7a-3070a1d69d4c\") " pod="openshift-dns/node-resolver-fcwvm" Jun 09 12:31:44.711388 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711283 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6df00b4d-c9bf-4058-a168-9be06b94cfda-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.711388 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711304 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-system-cni-dir\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.711388 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711340 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-var-lib-kubelet\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.711388 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711370 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn7pq\" (UniqueName: \"kubernetes.io/projected/1b97452c-3a03-4979-81bd-655f89f05c1b-kube-api-access-mn7pq\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.711694 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.711694 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-multus-socket-dir-parent\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.711694 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711467 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-var-lib-cni-multus\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.711694 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-sys-fs\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.711694 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711516 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt9tq\" (UniqueName: \"kubernetes.io/projected/593b1faa-5b02-4e90-b05c-d3b4724e8de9-kube-api-access-wt9tq\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.711694 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf20c681-6757-49db-ac7a-3070a1d69d4c-tmp-dir\") pod \"node-resolver-fcwvm\" (UID: \"cf20c681-6757-49db-ac7a-3070a1d69d4c\") " pod="openshift-dns/node-resolver-fcwvm" Jun 09 12:31:44.711694 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-cnibin\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.711694 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711672 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-hostroot\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.711694 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711687 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-socket-dir\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6df00b4d-c9bf-4058-a168-9be06b94cfda-os-release\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711761 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-run-netns\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711790 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-sysconfig\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-sysctl-conf\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711831 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-registration-dir\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711879 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-run-openvswitch\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711899 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6df00b4d-c9bf-4058-a168-9be06b94cfda-cni-binary-copy\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6df00b4d-c9bf-4058-a168-9be06b94cfda-tuning-conf-dir\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.711983 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb82ff6b-254f-46de-842f-2aa268fa6b59-cni-binary-copy\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50a39209-1238-4fc0-b441-0f1d6fe4f192-tmp\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-slash\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712045 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-var-lib-openvswitch\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712066 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/593b1faa-5b02-4e90-b05c-d3b4724e8de9-ovnkube-script-lib\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712087 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fed43365-44f8-4220-87ec-327acf7f874f-serviceca\") pod \"node-ca-qlfnh\" (UID: \"fed43365-44f8-4220-87ec-327acf7f874f\") " pod="openshift-image-registry/node-ca-qlfnh" Jun 09 12:31:44.712113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712109 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-multus-cni-dir\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712159 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-etc-kubernetes\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712197 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-node-log\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712216 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf20c681-6757-49db-ac7a-3070a1d69d4c-hosts-file\") pod \"node-resolver-fcwvm\" (UID: \"cf20c681-6757-49db-ac7a-3070a1d69d4c\") " pod="openshift-dns/node-resolver-fcwvm" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712230 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6df00b4d-c9bf-4058-a168-9be06b94cfda-cnibin\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712253 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb82ff6b-254f-46de-842f-2aa268fa6b59-multus-daemon-config\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-run-multus-certs\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-sysctl-d\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712349 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-lib-modules\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/86e23f6f-b74a-44a7-abac-9b22598d2078-agent-certs\") pod \"konnectivity-agent-6jc5n\" (UID: \"86e23f6f-b74a-44a7-abac-9b22598d2078\") " pod="kube-system/konnectivity-agent-6jc5n" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712395 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ntkf\" (UniqueName: \"kubernetes.io/projected/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-kube-api-access-4ntkf\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712414 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-os-release\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712437 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-var-lib-kubelet\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712459 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-kubelet\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712491 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzdqc\" (UniqueName: \"kubernetes.io/projected/fed43365-44f8-4220-87ec-327acf7f874f-kube-api-access-dzdqc\") pod \"node-ca-qlfnh\" (UID: \"fed43365-44f8-4220-87ec-327acf7f874f\") " pod="openshift-image-registry/node-ca-qlfnh" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712529 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-host\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712576 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx4lt\" (UniqueName: \"kubernetes.io/projected/50a39209-1238-4fc0-b441-0f1d6fe4f192-kube-api-access-jx4lt\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.712834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712608 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/86e23f6f-b74a-44a7-abac-9b22598d2078-konnectivity-ca\") pod \"konnectivity-agent-6jc5n\" (UID: \"86e23f6f-b74a-44a7-abac-9b22598d2078\") " pod="kube-system/konnectivity-agent-6jc5n" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712641 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-run-ovn\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712656 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-multus-conf-dir\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-run\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712724 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-cni-netd\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712768 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd42r\" (UniqueName: \"kubernetes.io/projected/cb82ff6b-254f-46de-842f-2aa268fa6b59-kube-api-access-rd42r\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712799 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-systemd\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712822 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-etc-openvswitch\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712844 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlvw2\" (UniqueName: \"kubernetes.io/projected/6df00b4d-c9bf-4058-a168-9be06b94cfda-kube-api-access-rlvw2\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712869 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-run-k8s-cni-cncf-io\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712893 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-var-lib-cni-bin\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712917 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-log-socket\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-cni-bin\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712974 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.712996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6df00b4d-c9bf-4058-a168-9be06b94cfda-system-cni-dir\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.713020 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-kubernetes\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.713479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.713042 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-device-dir\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.714114 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.713062 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fed43365-44f8-4220-87ec-327acf7f874f-host\") pod \"node-ca-qlfnh\" (UID: \"fed43365-44f8-4220-87ec-327acf7f874f\") " pod="openshift-image-registry/node-ca-qlfnh" Jun 09 12:31:44.714114 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.713099 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6df00b4d-c9bf-4058-a168-9be06b94cfda-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.714114 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.713121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-modprobe-d\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.714114 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.713142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-sys\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.714114 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.713180 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-etc-selinux\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.714114 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.713211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-run-netns\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.714114 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.713249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/593b1faa-5b02-4e90-b05c-d3b4724e8de9-env-overrides\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.714114 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.713278 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/593b1faa-5b02-4e90-b05c-d3b4724e8de9-ovn-node-metrics-cert\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.738022 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.737979 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 12:26:43 +0000 UTC" deadline="2028-03-16 08:07:59.135495614 +0000 UTC" Jun 09 12:31:44.738022 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.738022 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15499h36m14.397477228s" Jun 09 12:31:44.798750 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.798724 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 12:31:44.814243 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx4lt\" (UniqueName: \"kubernetes.io/projected/50a39209-1238-4fc0-b441-0f1d6fe4f192-kube-api-access-jx4lt\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.814243 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/86e23f6f-b74a-44a7-abac-9b22598d2078-konnectivity-ca\") pod \"konnectivity-agent-6jc5n\" (UID: \"86e23f6f-b74a-44a7-abac-9b22598d2078\") " pod="kube-system/konnectivity-agent-6jc5n" Jun 09 12:31:44.814433 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814264 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-run-ovn\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.814433 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-multus-conf-dir\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.814433 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-run\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.814433 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814369 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-run\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.814433 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814375 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-multus-conf-dir\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.814433 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814366 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-run-ovn\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.814433 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-cni-netd\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.814433 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814426 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-cni-netd\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.814433 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814426 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd42r\" (UniqueName: \"kubernetes.io/projected/cb82ff6b-254f-46de-842f-2aa268fa6b59-kube-api-access-rd42r\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814457 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-systemd\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814479 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-etc-openvswitch\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d-host-slash\") pod \"iptables-alerter-lrkgk\" (UID: \"0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d\") " pod="openshift-network-operator/iptables-alerter-lrkgk" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814529 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxrkw\" (UniqueName: \"kubernetes.io/projected/0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d-kube-api-access-wxrkw\") pod \"iptables-alerter-lrkgk\" (UID: \"0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d\") " pod="openshift-network-operator/iptables-alerter-lrkgk" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlvw2\" (UniqueName: \"kubernetes.io/projected/6df00b4d-c9bf-4058-a168-9be06b94cfda-kube-api-access-rlvw2\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-run-k8s-cni-cncf-io\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814598 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-etc-openvswitch\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-var-lib-cni-bin\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814628 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-systemd\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-log-socket\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814670 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-cni-bin\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814681 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-run-k8s-cni-cncf-io\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814685 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-var-lib-cni-bin\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814720 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6df00b4d-c9bf-4058-a168-9be06b94cfda-system-cni-dir\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814728 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-log-socket\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.814872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814736 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-cni-bin\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-kubernetes\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-device-dir\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814775 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6df00b4d-c9bf-4058-a168-9be06b94cfda-system-cni-dir\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814781 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-dbus\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814826 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-kubernetes\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814856 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fed43365-44f8-4220-87ec-327acf7f874f-host\") pod \"node-ca-qlfnh\" (UID: \"fed43365-44f8-4220-87ec-327acf7f874f\") " pod="openshift-image-registry/node-ca-qlfnh" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814865 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-device-dir\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6df00b4d-c9bf-4058-a168-9be06b94cfda-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814908 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fed43365-44f8-4220-87ec-327acf7f874f-host\") pod \"node-ca-qlfnh\" (UID: \"fed43365-44f8-4220-87ec-327acf7f874f\") " pod="openshift-image-registry/node-ca-qlfnh" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-modprobe-d\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814883 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/86e23f6f-b74a-44a7-abac-9b22598d2078-konnectivity-ca\") pod \"konnectivity-agent-6jc5n\" (UID: \"86e23f6f-b74a-44a7-abac-9b22598d2078\") " pod="kube-system/konnectivity-agent-6jc5n" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814949 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-sys\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-etc-selinux\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.814999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-run-netns\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/593b1faa-5b02-4e90-b05c-d3b4724e8de9-env-overrides\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.815682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815040 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-modprobe-d\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815046 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/593b1faa-5b02-4e90-b05c-d3b4724e8de9-ovn-node-metrics-cert\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815040 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-sys\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815059 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-run-netns\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815070 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-tuned\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815085 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-etc-selinux\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/593b1faa-5b02-4e90-b05c-d3b4724e8de9-ovnkube-config\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-systemd-units\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-run-systemd\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmhzj\" (UniqueName: \"kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj\") pod \"network-check-target-827j9\" (UID: \"d203da4c-dafa-49d8-8bcd-9caf517afbc1\") " pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcq2h\" (UniqueName: \"kubernetes.io/projected/cf20c681-6757-49db-ac7a-3070a1d69d4c-kube-api-access-lcq2h\") pod \"node-resolver-fcwvm\" (UID: \"cf20c681-6757-49db-ac7a-3070a1d69d4c\") " pod="openshift-dns/node-resolver-fcwvm" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815285 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6df00b4d-c9bf-4058-a168-9be06b94cfda-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-system-cni-dir\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815354 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6df00b4d-c9bf-4058-a168-9be06b94cfda-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-var-lib-kubelet\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815373 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-run-systemd\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815408 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-systemd-units\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.816454 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:44.815441 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815443 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815475 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-system-cni-dir\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:44.815522 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs podName:731e3c8f-34be-4caa-bc70-fba5d3fa2b08 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:45.315503047 +0000 UTC m=+3.012989956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs") pod "network-metrics-daemon-m7szl" (UID: "731e3c8f-34be-4caa-bc70-fba5d3fa2b08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815533 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/593b1faa-5b02-4e90-b05c-d3b4724e8de9-env-overrides\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815552 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-var-lib-kubelet\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn7pq\" (UniqueName: \"kubernetes.io/projected/1b97452c-3a03-4979-81bd-655f89f05c1b-kube-api-access-mn7pq\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815661 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-multus-socket-dir-parent\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815670 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/593b1faa-5b02-4e90-b05c-d3b4724e8de9-ovnkube-config\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-var-lib-cni-multus\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815722 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-run-ovn-kubernetes\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-sys-fs\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815731 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-multus-socket-dir-parent\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815762 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt9tq\" (UniqueName: \"kubernetes.io/projected/593b1faa-5b02-4e90-b05c-d3b4724e8de9-kube-api-access-wt9tq\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815788 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-kubelet-config\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815793 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-sys-fs\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.817362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815813 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-var-lib-cni-multus\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf20c681-6757-49db-ac7a-3070a1d69d4c-tmp-dir\") pod \"node-resolver-fcwvm\" (UID: \"cf20c681-6757-49db-ac7a-3070a1d69d4c\") " pod="openshift-dns/node-resolver-fcwvm" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-cnibin\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815886 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-hostroot\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815907 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-socket-dir\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6df00b4d-c9bf-4058-a168-9be06b94cfda-os-release\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815935 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6df00b4d-c9bf-4058-a168-9be06b94cfda-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815947 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-cnibin\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815956 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-run-netns\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.815992 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-hostroot\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816001 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-run-netns\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816042 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-socket-dir\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816055 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6df00b4d-c9bf-4058-a168-9be06b94cfda-os-release\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-sysconfig\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816099 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-sysctl-conf\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816131 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf20c681-6757-49db-ac7a-3070a1d69d4c-tmp-dir\") pod \"node-resolver-fcwvm\" (UID: \"cf20c681-6757-49db-ac7a-3070a1d69d4c\") " pod="openshift-dns/node-resolver-fcwvm" Jun 09 12:31:44.818190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816165 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-sysconfig\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816176 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816154 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-registration-dir\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-run-openvswitch\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816210 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b97452c-3a03-4979-81bd-655f89f05c1b-registration-dir\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816238 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6df00b4d-c9bf-4058-a168-9be06b94cfda-cni-binary-copy\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6df00b4d-c9bf-4058-a168-9be06b94cfda-tuning-conf-dir\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816322 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-sysctl-conf\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb82ff6b-254f-46de-842f-2aa268fa6b59-cni-binary-copy\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816245 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-run-openvswitch\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816432 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50a39209-1238-4fc0-b441-0f1d6fe4f192-tmp\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-slash\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-var-lib-openvswitch\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816502 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6df00b4d-c9bf-4058-a168-9be06b94cfda-tuning-conf-dir\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/593b1faa-5b02-4e90-b05c-d3b4724e8de9-ovnkube-script-lib\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d-iptables-alerter-script\") pod \"iptables-alerter-lrkgk\" (UID: \"0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d\") " pod="openshift-network-operator/iptables-alerter-lrkgk" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816550 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-slash\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.819038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816585 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fed43365-44f8-4220-87ec-327acf7f874f-serviceca\") pod \"node-ca-qlfnh\" (UID: \"fed43365-44f8-4220-87ec-327acf7f874f\") " pod="openshift-image-registry/node-ca-qlfnh" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-multus-cni-dir\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-etc-kubernetes\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-node-log\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf20c681-6757-49db-ac7a-3070a1d69d4c-hosts-file\") pod \"node-resolver-fcwvm\" (UID: \"cf20c681-6757-49db-ac7a-3070a1d69d4c\") " pod="openshift-dns/node-resolver-fcwvm" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816719 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6df00b4d-c9bf-4058-a168-9be06b94cfda-cnibin\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816743 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6df00b4d-c9bf-4058-a168-9be06b94cfda-cni-binary-copy\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816827 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-multus-cni-dir\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816865 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-etc-kubernetes\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816867 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb82ff6b-254f-46de-842f-2aa268fa6b59-cni-binary-copy\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816916 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf20c681-6757-49db-ac7a-3070a1d69d4c-hosts-file\") pod \"node-resolver-fcwvm\" (UID: \"cf20c681-6757-49db-ac7a-3070a1d69d4c\") " pod="openshift-dns/node-resolver-fcwvm" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816937 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-node-log\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816957 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6df00b4d-c9bf-4058-a168-9be06b94cfda-cnibin\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816983 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-var-lib-openvswitch\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.816745 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb82ff6b-254f-46de-842f-2aa268fa6b59-multus-daemon-config\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817014 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/593b1faa-5b02-4e90-b05c-d3b4724e8de9-ovnkube-script-lib\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-run-multus-certs\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817049 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-host-run-multus-certs\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.819670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-sysctl-d\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817092 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-lib-modules\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/86e23f6f-b74a-44a7-abac-9b22598d2078-agent-certs\") pod \"konnectivity-agent-6jc5n\" (UID: \"86e23f6f-b74a-44a7-abac-9b22598d2078\") " pod="kube-system/konnectivity-agent-6jc5n" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817140 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ntkf\" (UniqueName: \"kubernetes.io/projected/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-kube-api-access-4ntkf\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817150 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb82ff6b-254f-46de-842f-2aa268fa6b59-multus-daemon-config\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-os-release\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-var-lib-kubelet\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-kubelet\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817259 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-sysctl-d\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817259 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-lib-modules\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817225 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzdqc\" (UniqueName: \"kubernetes.io/projected/fed43365-44f8-4220-87ec-327acf7f874f-kube-api-access-dzdqc\") pod \"node-ca-qlfnh\" (UID: \"fed43365-44f8-4220-87ec-327acf7f874f\") " pod="openshift-image-registry/node-ca-qlfnh" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817316 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/593b1faa-5b02-4e90-b05c-d3b4724e8de9-host-kubelet\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817328 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb82ff6b-254f-46de-842f-2aa268fa6b59-os-release\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817351 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fed43365-44f8-4220-87ec-327acf7f874f-serviceca\") pod \"node-ca-qlfnh\" (UID: \"fed43365-44f8-4220-87ec-327acf7f874f\") " pod="openshift-image-registry/node-ca-qlfnh" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817392 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-var-lib-kubelet\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817484 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-host\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.817581 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50a39209-1238-4fc0-b441-0f1d6fe4f192-host\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.818999 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/50a39209-1238-4fc0-b441-0f1d6fe4f192-etc-tuned\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.820469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.819130 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/593b1faa-5b02-4e90-b05c-d3b4724e8de9-ovn-node-metrics-cert\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.821353 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.819130 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50a39209-1238-4fc0-b441-0f1d6fe4f192-tmp\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.821353 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.819894 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/86e23f6f-b74a-44a7-abac-9b22598d2078-agent-certs\") pod \"konnectivity-agent-6jc5n\" (UID: \"86e23f6f-b74a-44a7-abac-9b22598d2078\") " pod="kube-system/konnectivity-agent-6jc5n" Jun 09 12:31:44.822289 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.822267 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlvw2\" (UniqueName: \"kubernetes.io/projected/6df00b4d-c9bf-4058-a168-9be06b94cfda-kube-api-access-rlvw2\") pod \"multus-additional-cni-plugins-twwfm\" (UID: \"6df00b4d-c9bf-4058-a168-9be06b94cfda\") " pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:44.823128 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:44.822850 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:44.823128 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:44.822876 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:44.823128 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:44.822889 2564 projected.go:196] Error preparing data for projected volume kube-api-access-vmhzj for pod openshift-network-diagnostics/network-check-target-827j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:44.823128 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:44.822956 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj podName:d203da4c-dafa-49d8-8bcd-9caf517afbc1 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:45.322931708 +0000 UTC m=+3.020418621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vmhzj" (UniqueName: "kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj") pod "network-check-target-827j9" (UID: "d203da4c-dafa-49d8-8bcd-9caf517afbc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:44.824410 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.824383 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx4lt\" (UniqueName: \"kubernetes.io/projected/50a39209-1238-4fc0-b441-0f1d6fe4f192-kube-api-access-jx4lt\") pod \"tuned-5n424\" (UID: \"50a39209-1238-4fc0-b441-0f1d6fe4f192\") " pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:44.824852 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.824829 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd42r\" (UniqueName: \"kubernetes.io/projected/cb82ff6b-254f-46de-842f-2aa268fa6b59-kube-api-access-rd42r\") pod \"multus-s5bsx\" (UID: \"cb82ff6b-254f-46de-842f-2aa268fa6b59\") " pod="openshift-multus/multus-s5bsx" Jun 09 12:31:44.825689 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.825544 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcq2h\" (UniqueName: \"kubernetes.io/projected/cf20c681-6757-49db-ac7a-3070a1d69d4c-kube-api-access-lcq2h\") pod \"node-resolver-fcwvm\" (UID: \"cf20c681-6757-49db-ac7a-3070a1d69d4c\") " pod="openshift-dns/node-resolver-fcwvm" Jun 09 12:31:44.825881 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.825863 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn7pq\" (UniqueName: \"kubernetes.io/projected/1b97452c-3a03-4979-81bd-655f89f05c1b-kube-api-access-mn7pq\") pod \"aws-ebs-csi-driver-node-swtnx\" (UID: \"1b97452c-3a03-4979-81bd-655f89f05c1b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:44.825967 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.825897 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ntkf\" (UniqueName: \"kubernetes.io/projected/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-kube-api-access-4ntkf\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:44.826197 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.826177 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzdqc\" (UniqueName: \"kubernetes.io/projected/fed43365-44f8-4220-87ec-327acf7f874f-kube-api-access-dzdqc\") pod \"node-ca-qlfnh\" (UID: \"fed43365-44f8-4220-87ec-327acf7f874f\") " pod="openshift-image-registry/node-ca-qlfnh" Jun 09 12:31:44.827157 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.827130 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt9tq\" (UniqueName: \"kubernetes.io/projected/593b1faa-5b02-4e90-b05c-d3b4724e8de9-kube-api-access-wt9tq\") pod \"ovnkube-node-tgb8g\" (UID: \"593b1faa-5b02-4e90-b05c-d3b4724e8de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:44.918363 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.918291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-kubelet-config\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:44.918363 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.918332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:44.918363 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.918366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d-iptables-alerter-script\") pod \"iptables-alerter-lrkgk\" (UID: \"0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d\") " pod="openshift-network-operator/iptables-alerter-lrkgk" Jun 09 12:31:44.918651 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.918380 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-kubelet-config\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:44.918651 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.918403 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d-host-slash\") pod \"iptables-alerter-lrkgk\" (UID: \"0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d\") " pod="openshift-network-operator/iptables-alerter-lrkgk" Jun 09 12:31:44.918651 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.918427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxrkw\" (UniqueName: \"kubernetes.io/projected/0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d-kube-api-access-wxrkw\") pod \"iptables-alerter-lrkgk\" (UID: \"0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d\") " pod="openshift-network-operator/iptables-alerter-lrkgk" Jun 09 12:31:44.918651 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.918454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-dbus\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:44.918651 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.918469 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d-host-slash\") pod \"iptables-alerter-lrkgk\" (UID: \"0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d\") " pod="openshift-network-operator/iptables-alerter-lrkgk" Jun 09 12:31:44.918651 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:44.918491 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:44.918651 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:44.918595 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret podName:f203b2b9-f1b1-4e3b-bf90-b4618a470c1a nodeName:}" failed. No retries permitted until 2026-06-09 12:31:45.418534438 +0000 UTC m=+3.116021350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret") pod "global-pull-secret-syncer-2jgwm" (UID: "f203b2b9-f1b1-4e3b-bf90-b4618a470c1a") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:44.918651 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.918634 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-dbus\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:44.918979 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.918960 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d-iptables-alerter-script\") pod \"iptables-alerter-lrkgk\" (UID: \"0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d\") " pod="openshift-network-operator/iptables-alerter-lrkgk" Jun 09 12:31:44.926459 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.926436 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxrkw\" (UniqueName: \"kubernetes.io/projected/0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d-kube-api-access-wxrkw\") pod \"iptables-alerter-lrkgk\" (UID: \"0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d\") " pod="openshift-network-operator/iptables-alerter-lrkgk" Jun 09 12:31:44.995436 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:44.995405 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6jc5n" Jun 09 12:31:45.003812 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.003771 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qlfnh" Jun 09 12:31:45.011606 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.011585 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fcwvm" Jun 09 12:31:45.017063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.017046 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-twwfm" Jun 09 12:31:45.023715 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.023697 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" Jun 09 12:31:45.029193 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.029176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:31:45.036727 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.036707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s5bsx" Jun 09 12:31:45.043190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.043166 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5n424" Jun 09 12:31:45.048639 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.048620 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lrkgk" Jun 09 12:31:45.323368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.323282 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:45.323368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.323333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmhzj\" (UniqueName: \"kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj\") pod \"network-check-target-827j9\" (UID: \"d203da4c-dafa-49d8-8bcd-9caf517afbc1\") " pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:31:45.323584 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:45.323453 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:45.323584 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:45.323475 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:45.323584 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:45.323497 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:45.323584 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:45.323510 2564 projected.go:196] Error preparing data for projected volume kube-api-access-vmhzj for pod openshift-network-diagnostics/network-check-target-827j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:45.323584 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:45.323535 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs podName:731e3c8f-34be-4caa-bc70-fba5d3fa2b08 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:46.323514419 +0000 UTC m=+4.021001347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs") pod "network-metrics-daemon-m7szl" (UID: "731e3c8f-34be-4caa-bc70-fba5d3fa2b08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:45.323584 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:45.323573 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj podName:d203da4c-dafa-49d8-8bcd-9caf517afbc1 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:46.3235429 +0000 UTC m=+4.021029828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vmhzj" (UniqueName: "kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj") pod "network-check-target-827j9" (UID: "d203da4c-dafa-49d8-8bcd-9caf517afbc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:45.329621 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.329597 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:31:45.424462 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.424394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:45.424665 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:45.424543 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:45.424665 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:45.424642 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret podName:f203b2b9-f1b1-4e3b-bf90-b4618a470c1a nodeName:}" failed. No retries permitted until 2026-06-09 12:31:46.424618785 +0000 UTC m=+4.122105692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret") pod "global-pull-secret-syncer-2jgwm" (UID: "f203b2b9-f1b1-4e3b-bf90-b4618a470c1a") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:45.536190 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:45.536158 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e23f6f_b74a_44a7_abac_9b22598d2078.slice/crio-9783c42b9d4e85fa09c0ac2449d457484d0ecbbf4129dae95d737c13e5b090fe WatchSource:0}: Error finding container 9783c42b9d4e85fa09c0ac2449d457484d0ecbbf4129dae95d737c13e5b090fe: Status 404 returned error can't find the container with id 9783c42b9d4e85fa09c0ac2449d457484d0ecbbf4129dae95d737c13e5b090fe Jun 09 12:31:45.537354 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:45.537330 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf20c681_6757_49db_ac7a_3070a1d69d4c.slice/crio-40bbb90995f8a7de4a195dd2e275ac81359dd25e0567335b917b3d71591ac965 WatchSource:0}: Error finding container 40bbb90995f8a7de4a195dd2e275ac81359dd25e0567335b917b3d71591ac965: Status 404 returned error can't find the container with id 40bbb90995f8a7de4a195dd2e275ac81359dd25e0567335b917b3d71591ac965 Jun 09 12:31:45.541264 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:45.541237 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb82ff6b_254f_46de_842f_2aa268fa6b59.slice/crio-d4088aae09c6bd74a5499506d5f14e3b4d01311de2328ad31ff67c754aaaa715 WatchSource:0}: Error finding container d4088aae09c6bd74a5499506d5f14e3b4d01311de2328ad31ff67c754aaaa715: Status 404 returned error can't find the container with id d4088aae09c6bd74a5499506d5f14e3b4d01311de2328ad31ff67c754aaaa715 Jun 09 12:31:45.541798 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:45.541780 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df00b4d_c9bf_4058_a168_9be06b94cfda.slice/crio-1c612c0940c03fcc2ccf0e9187d1e2b0642e620e4c63b88f9e7b5d6faa51e919 WatchSource:0}: Error finding container 1c612c0940c03fcc2ccf0e9187d1e2b0642e620e4c63b88f9e7b5d6faa51e919: Status 404 returned error can't find the container with id 1c612c0940c03fcc2ccf0e9187d1e2b0642e620e4c63b88f9e7b5d6faa51e919 Jun 09 12:31:45.542776 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:45.542758 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a39209_1238_4fc0_b441_0f1d6fe4f192.slice/crio-30a17e54a988975bd7854fcbb94e282d918a6c1aa55f9a24027201fe0d227683 WatchSource:0}: Error finding container 30a17e54a988975bd7854fcbb94e282d918a6c1aa55f9a24027201fe0d227683: Status 404 returned error can't find the container with id 30a17e54a988975bd7854fcbb94e282d918a6c1aa55f9a24027201fe0d227683 Jun 09 12:31:45.544945 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:45.544924 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593b1faa_5b02_4e90_b05c_d3b4724e8de9.slice/crio-bb164beb38391fd68170af75dc41db05ecd873526a94ed1582c79d77979605b7 WatchSource:0}: Error finding container bb164beb38391fd68170af75dc41db05ecd873526a94ed1582c79d77979605b7: Status 404 returned error can't find the container with id bb164beb38391fd68170af75dc41db05ecd873526a94ed1582c79d77979605b7 Jun 09 12:31:45.546369 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:45.546352 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b97452c_3a03_4979_81bd_655f89f05c1b.slice/crio-28a90a56e3a551d6243d861735070d34e3ec42ac5545cb6d0fc50c8c0ebf12a1 WatchSource:0}: Error finding container 28a90a56e3a551d6243d861735070d34e3ec42ac5545cb6d0fc50c8c0ebf12a1: Status 404 returned error can't find the container with id 28a90a56e3a551d6243d861735070d34e3ec42ac5545cb6d0fc50c8c0ebf12a1 Jun 09 12:31:45.547380 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:45.547342 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfed43365_44f8_4220_87ec_327acf7f874f.slice/crio-a7ef40bc724fe6f5cf95bdff715285aae5c8d029f95b9dfdfe268e5e1b3f46fd WatchSource:0}: Error finding container a7ef40bc724fe6f5cf95bdff715285aae5c8d029f95b9dfdfe268e5e1b3f46fd: Status 404 returned error can't find the container with id a7ef40bc724fe6f5cf95bdff715285aae5c8d029f95b9dfdfe268e5e1b3f46fd Jun 09 12:31:45.548409 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:31:45.548280 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d3d94cc_0dc4_49d9_bdd7_cefbcf154d7d.slice/crio-5082c1f8d6e245ec12289813cede7fe411491564822867fc0afc002ce6995645 WatchSource:0}: Error finding container 5082c1f8d6e245ec12289813cede7fe411491564822867fc0afc002ce6995645: Status 404 returned error can't find the container with id 5082c1f8d6e245ec12289813cede7fe411491564822867fc0afc002ce6995645 Jun 09 12:31:45.738963 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.738758 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 12:26:43 +0000 UTC" deadline="2027-11-22 20:34:18.533029252 +0000 UTC" Jun 09 12:31:45.738963 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.738961 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12752h2m32.794073192s" Jun 09 12:31:45.783329 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.783297 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" event={"ID":"1b97452c-3a03-4979-81bd-655f89f05c1b","Type":"ContainerStarted","Data":"28a90a56e3a551d6243d861735070d34e3ec42ac5545cb6d0fc50c8c0ebf12a1"} Jun 09 12:31:45.784423 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.784394 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twwfm" event={"ID":"6df00b4d-c9bf-4058-a168-9be06b94cfda","Type":"ContainerStarted","Data":"1c612c0940c03fcc2ccf0e9187d1e2b0642e620e4c63b88f9e7b5d6faa51e919"} Jun 09 12:31:45.785424 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.785404 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s5bsx" event={"ID":"cb82ff6b-254f-46de-842f-2aa268fa6b59","Type":"ContainerStarted","Data":"d4088aae09c6bd74a5499506d5f14e3b4d01311de2328ad31ff67c754aaaa715"} Jun 09 12:31:45.786501 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.786472 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6jc5n" event={"ID":"86e23f6f-b74a-44a7-abac-9b22598d2078","Type":"ContainerStarted","Data":"9783c42b9d4e85fa09c0ac2449d457484d0ecbbf4129dae95d737c13e5b090fe"} Jun 09 12:31:45.788248 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.788226 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal" event={"ID":"63c7b38b62446b7059ee929b7e5f5e83","Type":"ContainerStarted","Data":"326828ab9ad01ec3289e7fa00abf23f010d8715c2b02ed1026418f980c54dbd3"} Jun 09 12:31:45.789342 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.789295 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lrkgk" event={"ID":"0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d","Type":"ContainerStarted","Data":"5082c1f8d6e245ec12289813cede7fe411491564822867fc0afc002ce6995645"} Jun 09 12:31:45.790355 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.790337 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" event={"ID":"593b1faa-5b02-4e90-b05c-d3b4724e8de9","Type":"ContainerStarted","Data":"bb164beb38391fd68170af75dc41db05ecd873526a94ed1582c79d77979605b7"} Jun 09 12:31:45.791360 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.791343 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5n424" event={"ID":"50a39209-1238-4fc0-b441-0f1d6fe4f192","Type":"ContainerStarted","Data":"30a17e54a988975bd7854fcbb94e282d918a6c1aa55f9a24027201fe0d227683"} Jun 09 12:31:45.792285 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.792259 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fcwvm" event={"ID":"cf20c681-6757-49db-ac7a-3070a1d69d4c","Type":"ContainerStarted","Data":"40bbb90995f8a7de4a195dd2e275ac81359dd25e0567335b917b3d71591ac965"} Jun 09 12:31:45.794406 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.794385 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qlfnh" event={"ID":"fed43365-44f8-4220-87ec-327acf7f874f","Type":"ContainerStarted","Data":"a7ef40bc724fe6f5cf95bdff715285aae5c8d029f95b9dfdfe268e5e1b3f46fd"} Jun 09 12:31:45.804350 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:45.804307 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal" podStartSLOduration=2.804297123 podStartE2EDuration="2.804297123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:31:45.803731773 +0000 UTC m=+3.501218703" watchObservedRunningTime="2026-06-09 12:31:45.804297123 +0000 UTC m=+3.501784052" Jun 09 12:31:46.333923 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:46.333879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:46.334130 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:46.333937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmhzj\" (UniqueName: \"kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj\") pod \"network-check-target-827j9\" (UID: \"d203da4c-dafa-49d8-8bcd-9caf517afbc1\") " pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:31:46.334214 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:46.334131 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:46.334214 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:46.334160 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:46.334214 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:46.334176 2564 projected.go:196] Error preparing data for projected volume kube-api-access-vmhzj for pod openshift-network-diagnostics/network-check-target-827j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:46.334378 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:46.334235 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj podName:d203da4c-dafa-49d8-8bcd-9caf517afbc1 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:48.334216026 +0000 UTC m=+6.031702949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vmhzj" (UniqueName: "kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj") pod "network-check-target-827j9" (UID: "d203da4c-dafa-49d8-8bcd-9caf517afbc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:46.334378 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:46.334310 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:46.334378 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:46.334343 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs podName:731e3c8f-34be-4caa-bc70-fba5d3fa2b08 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:48.334331429 +0000 UTC m=+6.031818349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs") pod "network-metrics-daemon-m7szl" (UID: "731e3c8f-34be-4caa-bc70-fba5d3fa2b08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:46.435083 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:46.435046 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:46.435259 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:46.435211 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:46.435326 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:46.435277 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret podName:f203b2b9-f1b1-4e3b-bf90-b4618a470c1a nodeName:}" failed. No retries permitted until 2026-06-09 12:31:48.435256715 +0000 UTC m=+6.132743626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret") pod "global-pull-secret-syncer-2jgwm" (UID: "f203b2b9-f1b1-4e3b-bf90-b4618a470c1a") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:46.774317 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:46.774246 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:31:46.774748 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:46.774379 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:31:46.774834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:46.774815 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:46.774944 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:46.774924 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:31:46.775081 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:46.775066 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:46.775166 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:46.775149 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:31:46.830528 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:46.830490 2564 generic.go:356] "Generic (PLEG): container finished" podID="2b7b5983e41cb92616dd05e9b3cc9039" containerID="3ccd5a10a8d743891ab67e790ba35f303bc705439b747072596871453a3e5911" exitCode=0 Jun 09 12:31:46.831068 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:46.831043 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" event={"ID":"2b7b5983e41cb92616dd05e9b3cc9039","Type":"ContainerDied","Data":"3ccd5a10a8d743891ab67e790ba35f303bc705439b747072596871453a3e5911"} Jun 09 12:31:47.862358 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:47.861677 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" event={"ID":"2b7b5983e41cb92616dd05e9b3cc9039","Type":"ContainerStarted","Data":"d4bab2b55fd8f80cbbb7c493c21aa848ab3f4eb5ef636e1c427760b0f41f20d6"} Jun 09 12:31:48.362415 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:48.362320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:48.362415 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:48.362373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmhzj\" (UniqueName: \"kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj\") pod \"network-check-target-827j9\" (UID: \"d203da4c-dafa-49d8-8bcd-9caf517afbc1\") " pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:31:48.362737 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:48.362537 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:48.362737 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:48.362575 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:48.362737 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:48.362589 2564 projected.go:196] Error preparing data for projected volume kube-api-access-vmhzj for pod openshift-network-diagnostics/network-check-target-827j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:48.362737 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:48.362653 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj podName:d203da4c-dafa-49d8-8bcd-9caf517afbc1 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:52.362633353 +0000 UTC m=+10.060120275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vmhzj" (UniqueName: "kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj") pod "network-check-target-827j9" (UID: "d203da4c-dafa-49d8-8bcd-9caf517afbc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:48.363101 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:48.363077 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:48.363164 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:48.363132 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs podName:731e3c8f-34be-4caa-bc70-fba5d3fa2b08 nodeName:}" failed. No retries permitted until 2026-06-09 12:31:52.363115476 +0000 UTC m=+10.060602389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs") pod "network-metrics-daemon-m7szl" (UID: "731e3c8f-34be-4caa-bc70-fba5d3fa2b08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:48.463596 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:48.463546 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:48.463778 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:48.463690 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:48.463778 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:48.463765 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret podName:f203b2b9-f1b1-4e3b-bf90-b4618a470c1a nodeName:}" failed. No retries permitted until 2026-06-09 12:31:52.463743516 +0000 UTC m=+10.161230449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret") pod "global-pull-secret-syncer-2jgwm" (UID: "f203b2b9-f1b1-4e3b-bf90-b4618a470c1a") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:48.774270 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:48.774205 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:48.774270 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:48.774240 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:31:48.774464 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:48.774306 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:31:48.774464 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:48.774207 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:48.774464 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:48.774428 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:31:48.774664 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:48.774499 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:31:50.774936 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:50.774899 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:50.775372 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:50.775057 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:31:50.776870 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:50.776842 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:31:50.780510 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:50.777031 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:31:50.780510 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:50.777110 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:50.780510 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:50.777409 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:31:52.397527 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:52.397495 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:52.397527 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:52.397532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmhzj\" (UniqueName: \"kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj\") pod \"network-check-target-827j9\" (UID: \"d203da4c-dafa-49d8-8bcd-9caf517afbc1\") " pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:31:52.398003 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:52.397655 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:31:52.398003 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:52.397679 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:31:52.398003 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:52.397691 2564 projected.go:196] Error preparing data for projected volume kube-api-access-vmhzj for pod openshift-network-diagnostics/network-check-target-827j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:52.398003 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:52.397692 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:52.398003 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:52.397741 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj podName:d203da4c-dafa-49d8-8bcd-9caf517afbc1 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:00.397725526 +0000 UTC m=+18.095212446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vmhzj" (UniqueName: "kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj") pod "network-check-target-827j9" (UID: "d203da4c-dafa-49d8-8bcd-9caf517afbc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:31:52.398003 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:52.397757 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs podName:731e3c8f-34be-4caa-bc70-fba5d3fa2b08 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:00.397749969 +0000 UTC m=+18.095236880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs") pod "network-metrics-daemon-m7szl" (UID: "731e3c8f-34be-4caa-bc70-fba5d3fa2b08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:31:52.498229 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:52.498185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:52.498382 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:52.498367 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:52.498462 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:52.498446 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret podName:f203b2b9-f1b1-4e3b-bf90-b4618a470c1a nodeName:}" failed. No retries permitted until 2026-06-09 12:32:00.498426034 +0000 UTC m=+18.195912959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret") pod "global-pull-secret-syncer-2jgwm" (UID: "f203b2b9-f1b1-4e3b-bf90-b4618a470c1a") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:31:52.775803 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:52.775727 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:52.775970 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:52.775834 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:31:52.776208 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:52.776189 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:31:52.776300 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:52.776276 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:31:52.776446 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:52.776431 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:52.776543 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:52.776525 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:31:54.774246 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:54.774214 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:54.774830 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:54.774227 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:54.774830 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:54.774357 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:31:54.774830 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:54.774488 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:31:54.774830 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:54.774529 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:31:54.774830 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:54.774632 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:31:56.774419 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:56.774384 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:56.774861 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:56.774384 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:31:56.774861 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:56.774529 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:31:56.774861 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:56.774397 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:56.774861 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:56.774663 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:31:56.774861 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:56.774784 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:31:58.774516 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:58.774482 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:31:58.774516 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:58.774478 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:31:58.774980 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:58.774612 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:31:58.774980 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:58.774694 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:31:58.774980 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:31:58.774714 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:31:58.774980 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:31:58.774827 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:32:00.457392 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:00.457357 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:32:00.457392 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:00.457396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmhzj\" (UniqueName: \"kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj\") pod \"network-check-target-827j9\" (UID: \"d203da4c-dafa-49d8-8bcd-9caf517afbc1\") " pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:00.457896 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:00.457541 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:32:00.457896 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:00.457541 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:32:00.457896 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:00.457573 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:32:00.457896 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:00.457586 2564 projected.go:196] Error preparing data for projected volume kube-api-access-vmhzj for pod openshift-network-diagnostics/network-check-target-827j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:32:00.457896 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:00.457635 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs podName:731e3c8f-34be-4caa-bc70-fba5d3fa2b08 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:16.457613865 +0000 UTC m=+34.155100774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs") pod "network-metrics-daemon-m7szl" (UID: "731e3c8f-34be-4caa-bc70-fba5d3fa2b08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:32:00.457896 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:00.457657 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj podName:d203da4c-dafa-49d8-8bcd-9caf517afbc1 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:16.457646076 +0000 UTC m=+34.155132982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vmhzj" (UniqueName: "kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj") pod "network-check-target-827j9" (UID: "d203da4c-dafa-49d8-8bcd-9caf517afbc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:32:00.558138 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:00.558098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:00.558299 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:00.558224 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:32:00.558299 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:00.558292 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret podName:f203b2b9-f1b1-4e3b-bf90-b4618a470c1a nodeName:}" failed. No retries permitted until 2026-06-09 12:32:16.558276509 +0000 UTC m=+34.255763416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret") pod "global-pull-secret-syncer-2jgwm" (UID: "f203b2b9-f1b1-4e3b-bf90-b4618a470c1a") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:32:00.774937 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:00.774860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:00.775082 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:00.774860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:00.775082 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:00.775000 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:32:00.775082 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:00.774859 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:32:00.775241 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:00.775086 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:32:00.775241 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:00.775196 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:32:02.774912 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:02.774883 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:02.775366 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:02.774975 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:02.775366 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:02.775003 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:32:02.775366 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:02.775053 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:32:02.775366 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:02.775080 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:32:02.775366 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:02.775155 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:32:04.774501 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.774218 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:32:04.775093 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.774218 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:04.775093 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:04.774601 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:32:04.775093 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:04.774684 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:32:04.775093 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.774305 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:04.775093 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:04.774779 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:32:04.893643 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.893541 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s5bsx" event={"ID":"cb82ff6b-254f-46de-842f-2aa268fa6b59","Type":"ContainerStarted","Data":"45ac536c15ee7fe48979cb8029419307d69d61d19ef9707bc91c6bff9c34058e"} Jun 09 12:32:04.894995 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.894969 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6jc5n" event={"ID":"86e23f6f-b74a-44a7-abac-9b22598d2078","Type":"ContainerStarted","Data":"978d8332dc036c29feba779829aac5f4e90181a9931d1a6718841243e6fa514a"} Jun 09 12:32:04.897630 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.897613 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgb8g_593b1faa-5b02-4e90-b05c-d3b4724e8de9/ovn-acl-logging/0.log" Jun 09 12:32:04.897980 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.897961 2564 generic.go:356] "Generic (PLEG): container finished" podID="593b1faa-5b02-4e90-b05c-d3b4724e8de9" containerID="32ae132ce17ffd9d3eabf6252348e46cbabb370cd454772ce3e8d8d1977fe617" exitCode=1 Jun 09 12:32:04.898052 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.898030 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" event={"ID":"593b1faa-5b02-4e90-b05c-d3b4724e8de9","Type":"ContainerStarted","Data":"dcbb8cb5d29104b4b8b6a8cb71026eb65fdf9c35b0763003b449e4549b797a5f"} Jun 09 12:32:04.898111 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.898102 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" event={"ID":"593b1faa-5b02-4e90-b05c-d3b4724e8de9","Type":"ContainerStarted","Data":"0b922339e0dfa99d388535b755d3ba12e688a2c815af8f2ee19206b72b556fb2"} Jun 09 12:32:04.898165 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.898142 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" event={"ID":"593b1faa-5b02-4e90-b05c-d3b4724e8de9","Type":"ContainerStarted","Data":"375faa7585c49cf5c1d0e77e8aa87526e4f91d7ec4db6e505d0103f75998c854"} Jun 09 12:32:04.898215 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.898179 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" event={"ID":"593b1faa-5b02-4e90-b05c-d3b4724e8de9","Type":"ContainerStarted","Data":"0f3a3e58fa29e92b7b1f75baf6b0dffb54caa7e54a61cf6a5d015ec0e673329f"} Jun 09 12:32:04.898251 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.898214 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" event={"ID":"593b1faa-5b02-4e90-b05c-d3b4724e8de9","Type":"ContainerDied","Data":"32ae132ce17ffd9d3eabf6252348e46cbabb370cd454772ce3e8d8d1977fe617"} Jun 09 12:32:04.898280 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.898265 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" event={"ID":"593b1faa-5b02-4e90-b05c-d3b4724e8de9","Type":"ContainerStarted","Data":"265c0465d9260642fc4bc8e597fb1949282775ed333aa76041fc8f6392dae737"} Jun 09 12:32:04.899602 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.899503 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5n424" event={"ID":"50a39209-1238-4fc0-b441-0f1d6fe4f192","Type":"ContainerStarted","Data":"a2bb40efabcba5fdde86d77dc42081627415bd657804730bc69c174f8b159334"} Jun 09 12:32:04.901050 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.901018 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fcwvm" event={"ID":"cf20c681-6757-49db-ac7a-3070a1d69d4c","Type":"ContainerStarted","Data":"ff18adab8703a7b9744e3468d71af1a86510bd8f4c762534e6da3a4c86fcf377"} Jun 09 12:32:04.902646 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.902624 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qlfnh" event={"ID":"fed43365-44f8-4220-87ec-327acf7f874f","Type":"ContainerStarted","Data":"3380879aab11c24ce28648e5d3b0b0404adb7ed42388c0f38521cc1c87ec4255"} Jun 09 12:32:04.904054 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.904036 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" event={"ID":"1b97452c-3a03-4979-81bd-655f89f05c1b","Type":"ContainerStarted","Data":"f6996816461e8f6a15f2bbda0627094b2a21fe42b6d0b71a3458d22955be7d29"} Jun 09 12:32:04.905431 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.905410 2564 generic.go:356] "Generic (PLEG): container finished" podID="6df00b4d-c9bf-4058-a168-9be06b94cfda" containerID="10db4534b5cc4e8dc7439644ae55907d28a7f63460d6417b683a63b93691e175" exitCode=0 Jun 09 12:32:04.905532 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.905440 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twwfm" event={"ID":"6df00b4d-c9bf-4058-a168-9be06b94cfda","Type":"ContainerDied","Data":"10db4534b5cc4e8dc7439644ae55907d28a7f63460d6417b683a63b93691e175"} Jun 09 12:32:04.910633 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.910584 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" podStartSLOduration=21.910554021 podStartE2EDuration="21.910554021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:31:47.876862632 +0000 UTC m=+5.574349562" watchObservedRunningTime="2026-06-09 12:32:04.910554021 +0000 UTC m=+22.608040951" Jun 09 12:32:04.910725 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.910676 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s5bsx" podStartSLOduration=3.360236778 podStartE2EDuration="21.910669059s" totalImagesPullingTime="18.550432281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:04.909950074 +0000 UTC m=+22.607437023" watchObservedRunningTime="2026-06-09 12:32:04.910669059 +0000 UTC m=+22.608155993" Jun 09 12:32:04.925842 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.925792 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qlfnh" podStartSLOduration=4.40594437 podStartE2EDuration="22.925775073s" totalImagesPullingTime="18.519830703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:04.925484494 +0000 UTC m=+22.622971442" watchObservedRunningTime="2026-06-09 12:32:04.925775073 +0000 UTC m=+22.623262003" Jun 09 12:32:04.968154 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.968103 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fcwvm" podStartSLOduration=4.438256997 podStartE2EDuration="22.968087596s" totalImagesPullingTime="18.529830599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:04.942804559 +0000 UTC m=+22.640291489" watchObservedRunningTime="2026-06-09 12:32:04.968087596 +0000 UTC m=+22.665574525" Jun 09 12:32:04.985476 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:04.985424 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5n424" podStartSLOduration=3.456606149 podStartE2EDuration="21.985406817s" totalImagesPullingTime="18.528800668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:04.984834663 +0000 UTC m=+22.682321605" watchObservedRunningTime="2026-06-09 12:32:04.985406817 +0000 UTC m=+22.682893747" Jun 09 12:32:05.581635 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:05.581609 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 12:32:05.766743 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:05.766570 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T12:32:05.581629149Z","UUID":"e7c63503-01d6-4062-87ec-ce9d6423b330","Handler":null,"Name":"","Endpoint":""} Jun 09 12:32:05.768094 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:05.768075 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 12:32:05.768233 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:05.768109 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 12:32:05.909285 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:05.909255 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" event={"ID":"1b97452c-3a03-4979-81bd-655f89f05c1b","Type":"ContainerStarted","Data":"444ea85426fd385cc2e1a3acf911b7c76025c1c9a2e2c7020825dda4ff618b29"} Jun 09 12:32:05.910809 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:05.910785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lrkgk" event={"ID":"0d3d94cc-0dc4-49d9-bdd7-cefbcf154d7d","Type":"ContainerStarted","Data":"6d794d4de7b79b5835b48abf0bf84acd99492926bc8ab103bfc78d5b8b914fd4"} Jun 09 12:32:05.925486 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:05.925446 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lrkgk" podStartSLOduration=4.405483526 podStartE2EDuration="22.925432669s" totalImagesPullingTime="18.519949143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:05.925148952 +0000 UTC m=+23.622635880" watchObservedRunningTime="2026-06-09 12:32:05.925432669 +0000 UTC m=+23.622919597" Jun 09 12:32:05.925605 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:05.925536 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6jc5n" podStartSLOduration=13.769900369 podStartE2EDuration="23.92553084s" totalImagesPullingTime="10.155630471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:04.9978191 +0000 UTC m=+22.695306024" watchObservedRunningTime="2026-06-09 12:32:05.92553084 +0000 UTC m=+23.623017768" Jun 09 12:32:06.774927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:06.774748 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:06.775099 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:06.774748 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:06.775099 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:06.775020 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:32:06.775099 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:06.774748 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:32:06.775099 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:06.775084 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:32:06.775287 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:06.775147 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:32:06.914989 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:06.914963 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" event={"ID":"1b97452c-3a03-4979-81bd-655f89f05c1b","Type":"ContainerStarted","Data":"f79b7086f1b40c3d2921ecafa2df6ca5b790ec8c8608a9b1a9a28c31f4a96b08"} Jun 09 12:32:06.918000 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:06.917983 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgb8g_593b1faa-5b02-4e90-b05c-d3b4724e8de9/ovn-acl-logging/0.log" Jun 09 12:32:06.918335 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:06.918314 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" event={"ID":"593b1faa-5b02-4e90-b05c-d3b4724e8de9","Type":"ContainerStarted","Data":"bf7cef51df4835360f911c6e79959e1e59bc583f7e5920560bde9731344d8eae"} Jun 09 12:32:06.932965 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:06.932928 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swtnx" podStartSLOduration=4.258665884 podStartE2EDuration="24.932914733s" totalImagesPullingTime="20.674248849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:06.932473457 +0000 UTC m=+24.629960386" watchObservedRunningTime="2026-06-09 12:32:06.932914733 +0000 UTC m=+24.630401662" Jun 09 12:32:07.473995 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:07.473962 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:07.570158 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:07.570132 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:07.686386 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:07.686357 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:07.798609 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:07.798541 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6jc5n" Jun 09 12:32:07.799016 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:07.798999 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6jc5n" Jun 09 12:32:07.920539 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:07.920511 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6jc5n" Jun 09 12:32:07.921092 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:07.921077 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6jc5n" Jun 09 12:32:08.028004 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:08.027976 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:08.774879 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:08.774843 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:08.774879 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:08.774866 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:32:08.775071 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:08.774955 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:32:08.775071 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:08.774970 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:08.775071 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:08.775037 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:32:08.775174 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:08.775149 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:32:08.791447 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:08.791414 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:09.748759 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:09.748590 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:09.809085 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:09.809051 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:09.927887 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:09.927864 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgb8g_593b1faa-5b02-4e90-b05c-d3b4724e8de9/ovn-acl-logging/0.log" Jun 09 12:32:09.928607 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:09.928306 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" event={"ID":"593b1faa-5b02-4e90-b05c-d3b4724e8de9","Type":"ContainerStarted","Data":"64571953e6adb882992a50fd5a24aedbf79fda4adcad51f87c1c5590bdf9841e"} Jun 09 12:32:09.928733 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:09.928614 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:32:09.928794 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:09.928739 2564 scope.go:117] "RemoveContainer" containerID="32ae132ce17ffd9d3eabf6252348e46cbabb370cd454772ce3e8d8d1977fe617" Jun 09 12:32:09.945848 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:09.945829 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:32:10.774409 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:10.774380 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:32:10.774823 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:10.774380 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:10.774823 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:10.774499 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:32:10.774823 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:10.774513 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:10.774823 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:10.774647 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:32:10.774823 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:10.774715 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:32:11.233660 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:11.233620 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2jgwm"] Jun 09 12:32:11.233833 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:11.233738 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-827j9"] Jun 09 12:32:11.233900 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:11.233867 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:11.235153 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:11.234011 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:32:11.235153 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:11.234322 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:11.235153 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:11.234483 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:32:11.244609 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:11.244582 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m7szl"] Jun 09 12:32:11.244776 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:11.244684 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:32:11.244860 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:11.244782 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:32:11.936416 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:11.936393 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgb8g_593b1faa-5b02-4e90-b05c-d3b4724e8de9/ovn-acl-logging/0.log" Jun 09 12:32:11.936874 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:11.936847 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" event={"ID":"593b1faa-5b02-4e90-b05c-d3b4724e8de9","Type":"ContainerStarted","Data":"2d5282f2ff9411e59a59744b3964fff24f40ea9d94280bc02b28180d77f61d9c"} Jun 09 12:32:11.937320 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:11.937303 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:32:11.937409 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:11.937377 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:32:11.938950 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:11.938928 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twwfm" event={"ID":"6df00b4d-c9bf-4058-a168-9be06b94cfda","Type":"ContainerStarted","Data":"6d6c73e0f3e8cbce80229a3b45173b42cece77aa7bc5ddc4b2b4b0ced574b484"} Jun 09 12:32:11.951369 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:11.951320 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:32:11.963450 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:11.963410 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" podStartSLOduration=11.379088977 podStartE2EDuration="29.963396342s" totalImagesPullingTime="18.584307365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:11.962386185 +0000 UTC m=+29.659873113" watchObservedRunningTime="2026-06-09 12:32:11.963396342 +0000 UTC m=+29.660883278" Jun 09 12:32:12.467162 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:12.467129 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:12.520894 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:12.520869 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:12.775359 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:12.775287 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:12.775482 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:12.775357 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:32:12.775482 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:12.775446 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:32:12.775610 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:12.775588 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:32:12.775668 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:12.775617 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:12.775757 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:12.775725 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:32:12.942505 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:12.942479 2564 generic.go:356] "Generic (PLEG): container finished" podID="6df00b4d-c9bf-4058-a168-9be06b94cfda" containerID="6d6c73e0f3e8cbce80229a3b45173b42cece77aa7bc5ddc4b2b4b0ced574b484" exitCode=0 Jun 09 12:32:12.942883 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:12.942582 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twwfm" event={"ID":"6df00b4d-c9bf-4058-a168-9be06b94cfda","Type":"ContainerDied","Data":"6d6c73e0f3e8cbce80229a3b45173b42cece77aa7bc5ddc4b2b4b0ced574b484"} Jun 09 12:32:14.774600 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:14.774553 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:14.775137 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:14.774570 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:14.775137 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:14.774675 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:32:14.775137 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:14.774573 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:32:14.775137 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:14.774746 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:32:14.775137 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:14.774816 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:32:14.949359 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:14.949334 2564 generic.go:356] "Generic (PLEG): container finished" podID="6df00b4d-c9bf-4058-a168-9be06b94cfda" containerID="2607d37ac3cb3e9976748a412fc99942459c59be0b7da129c3b2008159d424cb" exitCode=0 Jun 09 12:32:14.949478 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:14.949374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twwfm" event={"ID":"6df00b4d-c9bf-4058-a168-9be06b94cfda","Type":"ContainerDied","Data":"2607d37ac3cb3e9976748a412fc99942459c59be0b7da129c3b2008159d424cb"} Jun 09 12:32:15.340602 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:15.340556 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:15.397431 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:15.397396 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:16.482173 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:16.482140 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmhzj\" (UniqueName: \"kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj\") pod \"network-check-target-827j9\" (UID: \"d203da4c-dafa-49d8-8bcd-9caf517afbc1\") " pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:16.482719 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:16.482203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:32:16.482719 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:16.482292 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:32:16.482719 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:16.482314 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:32:16.482719 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:16.482323 2564 projected.go:196] Error preparing data for projected volume kube-api-access-vmhzj for pod openshift-network-diagnostics/network-check-target-827j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:32:16.482719 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:16.482365 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj podName:d203da4c-dafa-49d8-8bcd-9caf517afbc1 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:48.48235155 +0000 UTC m=+66.179838473 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vmhzj" (UniqueName: "kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj") pod "network-check-target-827j9" (UID: "d203da4c-dafa-49d8-8bcd-9caf517afbc1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:32:16.482719 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:16.482295 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:32:16.482719 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:16.482422 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs podName:731e3c8f-34be-4caa-bc70-fba5d3fa2b08 nodeName:}" failed. No retries permitted until 2026-06-09 12:32:48.482407787 +0000 UTC m=+66.179894709 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs") pod "network-metrics-daemon-m7szl" (UID: "731e3c8f-34be-4caa-bc70-fba5d3fa2b08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:32:16.583161 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:16.583129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:16.583302 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:16.583266 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:32:16.583344 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:16.583326 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret podName:f203b2b9-f1b1-4e3b-bf90-b4618a470c1a nodeName:}" failed. No retries permitted until 2026-06-09 12:32:48.583311526 +0000 UTC m=+66.280798435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret") pod "global-pull-secret-syncer-2jgwm" (UID: "f203b2b9-f1b1-4e3b-bf90-b4618a470c1a") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:32:16.774270 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:16.774197 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:16.774402 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:16.774196 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:32:16.774402 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:16.774309 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-827j9" podUID="d203da4c-dafa-49d8-8bcd-9caf517afbc1" Jun 09 12:32:16.774402 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:16.774197 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:16.774402 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:16.774367 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:32:16.774620 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:16.774441 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2jgwm" podUID="f203b2b9-f1b1-4e3b-bf90-b4618a470c1a" Jun 09 12:32:16.956321 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:16.956286 2564 generic.go:356] "Generic (PLEG): container finished" podID="6df00b4d-c9bf-4058-a168-9be06b94cfda" containerID="b8ef1f7c69286baebbc6abc447de7b981a41fcf8904d71b2e3199b8c13bfddcb" exitCode=0 Jun 09 12:32:16.956476 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:16.956327 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twwfm" event={"ID":"6df00b4d-c9bf-4058-a168-9be06b94cfda","Type":"ContainerDied","Data":"b8ef1f7c69286baebbc6abc447de7b981a41fcf8904d71b2e3199b8c13bfddcb"} Jun 09 12:32:17.132651 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.132587 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeReady" Jun 09 12:32:17.132776 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.132686 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 12:32:17.202315 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.202286 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w7l97"] Jun 09 12:32:17.213885 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.213866 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8q6ht"] Jun 09 12:32:17.213992 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.213975 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:17.216100 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.216084 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b8l29\"" Jun 09 12:32:17.216200 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.216113 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 12:32:17.216326 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.216313 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 12:32:17.225409 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.225388 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w7l97"] Jun 09 12:32:17.225587 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.225430 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8q6ht"] Jun 09 12:32:17.225587 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.225499 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8q6ht" Jun 09 12:32:17.227595 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.227579 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 12:32:17.227882 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.227866 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ksb5z\"" Jun 09 12:32:17.227959 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.227905 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 12:32:17.227996 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.227911 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 12:32:17.288682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.288652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlwpt\" (UniqueName: \"kubernetes.io/projected/75004378-a4fe-48db-9825-2d3cf54da59a-kube-api-access-jlwpt\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:17.288682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.288682 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zzz5\" (UniqueName: \"kubernetes.io/projected/fc101d88-babb-4b12-a41c-5054275e8682-kube-api-access-9zzz5\") pod \"ingress-canary-8q6ht\" (UID: \"fc101d88-babb-4b12-a41c-5054275e8682\") " pod="openshift-ingress-canary/ingress-canary-8q6ht" Jun 09 12:32:17.288861 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.288702 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75004378-a4fe-48db-9825-2d3cf54da59a-tmp-dir\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:17.288861 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.288730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75004378-a4fe-48db-9825-2d3cf54da59a-config-volume\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:17.288861 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.288771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc101d88-babb-4b12-a41c-5054275e8682-cert\") pod \"ingress-canary-8q6ht\" (UID: \"fc101d88-babb-4b12-a41c-5054275e8682\") " pod="openshift-ingress-canary/ingress-canary-8q6ht" Jun 09 12:32:17.288969 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.288862 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:17.390112 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.390037 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75004378-a4fe-48db-9825-2d3cf54da59a-config-volume\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:17.390112 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.390088 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc101d88-babb-4b12-a41c-5054275e8682-cert\") pod \"ingress-canary-8q6ht\" (UID: \"fc101d88-babb-4b12-a41c-5054275e8682\") " pod="openshift-ingress-canary/ingress-canary-8q6ht" Jun 09 12:32:17.390338 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.390319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:17.390401 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.390369 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlwpt\" (UniqueName: \"kubernetes.io/projected/75004378-a4fe-48db-9825-2d3cf54da59a-kube-api-access-jlwpt\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:17.390456 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.390398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zzz5\" (UniqueName: \"kubernetes.io/projected/fc101d88-babb-4b12-a41c-5054275e8682-kube-api-access-9zzz5\") pod \"ingress-canary-8q6ht\" (UID: \"fc101d88-babb-4b12-a41c-5054275e8682\") " pod="openshift-ingress-canary/ingress-canary-8q6ht" Jun 09 12:32:17.390456 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.390425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75004378-a4fe-48db-9825-2d3cf54da59a-tmp-dir\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:17.390891 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.390695 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75004378-a4fe-48db-9825-2d3cf54da59a-config-volume\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:17.390891 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.390700 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75004378-a4fe-48db-9825-2d3cf54da59a-tmp-dir\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:17.390891 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:17.390816 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:17.390891 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:17.390887 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls podName:75004378-a4fe-48db-9825-2d3cf54da59a nodeName:}" failed. No retries permitted until 2026-06-09 12:32:17.890867162 +0000 UTC m=+35.588354098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls") pod "dns-default-w7l97" (UID: "75004378-a4fe-48db-9825-2d3cf54da59a") : secret "dns-default-metrics-tls" not found Jun 09 12:32:17.394812 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.394683 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc101d88-babb-4b12-a41c-5054275e8682-cert\") pod \"ingress-canary-8q6ht\" (UID: \"fc101d88-babb-4b12-a41c-5054275e8682\") " pod="openshift-ingress-canary/ingress-canary-8q6ht" Jun 09 12:32:17.400122 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.400100 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlwpt\" (UniqueName: \"kubernetes.io/projected/75004378-a4fe-48db-9825-2d3cf54da59a-kube-api-access-jlwpt\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:17.400420 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.400401 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zzz5\" (UniqueName: \"kubernetes.io/projected/fc101d88-babb-4b12-a41c-5054275e8682-kube-api-access-9zzz5\") pod \"ingress-canary-8q6ht\" (UID: \"fc101d88-babb-4b12-a41c-5054275e8682\") " pod="openshift-ingress-canary/ingress-canary-8q6ht" Jun 09 12:32:17.533112 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.533077 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8q6ht" Jun 09 12:32:17.716741 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.716710 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8q6ht"] Jun 09 12:32:17.720526 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:32:17.720500 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc101d88_babb_4b12_a41c_5054275e8682.slice/crio-91384fd4d5773e77b050cdd8be9a829ab96d79eb096cf9bac85d9cb701a181f1 WatchSource:0}: Error finding container 91384fd4d5773e77b050cdd8be9a829ab96d79eb096cf9bac85d9cb701a181f1: Status 404 returned error can't find the container with id 91384fd4d5773e77b050cdd8be9a829ab96d79eb096cf9bac85d9cb701a181f1 Jun 09 12:32:17.893313 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.893286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:17.893494 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:17.893472 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:17.893577 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:17.893541 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls podName:75004378-a4fe-48db-9825-2d3cf54da59a nodeName:}" failed. No retries permitted until 2026-06-09 12:32:18.893517859 +0000 UTC m=+36.591004766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls") pod "dns-default-w7l97" (UID: "75004378-a4fe-48db-9825-2d3cf54da59a") : secret "dns-default-metrics-tls" not found Jun 09 12:32:17.960434 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:17.960400 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8q6ht" event={"ID":"fc101d88-babb-4b12-a41c-5054275e8682","Type":"ContainerStarted","Data":"91384fd4d5773e77b050cdd8be9a829ab96d79eb096cf9bac85d9cb701a181f1"} Jun 09 12:32:18.774833 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:18.774799 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:32:18.774833 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:18.774832 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:18.775338 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:18.774799 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:18.778238 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:18.777905 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 12:32:18.778238 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:18.777915 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4297v\"" Jun 09 12:32:18.778238 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:18.777966 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 12:32:18.778238 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:18.777915 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4k8hn\"" Jun 09 12:32:18.778238 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:18.778118 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 12:32:18.778238 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:18.778131 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 12:32:18.900384 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:18.900349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:18.900550 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:18.900534 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:18.900647 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:18.900616 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls podName:75004378-a4fe-48db-9825-2d3cf54da59a nodeName:}" failed. No retries permitted until 2026-06-09 12:32:20.900601517 +0000 UTC m=+38.598088425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls") pod "dns-default-w7l97" (UID: "75004378-a4fe-48db-9825-2d3cf54da59a") : secret "dns-default-metrics-tls" not found Jun 09 12:32:20.915230 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:20.915128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:20.915705 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:20.915268 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:20.915705 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:20.915336 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls podName:75004378-a4fe-48db-9825-2d3cf54da59a nodeName:}" failed. No retries permitted until 2026-06-09 12:32:24.91531649 +0000 UTC m=+42.612803415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls") pod "dns-default-w7l97" (UID: "75004378-a4fe-48db-9825-2d3cf54da59a") : secret "dns-default-metrics-tls" not found Jun 09 12:32:20.949943 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:20.949913 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:21.013343 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:21.013319 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:21.665359 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:21.665212 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:21.972533 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:21.972504 2564 generic.go:356] "Generic (PLEG): container finished" podID="6df00b4d-c9bf-4058-a168-9be06b94cfda" containerID="0d03f3214cb833ebcf9fa42802e67955d8e7efb2e3add8235fb6ff86f843ea53" exitCode=0 Jun 09 12:32:21.973029 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:21.972592 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twwfm" event={"ID":"6df00b4d-c9bf-4058-a168-9be06b94cfda","Type":"ContainerDied","Data":"0d03f3214cb833ebcf9fa42802e67955d8e7efb2e3add8235fb6ff86f843ea53"} Jun 09 12:32:21.974074 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:21.974056 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8q6ht" event={"ID":"fc101d88-babb-4b12-a41c-5054275e8682","Type":"ContainerStarted","Data":"96c593cb0624cde6289bb170683d6c50580e847b7832cd643c78ff4b760455a9"} Jun 09 12:32:22.009157 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:22.009116 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8q6ht" podStartSLOduration=1.602650321 podStartE2EDuration="5.009101952s" totalImagesPullingTime="3.406451631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:22.007953471 +0000 UTC m=+39.705440401" watchObservedRunningTime="2026-06-09 12:32:22.009101952 +0000 UTC m=+39.706588882" Jun 09 12:32:22.691409 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:22.691380 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:22.746547 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:22.746521 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:22.979392 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:22.979358 2564 generic.go:356] "Generic (PLEG): container finished" podID="6df00b4d-c9bf-4058-a168-9be06b94cfda" containerID="d2769c6c1cca4de745e37de2e0bf543b457fce601652135249b9aa8d6ae597e7" exitCode=0 Jun 09 12:32:22.979754 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:22.979439 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twwfm" event={"ID":"6df00b4d-c9bf-4058-a168-9be06b94cfda","Type":"ContainerDied","Data":"d2769c6c1cca4de745e37de2e0bf543b457fce601652135249b9aa8d6ae597e7"} Jun 09 12:32:23.984493 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:23.984454 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-twwfm" event={"ID":"6df00b4d-c9bf-4058-a168-9be06b94cfda","Type":"ContainerStarted","Data":"1eb7258d97526c71560756819223f060bb020fa42fa0f8dad26ba1fb9f518a18"} Jun 09 12:32:24.005208 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:24.005162 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-twwfm" podStartSLOduration=10.445763591 podStartE2EDuration="42.005147107s" totalImagesPullingTime="31.559383516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:24.00495632 +0000 UTC m=+41.702443251" watchObservedRunningTime="2026-06-09 12:32:24.005147107 +0000 UTC m=+41.702634032" Jun 09 12:32:24.125820 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:24.125776 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:24.226288 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:24.226259 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:24.938342 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:24.938297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:24.938697 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:24.938440 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:24.938697 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:24.938515 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls podName:75004378-a4fe-48db-9825-2d3cf54da59a nodeName:}" failed. No retries permitted until 2026-06-09 12:32:32.938493455 +0000 UTC m=+50.635980379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls") pod "dns-default-w7l97" (UID: "75004378-a4fe-48db-9825-2d3cf54da59a") : secret "dns-default-metrics-tls" not found Jun 09 12:32:31.899279 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:31.899243 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5"] Jun 09 12:32:31.928878 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:31.928858 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5"] Jun 09 12:32:31.928991 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:31.928935 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" Jun 09 12:32:31.930825 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:31.930805 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 12:32:31.930941 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:31.930856 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 12:32:31.931621 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:31.931604 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 12:32:31.931694 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:31.931608 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4nfml\"" Jun 09 12:32:31.931694 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:31.931648 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 12:32:31.985439 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:31.985420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3920251-511e-4176-b31e-2f9f479ed9a6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5\" (UID: \"f3920251-511e-4176-b31e-2f9f479ed9a6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" Jun 09 12:32:31.985546 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:31.985451 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfhtp\" (UniqueName: \"kubernetes.io/projected/f3920251-511e-4176-b31e-2f9f479ed9a6-kube-api-access-tfhtp\") pod \"managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5\" (UID: \"f3920251-511e-4176-b31e-2f9f479ed9a6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" Jun 09 12:32:32.086431 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:32.086403 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3920251-511e-4176-b31e-2f9f479ed9a6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5\" (UID: \"f3920251-511e-4176-b31e-2f9f479ed9a6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" Jun 09 12:32:32.086541 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:32.086435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhtp\" (UniqueName: \"kubernetes.io/projected/f3920251-511e-4176-b31e-2f9f479ed9a6-kube-api-access-tfhtp\") pod \"managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5\" (UID: \"f3920251-511e-4176-b31e-2f9f479ed9a6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" Jun 09 12:32:32.089938 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:32.089915 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3920251-511e-4176-b31e-2f9f479ed9a6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5\" (UID: \"f3920251-511e-4176-b31e-2f9f479ed9a6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" Jun 09 12:32:32.094350 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:32.094324 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfhtp\" (UniqueName: \"kubernetes.io/projected/f3920251-511e-4176-b31e-2f9f479ed9a6-kube-api-access-tfhtp\") pod \"managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5\" (UID: \"f3920251-511e-4176-b31e-2f9f479ed9a6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" Jun 09 12:32:32.253511 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:32.253485 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" Jun 09 12:32:32.396497 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:32.396468 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5"] Jun 09 12:32:32.994941 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:32.994912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:32.995324 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:32.995032 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:32.995324 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:32.995087 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls podName:75004378-a4fe-48db-9825-2d3cf54da59a nodeName:}" failed. No retries permitted until 2026-06-09 12:32:48.995070515 +0000 UTC m=+66.692557443 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls") pod "dns-default-w7l97" (UID: "75004378-a4fe-48db-9825-2d3cf54da59a") : secret "dns-default-metrics-tls" not found Jun 09 12:32:33.006256 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:33.006233 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" event={"ID":"f3920251-511e-4176-b31e-2f9f479ed9a6","Type":"ContainerStarted","Data":"d7ab9855d91f588085ac01b7db9e82cb74a9e13d136a1b5b27bfb476d302b5a3"} Jun 09 12:32:33.306900 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:33.306826 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:33.364176 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:33.364145 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:37.015904 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:37.015862 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" event={"ID":"f3920251-511e-4176-b31e-2f9f479ed9a6","Type":"ContainerStarted","Data":"9b3fde99406ed21a03f99ec999a744ef8cc4cb55935882ce7ffd6b7da1566a72"} Jun 09 12:32:37.031472 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:37.031411 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" podStartSLOduration=2.267746424 podStartE2EDuration="6.031397416s" totalImagesPullingTime="3.763650992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:37.030530725 +0000 UTC m=+54.728017654" watchObservedRunningTime="2026-06-09 12:32:37.031397416 +0000 UTC m=+54.728884345" Jun 09 12:32:43.948798 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:43.948765 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:43.954811 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:43.954792 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tgb8g" Jun 09 12:32:44.050373 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:44.050332 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:44.147840 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:44.147801 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:44.213654 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:44.213576 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:47.470421 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:47.470382 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:47.523571 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:47.523545 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:32:48.499578 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:48.499513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmhzj\" (UniqueName: \"kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj\") pod \"network-check-target-827j9\" (UID: \"d203da4c-dafa-49d8-8bcd-9caf517afbc1\") " pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:48.499975 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:48.499645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:32:48.502144 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:48.502120 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 12:32:48.502144 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:48.502134 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 12:32:48.509831 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:48.509816 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 12:32:48.509893 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:48.509884 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs podName:731e3c8f-34be-4caa-bc70-fba5d3fa2b08 nodeName:}" failed. No retries permitted until 2026-06-09 12:33:52.509869078 +0000 UTC m=+130.207355996 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs") pod "network-metrics-daemon-m7szl" (UID: "731e3c8f-34be-4caa-bc70-fba5d3fa2b08") : secret "metrics-daemon-secret" not found Jun 09 12:32:48.511709 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:48.511695 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 12:32:48.522449 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:48.522429 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmhzj\" (UniqueName: \"kubernetes.io/projected/d203da4c-dafa-49d8-8bcd-9caf517afbc1-kube-api-access-vmhzj\") pod \"network-check-target-827j9\" (UID: \"d203da4c-dafa-49d8-8bcd-9caf517afbc1\") " pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:48.600504 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:48.600472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:48.602670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:48.602654 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 12:32:48.613027 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:48.613006 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f203b2b9-f1b1-4e3b-bf90-b4618a470c1a-original-pull-secret\") pod \"global-pull-secret-syncer-2jgwm\" (UID: \"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a\") " pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:48.795601 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:48.795509 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2jgwm" Jun 09 12:32:48.806608 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:48.806586 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4297v\"" Jun 09 12:32:48.815160 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:48.815135 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:48.920160 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:48.920136 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2jgwm"] Jun 09 12:32:48.922569 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:32:48.922532 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf203b2b9_f1b1_4e3b_bf90_b4618a470c1a.slice/crio-2d1687c2a5432d6a4af717a168ad0a9c63e06ec9cb17eebdb0f398c25e92b98f WatchSource:0}: Error finding container 2d1687c2a5432d6a4af717a168ad0a9c63e06ec9cb17eebdb0f398c25e92b98f: Status 404 returned error can't find the container with id 2d1687c2a5432d6a4af717a168ad0a9c63e06ec9cb17eebdb0f398c25e92b98f Jun 09 12:32:48.934419 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:48.934391 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-827j9"] Jun 09 12:32:48.937789 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:32:48.937769 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd203da4c_dafa_49d8_8bcd_9caf517afbc1.slice/crio-88dad012f912de873e02c3fbe7dc7ba64512e4e292b3f696b21eda9dd988d3d7 WatchSource:0}: Error finding container 88dad012f912de873e02c3fbe7dc7ba64512e4e292b3f696b21eda9dd988d3d7: Status 404 returned error can't find the container with id 88dad012f912de873e02c3fbe7dc7ba64512e4e292b3f696b21eda9dd988d3d7 Jun 09 12:32:49.003504 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:49.003478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:32:49.003633 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:49.003619 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:32:49.003678 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:32:49.003673 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls podName:75004378-a4fe-48db-9825-2d3cf54da59a nodeName:}" failed. No retries permitted until 2026-06-09 12:33:21.003655602 +0000 UTC m=+98.701142512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls") pod "dns-default-w7l97" (UID: "75004378-a4fe-48db-9825-2d3cf54da59a") : secret "dns-default-metrics-tls" not found Jun 09 12:32:49.045764 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:49.045696 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-827j9" event={"ID":"d203da4c-dafa-49d8-8bcd-9caf517afbc1","Type":"ContainerStarted","Data":"88dad012f912de873e02c3fbe7dc7ba64512e4e292b3f696b21eda9dd988d3d7"} Jun 09 12:32:49.046684 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:49.046663 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2jgwm" event={"ID":"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a","Type":"ContainerStarted","Data":"2d1687c2a5432d6a4af717a168ad0a9c63e06ec9cb17eebdb0f398c25e92b98f"} Jun 09 12:32:54.061914 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:54.061870 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2jgwm" event={"ID":"f203b2b9-f1b1-4e3b-bf90-b4618a470c1a","Type":"ContainerStarted","Data":"0b720fdb2cc4cb43e7986f7ecbe4109b6ea25d6172c451b4d68b7c5d8987d823"} Jun 09 12:32:54.063227 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:54.063200 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-827j9" event={"ID":"d203da4c-dafa-49d8-8bcd-9caf517afbc1","Type":"ContainerStarted","Data":"95b05b289d466764864475463e76422445e04e6f5da8f2f56072bde3a6176ada"} Jun 09 12:32:54.063351 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:54.063332 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:32:54.077499 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:54.077459 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2jgwm" podStartSLOduration=66.874121593 podStartE2EDuration="1m11.077445336s" totalImagesPullingTime="4.203323743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:54.076956833 +0000 UTC m=+71.774443761" watchObservedRunningTime="2026-06-09 12:32:54.077445336 +0000 UTC m=+71.774932265" Jun 09 12:32:54.092259 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:32:54.092203 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-827j9" podStartSLOduration=67.907138502 podStartE2EDuration="1m12.092190042s" totalImagesPullingTime="4.18505154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:32:54.0921114 +0000 UTC m=+71.789598339" watchObservedRunningTime="2026-06-09 12:32:54.092190042 +0000 UTC m=+71.789676973" Jun 09 12:33:21.007835 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:33:21.007791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:33:21.008267 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:33:21.007965 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:33:21.008267 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:33:21.008047 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls podName:75004378-a4fe-48db-9825-2d3cf54da59a nodeName:}" failed. No retries permitted until 2026-06-09 12:34:25.008028959 +0000 UTC m=+162.705515866 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls") pod "dns-default-w7l97" (UID: "75004378-a4fe-48db-9825-2d3cf54da59a") : secret "dns-default-metrics-tls" not found Jun 09 12:33:25.067833 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:33:25.067804 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-827j9" Jun 09 12:33:52.603285 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:33:52.603243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:33:52.603795 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:33:52.603354 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 12:33:52.603795 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:33:52.603417 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs podName:731e3c8f-34be-4caa-bc70-fba5d3fa2b08 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:54.603402114 +0000 UTC m=+252.300889021 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs") pod "network-metrics-daemon-m7szl" (UID: "731e3c8f-34be-4caa-bc70-fba5d3fa2b08") : secret "metrics-daemon-secret" not found Jun 09 12:34:20.224322 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:20.224270 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w7l97" podUID="75004378-a4fe-48db-9825-2d3cf54da59a" Jun 09 12:34:20.262154 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:20.262131 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w7l97" Jun 09 12:34:21.788651 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:21.788597 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-m7szl" podUID="731e3c8f-34be-4caa-bc70-fba5d3fa2b08" Jun 09 12:34:25.022077 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:25.021988 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:34:25.022458 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:25.022123 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:34:25.022458 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:25.022188 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls podName:75004378-a4fe-48db-9825-2d3cf54da59a nodeName:}" failed. No retries permitted until 2026-06-09 12:36:27.022173215 +0000 UTC m=+284.719660125 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls") pod "dns-default-w7l97" (UID: "75004378-a4fe-48db-9825-2d3cf54da59a") : secret "dns-default-metrics-tls" not found Jun 09 12:34:33.773939 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:33.773895 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:34:37.303759 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:37.303724 2564 generic.go:356] "Generic (PLEG): container finished" podID="f3920251-511e-4176-b31e-2f9f479ed9a6" containerID="9b3fde99406ed21a03f99ec999a744ef8cc4cb55935882ce7ffd6b7da1566a72" exitCode=255 Jun 09 12:34:37.303759 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:37.303762 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" event={"ID":"f3920251-511e-4176-b31e-2f9f479ed9a6","Type":"ContainerDied","Data":"9b3fde99406ed21a03f99ec999a744ef8cc4cb55935882ce7ffd6b7da1566a72"} Jun 09 12:34:37.309020 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:37.309003 2564 scope.go:117] "RemoveContainer" containerID="9b3fde99406ed21a03f99ec999a744ef8cc4cb55935882ce7ffd6b7da1566a72" Jun 09 12:34:38.308312 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:38.308278 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" event={"ID":"f3920251-511e-4176-b31e-2f9f479ed9a6","Type":"ContainerStarted","Data":"485ef0e9c6107f90eff10e6dd336f60004a2bb0b0ad6a2c35dde7d99bd7dd70a"} Jun 09 12:34:57.263971 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.263939 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-98d765c7f-2fw6t"] Jun 09 12:34:57.265735 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.265719 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.269913 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.269874 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 09 12:34:57.270031 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.269922 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 09 12:34:57.270031 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.269944 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 09 12:34:57.270301 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.270286 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 12:34:57.270985 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.270965 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 12:34:57.271095 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.271016 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 09 12:34:57.271095 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.271050 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-l5dhk\"" Jun 09 12:34:57.297174 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.297153 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-98d765c7f-2fw6t"] Jun 09 12:34:57.329436 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.329415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-stats-auth\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.329551 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.329457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.329551 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.329481 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkj4f\" (UniqueName: \"kubernetes.io/projected/0bd6da96-28ea-47a0-b935-b389c8d132d8-kube-api-access-wkj4f\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.329551 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.329509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.329713 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.329578 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-default-certificate\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.345484 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.345460 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-gldp6"] Jun 09 12:34:57.347289 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.347273 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:34:57.349330 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.349312 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7pwp8\"" Jun 09 12:34:57.349847 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.349825 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 12:34:57.349930 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.349909 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 12:34:57.350053 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.350039 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 12:34:57.350199 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.350149 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:34:57.350333 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.350314 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84"] Jun 09 12:34:57.352368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.352345 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9g69p"] Jun 09 12:34:57.352477 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.352462 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" Jun 09 12:34:57.354268 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.354182 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9g69p" Jun 09 12:34:57.354858 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.354836 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 12:34:57.359745 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.359728 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7948fc977c-qjhgz"] Jun 09 12:34:57.360601 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.360584 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 12:34:57.360694 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.360666 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-s5bcw\"" Jun 09 12:34:57.360772 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.360747 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:34:57.360844 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.360795 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:34:57.360953 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.360934 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 12:34:57.361214 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.361196 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2tjb9\"" Jun 09 12:34:57.361304 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.361290 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 12:34:57.361548 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.361533 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.367654 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.367632 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-gldp6"] Jun 09 12:34:57.368132 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.367952 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 12:34:57.368132 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.367997 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 12:34:57.368428 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.368410 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 12:34:57.371915 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.371897 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n2brk\"" Jun 09 12:34:57.378160 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.378142 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84"] Jun 09 12:34:57.379243 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.379224 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9g69p"] Jun 09 12:34:57.381784 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.381761 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 12:34:57.387727 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.387707 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7948fc977c-qjhgz"] Jun 09 12:34:57.430646 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.430623 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3d19277-5428-4b35-8e21-8b0d561e7ad1-image-registry-private-configuration\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.430763 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.430658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zls84\" (UID: \"06b10a38-580d-4b48-9a1f-aa7a73bf2109\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" Jun 09 12:34:57.430763 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.430692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.430763 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.430717 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkgjj\" (UniqueName: \"kubernetes.io/projected/06b10a38-580d-4b48-9a1f-aa7a73bf2109-kube-api-access-wkgjj\") pod \"cluster-samples-operator-854f8b96b6-zls84\" (UID: \"06b10a38-580d-4b48-9a1f-aa7a73bf2109\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" Jun 09 12:34:57.430763 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.430740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vphv\" (UniqueName: \"kubernetes.io/projected/7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68-kube-api-access-7vphv\") pod \"console-operator-668fdbf85c-gldp6\" (UID: \"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68\") " pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:34:57.431003 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.430765 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-default-certificate\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.431003 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:57.430782 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 12:34:57.431003 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:57.430850 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs podName:0bd6da96-28ea-47a0-b935-b389c8d132d8 nodeName:}" failed. No retries permitted until 2026-06-09 12:34:57.930834191 +0000 UTC m=+195.628321097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs") pod "router-default-98d765c7f-2fw6t" (UID: "0bd6da96-28ea-47a0-b935-b389c8d132d8") : secret "router-metrics-certs-default" not found Jun 09 12:34:57.431003 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.430788 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3d19277-5428-4b35-8e21-8b0d561e7ad1-ca-trust-extracted\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.431003 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.430894 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3d19277-5428-4b35-8e21-8b0d561e7ad1-installation-pull-secrets\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.431003 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.430921 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.431003 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.430949 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68-serving-cert\") pod \"console-operator-668fdbf85c-gldp6\" (UID: \"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68\") " pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:34:57.431003 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.430970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3d19277-5428-4b35-8e21-8b0d561e7ad1-trusted-ca\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.431003 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.430987 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-certificates\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.431385 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.431044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-stats-auth\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.431385 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.431075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz5vt\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-kube-api-access-bz5vt\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.431385 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.431096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.431385 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.431120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkj4f\" (UniqueName: \"kubernetes.io/projected/0bd6da96-28ea-47a0-b935-b389c8d132d8-kube-api-access-wkj4f\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.431385 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:57.431241 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle podName:0bd6da96-28ea-47a0-b935-b389c8d132d8 nodeName:}" failed. No retries permitted until 2026-06-09 12:34:57.931222083 +0000 UTC m=+195.628709004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle") pod "router-default-98d765c7f-2fw6t" (UID: "0bd6da96-28ea-47a0-b935-b389c8d132d8") : configmap references non-existent config key: service-ca.crt Jun 09 12:34:57.431385 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.431342 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqjww\" (UniqueName: \"kubernetes.io/projected/7a055be1-d460-4cd1-a19d-9d6790702b9c-kube-api-access-lqjww\") pod \"volume-data-source-validator-78dd696465-9g69p\" (UID: \"7a055be1-d460-4cd1-a19d-9d6790702b9c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9g69p" Jun 09 12:34:57.431385 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.431376 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68-config\") pod \"console-operator-668fdbf85c-gldp6\" (UID: \"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68\") " pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:34:57.431644 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.431427 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68-trusted-ca\") pod \"console-operator-668fdbf85c-gldp6\" (UID: \"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68\") " pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:34:57.431644 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.431454 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-bound-sa-token\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.433207 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.433187 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-default-certificate\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.433357 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.433341 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-stats-auth\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.449960 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.449933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkj4f\" (UniqueName: \"kubernetes.io/projected/0bd6da96-28ea-47a0-b935-b389c8d132d8-kube-api-access-wkj4f\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.532285 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.532285 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532259 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68-serving-cert\") pod \"console-operator-668fdbf85c-gldp6\" (UID: \"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68\") " pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:34:57.532491 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532301 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3d19277-5428-4b35-8e21-8b0d561e7ad1-trusted-ca\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.532491 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532351 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-certificates\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.532491 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:57.532375 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 12:34:57.532491 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:57.532395 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7948fc977c-qjhgz: secret "image-registry-tls" not found Jun 09 12:34:57.532491 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:57.532461 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls podName:a3d19277-5428-4b35-8e21-8b0d561e7ad1 nodeName:}" failed. No retries permitted until 2026-06-09 12:34:58.032441612 +0000 UTC m=+195.729928519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls") pod "image-registry-7948fc977c-qjhgz" (UID: "a3d19277-5428-4b35-8e21-8b0d561e7ad1") : secret "image-registry-tls" not found Jun 09 12:34:57.532779 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz5vt\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-kube-api-access-bz5vt\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.532779 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqjww\" (UniqueName: \"kubernetes.io/projected/7a055be1-d460-4cd1-a19d-9d6790702b9c-kube-api-access-lqjww\") pod \"volume-data-source-validator-78dd696465-9g69p\" (UID: \"7a055be1-d460-4cd1-a19d-9d6790702b9c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9g69p" Jun 09 12:34:57.532779 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532619 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68-config\") pod \"console-operator-668fdbf85c-gldp6\" (UID: \"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68\") " pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:34:57.532779 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68-trusted-ca\") pod \"console-operator-668fdbf85c-gldp6\" (UID: \"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68\") " pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:34:57.532779 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-bound-sa-token\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.532779 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532776 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3d19277-5428-4b35-8e21-8b0d561e7ad1-image-registry-private-configuration\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.533077 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zls84\" (UID: \"06b10a38-580d-4b48-9a1f-aa7a73bf2109\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" Jun 09 12:34:57.533077 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkgjj\" (UniqueName: \"kubernetes.io/projected/06b10a38-580d-4b48-9a1f-aa7a73bf2109-kube-api-access-wkgjj\") pod \"cluster-samples-operator-854f8b96b6-zls84\" (UID: \"06b10a38-580d-4b48-9a1f-aa7a73bf2109\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" Jun 09 12:34:57.533077 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532876 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vphv\" (UniqueName: \"kubernetes.io/projected/7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68-kube-api-access-7vphv\") pod \"console-operator-668fdbf85c-gldp6\" (UID: \"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68\") " pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:34:57.533077 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3d19277-5428-4b35-8e21-8b0d561e7ad1-ca-trust-extracted\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.533077 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3d19277-5428-4b35-8e21-8b0d561e7ad1-installation-pull-secrets\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.533077 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.532985 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-certificates\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.533415 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.533251 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3d19277-5428-4b35-8e21-8b0d561e7ad1-trusted-ca\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.533415 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:57.533350 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 12:34:57.533415 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.533393 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68-config\") pod \"console-operator-668fdbf85c-gldp6\" (UID: \"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68\") " pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:34:57.533415 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:57.533412 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls podName:06b10a38-580d-4b48-9a1f-aa7a73bf2109 nodeName:}" failed. No retries permitted until 2026-06-09 12:34:58.033396525 +0000 UTC m=+195.730883453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-zls84" (UID: "06b10a38-580d-4b48-9a1f-aa7a73bf2109") : secret "samples-operator-tls" not found Jun 09 12:34:57.533684 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.533664 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3d19277-5428-4b35-8e21-8b0d561e7ad1-ca-trust-extracted\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.533925 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.533906 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68-trusted-ca\") pod \"console-operator-668fdbf85c-gldp6\" (UID: \"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68\") " pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:34:57.534983 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.534961 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68-serving-cert\") pod \"console-operator-668fdbf85c-gldp6\" (UID: \"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68\") " pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:34:57.535260 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.535244 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3d19277-5428-4b35-8e21-8b0d561e7ad1-installation-pull-secrets\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.535394 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.535375 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3d19277-5428-4b35-8e21-8b0d561e7ad1-image-registry-private-configuration\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.542496 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.542430 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-bound-sa-token\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.544097 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.544075 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqjww\" (UniqueName: \"kubernetes.io/projected/7a055be1-d460-4cd1-a19d-9d6790702b9c-kube-api-access-lqjww\") pod \"volume-data-source-validator-78dd696465-9g69p\" (UID: \"7a055be1-d460-4cd1-a19d-9d6790702b9c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9g69p" Jun 09 12:34:57.544230 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.544213 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vphv\" (UniqueName: \"kubernetes.io/projected/7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68-kube-api-access-7vphv\") pod \"console-operator-668fdbf85c-gldp6\" (UID: \"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68\") " pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:34:57.544285 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.544224 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkgjj\" (UniqueName: \"kubernetes.io/projected/06b10a38-580d-4b48-9a1f-aa7a73bf2109-kube-api-access-wkgjj\") pod \"cluster-samples-operator-854f8b96b6-zls84\" (UID: \"06b10a38-580d-4b48-9a1f-aa7a73bf2109\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" Jun 09 12:34:57.544493 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.544477 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz5vt\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-kube-api-access-bz5vt\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:57.657423 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.657398 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:34:57.670915 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.670890 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9g69p" Jun 09 12:34:57.678835 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.678764 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:34:57.769826 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.769779 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:34:57.783456 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.783402 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-gldp6"] Jun 09 12:34:57.786602 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:34:57.786553 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a40ef0a_d3fa_46ed_a98f_8b3e8d06af68.slice/crio-ea2817cecdb6ad330ba2b645023899664f82dfdc7ee7cce488197b8f05826a23 WatchSource:0}: Error finding container ea2817cecdb6ad330ba2b645023899664f82dfdc7ee7cce488197b8f05826a23: Status 404 returned error can't find the container with id ea2817cecdb6ad330ba2b645023899664f82dfdc7ee7cce488197b8f05826a23 Jun 09 12:34:57.800485 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.800462 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9g69p"] Jun 09 12:34:57.802766 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:34:57.802747 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a055be1_d460_4cd1_a19d_9d6790702b9c.slice/crio-b3e2771d11be05a10c7406d9a4059d4f2219eaacc4caac661c3b68f512b8d012 WatchSource:0}: Error finding container b3e2771d11be05a10c7406d9a4059d4f2219eaacc4caac661c3b68f512b8d012: Status 404 returned error can't find the container with id b3e2771d11be05a10c7406d9a4059d4f2219eaacc4caac661c3b68f512b8d012 Jun 09 12:34:57.936537 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.936509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.936671 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:57.936611 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:57.936711 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:57.936674 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle podName:0bd6da96-28ea-47a0-b935-b389c8d132d8 nodeName:}" failed. No retries permitted until 2026-06-09 12:34:58.936655641 +0000 UTC m=+196.634142570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle") pod "router-default-98d765c7f-2fw6t" (UID: "0bd6da96-28ea-47a0-b935-b389c8d132d8") : configmap references non-existent config key: service-ca.crt Jun 09 12:34:57.936752 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:57.936734 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 12:34:57.936787 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:57.936779 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs podName:0bd6da96-28ea-47a0-b935-b389c8d132d8 nodeName:}" failed. No retries permitted until 2026-06-09 12:34:58.936766025 +0000 UTC m=+196.634252936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs") pod "router-default-98d765c7f-2fw6t" (UID: "0bd6da96-28ea-47a0-b935-b389c8d132d8") : secret "router-metrics-certs-default" not found Jun 09 12:34:58.037872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:58.037792 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zls84\" (UID: \"06b10a38-580d-4b48-9a1f-aa7a73bf2109\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" Jun 09 12:34:58.037872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:58.037844 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:58.038046 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:58.037943 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 12:34:58.038046 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:58.037950 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 12:34:58.038046 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:58.037963 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7948fc977c-qjhgz: secret "image-registry-tls" not found Jun 09 12:34:58.038046 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:58.038008 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls podName:06b10a38-580d-4b48-9a1f-aa7a73bf2109 nodeName:}" failed. No retries permitted until 2026-06-09 12:34:59.037990927 +0000 UTC m=+196.735477846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-zls84" (UID: "06b10a38-580d-4b48-9a1f-aa7a73bf2109") : secret "samples-operator-tls" not found Jun 09 12:34:58.038046 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:58.038026 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls podName:a3d19277-5428-4b35-8e21-8b0d561e7ad1 nodeName:}" failed. No retries permitted until 2026-06-09 12:34:59.038017105 +0000 UTC m=+196.735504012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls") pod "image-registry-7948fc977c-qjhgz" (UID: "a3d19277-5428-4b35-8e21-8b0d561e7ad1") : secret "image-registry-tls" not found Jun 09 12:34:58.366133 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:58.366060 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9g69p" event={"ID":"7a055be1-d460-4cd1-a19d-9d6790702b9c","Type":"ContainerStarted","Data":"b3e2771d11be05a10c7406d9a4059d4f2219eaacc4caac661c3b68f512b8d012"} Jun 09 12:34:58.367281 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:58.367253 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" event={"ID":"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68","Type":"ContainerStarted","Data":"ea2817cecdb6ad330ba2b645023899664f82dfdc7ee7cce488197b8f05826a23"} Jun 09 12:34:58.945362 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:58.945341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:58.945469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:58.945429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:34:58.945526 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:58.945492 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle podName:0bd6da96-28ea-47a0-b935-b389c8d132d8 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:00.945470185 +0000 UTC m=+198.642957109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle") pod "router-default-98d765c7f-2fw6t" (UID: "0bd6da96-28ea-47a0-b935-b389c8d132d8") : configmap references non-existent config key: service-ca.crt Jun 09 12:34:58.945610 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:58.945542 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 12:34:58.945663 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:58.945614 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs podName:0bd6da96-28ea-47a0-b935-b389c8d132d8 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:00.945597748 +0000 UTC m=+198.643084685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs") pod "router-default-98d765c7f-2fw6t" (UID: "0bd6da96-28ea-47a0-b935-b389c8d132d8") : secret "router-metrics-certs-default" not found Jun 09 12:34:59.046784 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:59.046748 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zls84\" (UID: \"06b10a38-580d-4b48-9a1f-aa7a73bf2109\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" Jun 09 12:34:59.046969 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:59.046905 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 12:34:59.046969 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:59.046920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:34:59.047079 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:59.047024 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls podName:06b10a38-580d-4b48-9a1f-aa7a73bf2109 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:01.047000176 +0000 UTC m=+198.744487086 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-zls84" (UID: "06b10a38-580d-4b48-9a1f-aa7a73bf2109") : secret "samples-operator-tls" not found Jun 09 12:34:59.047079 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:59.047053 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 12:34:59.047079 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:59.047066 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7948fc977c-qjhgz: secret "image-registry-tls" not found Jun 09 12:34:59.047218 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:34:59.047107 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls podName:a3d19277-5428-4b35-8e21-8b0d561e7ad1 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:01.047096283 +0000 UTC m=+198.744583191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls") pod "image-registry-7948fc977c-qjhgz" (UID: "a3d19277-5428-4b35-8e21-8b0d561e7ad1") : secret "image-registry-tls" not found Jun 09 12:34:59.372417 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:59.372375 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9g69p" event={"ID":"7a055be1-d460-4cd1-a19d-9d6790702b9c","Type":"ContainerStarted","Data":"8f33e740a6b861e1df1b97e1f807caa8aa48fc55d74b9972eb46fbc4dae96ba3"} Jun 09 12:34:59.389250 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:59.389209 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-9g69p" podStartSLOduration=1.307530245 podStartE2EDuration="2.389195137s" totalImagesPullingTime="1.081664892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:34:59.388375026 +0000 UTC m=+197.085861955" watchObservedRunningTime="2026-06-09 12:34:59.389195137 +0000 UTC m=+197.086682045" Jun 09 12:34:59.497059 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:59.497028 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:34:59.574379 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:34:59.574340 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:00.376394 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:00.376375 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/0.log" Jun 09 12:35:00.376765 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:00.376415 2564 generic.go:356] "Generic (PLEG): container finished" podID="7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68" containerID="34cd54032bcfe6aff8bca8acb1e4de8f0e93a78553a99572f366b4a4c3ab99fb" exitCode=255 Jun 09 12:35:00.376765 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:00.376470 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" event={"ID":"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68","Type":"ContainerDied","Data":"34cd54032bcfe6aff8bca8acb1e4de8f0e93a78553a99572f366b4a4c3ab99fb"} Jun 09 12:35:00.376878 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:00.376791 2564 scope.go:117] "RemoveContainer" containerID="34cd54032bcfe6aff8bca8acb1e4de8f0e93a78553a99572f366b4a4c3ab99fb" Jun 09 12:35:00.962888 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:00.962858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:35:00.963063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:00.962914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:35:00.963063 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:00.962999 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 12:35:00.963063 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:00.963029 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle podName:0bd6da96-28ea-47a0-b935-b389c8d132d8 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:04.963015661 +0000 UTC m=+202.660502572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle") pod "router-default-98d765c7f-2fw6t" (UID: "0bd6da96-28ea-47a0-b935-b389c8d132d8") : configmap references non-existent config key: service-ca.crt Jun 09 12:35:00.963063 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:00.963063 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs podName:0bd6da96-28ea-47a0-b935-b389c8d132d8 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:04.963049586 +0000 UTC m=+202.660536493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs") pod "router-default-98d765c7f-2fw6t" (UID: "0bd6da96-28ea-47a0-b935-b389c8d132d8") : secret "router-metrics-certs-default" not found Jun 09 12:35:01.063493 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:01.063460 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:35:01.063645 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:01.063554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zls84\" (UID: \"06b10a38-580d-4b48-9a1f-aa7a73bf2109\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" Jun 09 12:35:01.063645 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:01.063608 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 12:35:01.063645 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:01.063626 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7948fc977c-qjhgz: secret "image-registry-tls" not found Jun 09 12:35:01.063739 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:01.063659 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 12:35:01.063739 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:01.063675 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls podName:a3d19277-5428-4b35-8e21-8b0d561e7ad1 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:05.063660461 +0000 UTC m=+202.761147371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls") pod "image-registry-7948fc977c-qjhgz" (UID: "a3d19277-5428-4b35-8e21-8b0d561e7ad1") : secret "image-registry-tls" not found Jun 09 12:35:01.063739 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:01.063713 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls podName:06b10a38-580d-4b48-9a1f-aa7a73bf2109 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:05.063701998 +0000 UTC m=+202.761188904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-zls84" (UID: "06b10a38-580d-4b48-9a1f-aa7a73bf2109") : secret "samples-operator-tls" not found Jun 09 12:35:01.387140 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:01.387069 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/1.log" Jun 09 12:35:01.387527 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:01.387457 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/0.log" Jun 09 12:35:01.387527 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:01.387487 2564 generic.go:356] "Generic (PLEG): container finished" podID="7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68" containerID="d0af22acff796821eecf8993e92059a3d86564b66e8d99c5e2a452eda0c2f492" exitCode=255 Jun 09 12:35:01.387649 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:01.387533 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" event={"ID":"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68","Type":"ContainerDied","Data":"d0af22acff796821eecf8993e92059a3d86564b66e8d99c5e2a452eda0c2f492"} Jun 09 12:35:01.387649 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:01.387625 2564 scope.go:117] "RemoveContainer" containerID="34cd54032bcfe6aff8bca8acb1e4de8f0e93a78553a99572f366b4a4c3ab99fb" Jun 09 12:35:01.387835 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:01.387818 2564 scope.go:117] "RemoveContainer" containerID="d0af22acff796821eecf8993e92059a3d86564b66e8d99c5e2a452eda0c2f492" Jun 09 12:35:01.388022 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:01.388001 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-gldp6_openshift-console-operator(7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68)\"" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" podUID="7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68" Jun 09 12:35:02.302687 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:02.302646 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:02.391515 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:02.391489 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/1.log" Jun 09 12:35:02.391977 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:02.391916 2564 scope.go:117] "RemoveContainer" containerID="d0af22acff796821eecf8993e92059a3d86564b66e8d99c5e2a452eda0c2f492" Jun 09 12:35:02.392116 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:02.392093 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-gldp6_openshift-console-operator(7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68)\"" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" podUID="7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68" Jun 09 12:35:02.425108 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:02.425085 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:02.552018 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:02.551999 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:02.866263 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:02.866233 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:03.004425 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:03.004391 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:03.114290 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:03.114260 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:03.240368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:03.240338 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:03.336199 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:03.336175 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:04.008375 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:04.008351 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fcwvm_cf20c681-6757-49db-ac7a-3070a1d69d4c/dns-node-resolver/0.log" Jun 09 12:35:04.916292 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:04.916263 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:04.995852 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:04.995815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:35:04.996002 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:04.995887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:35:04.996002 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:04.995970 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle podName:0bd6da96-28ea-47a0-b935-b389c8d132d8 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:12.995954103 +0000 UTC m=+210.693441010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle") pod "router-default-98d765c7f-2fw6t" (UID: "0bd6da96-28ea-47a0-b935-b389c8d132d8") : configmap references non-existent config key: service-ca.crt Jun 09 12:35:04.996002 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:04.995988 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 12:35:04.996115 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:04.996033 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs podName:0bd6da96-28ea-47a0-b935-b389c8d132d8 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:12.996017752 +0000 UTC m=+210.693504674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs") pod "router-default-98d765c7f-2fw6t" (UID: "0bd6da96-28ea-47a0-b935-b389c8d132d8") : secret "router-metrics-certs-default" not found Jun 09 12:35:05.027855 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:05.027832 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:05.096778 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:05.096752 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:35:05.096903 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:05.096840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zls84\" (UID: \"06b10a38-580d-4b48-9a1f-aa7a73bf2109\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" Jun 09 12:35:05.096939 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:05.096900 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 12:35:05.096939 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:05.096919 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7948fc977c-qjhgz: secret "image-registry-tls" not found Jun 09 12:35:05.097004 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:05.096961 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls podName:a3d19277-5428-4b35-8e21-8b0d561e7ad1 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:13.096947141 +0000 UTC m=+210.794434048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls") pod "image-registry-7948fc977c-qjhgz" (UID: "a3d19277-5428-4b35-8e21-8b0d561e7ad1") : secret "image-registry-tls" not found Jun 09 12:35:05.097004 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:05.096918 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 12:35:05.097071 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:05.097034 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls podName:06b10a38-580d-4b48-9a1f-aa7a73bf2109 nodeName:}" failed. No retries permitted until 2026-06-09 12:35:13.097020443 +0000 UTC m=+210.794507369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-zls84" (UID: "06b10a38-580d-4b48-9a1f-aa7a73bf2109") : secret "samples-operator-tls" not found Jun 09 12:35:05.210131 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:05.210109 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qlfnh_fed43365-44f8-4220-87ec-327acf7f874f/node-ca/0.log" Jun 09 12:35:05.835555 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:05.835533 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8q6ht_fc101d88-babb-4b12-a41c-5054275e8682/serve-healthcheck-canary/0.log" Jun 09 12:35:06.031388 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:06.031360 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:06.202153 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:06.202118 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:06.579355 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:06.579274 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:06.823302 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:06.823269 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:07.147416 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:07.147383 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:07.407083 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:07.407003 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:07.658066 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:07.657970 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:35:07.658066 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:07.658031 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:35:07.658430 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:07.658413 2564 scope.go:117] "RemoveContainer" containerID="d0af22acff796821eecf8993e92059a3d86564b66e8d99c5e2a452eda0c2f492" Jun 09 12:35:07.658620 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:07.658600 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-gldp6_openshift-console-operator(7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68)\"" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" podUID="7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68" Jun 09 12:35:08.216409 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:08.216376 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:08.614799 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:08.614719 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:08.843015 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:08.842980 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:09.039322 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:09.039297 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:09.252142 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:09.252112 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:10.056615 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:10.056584 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:10.420106 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:10.420028 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:10.596225 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:10.596196 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:10.706177 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:10.706148 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:10.828437 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:10.828411 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:10.923121 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:10.923092 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:10.999110 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:10.999039 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:11.212032 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:11.212003 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:12.206401 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:12.206369 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:12.582307 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:12.582226 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:12.807058 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:12.807031 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:12.925889 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:12.925817 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:13.030757 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.030729 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:13.057872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.057852 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:35:13.057940 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.057911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:35:13.058450 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.058427 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bd6da96-28ea-47a0-b935-b389c8d132d8-service-ca-bundle\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:35:13.060068 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.060047 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bd6da96-28ea-47a0-b935-b389c8d132d8-metrics-certs\") pod \"router-default-98d765c7f-2fw6t\" (UID: \"0bd6da96-28ea-47a0-b935-b389c8d132d8\") " pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:35:13.158187 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.158160 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:35:13.158350 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.158251 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zls84\" (UID: \"06b10a38-580d-4b48-9a1f-aa7a73bf2109\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" Jun 09 12:35:13.160545 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.160518 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/06b10a38-580d-4b48-9a1f-aa7a73bf2109-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zls84\" (UID: \"06b10a38-580d-4b48-9a1f-aa7a73bf2109\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" Jun 09 12:35:13.160673 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.160525 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls\") pod \"image-registry-7948fc977c-qjhgz\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:35:13.173919 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.173897 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:35:13.201336 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.201308 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:13.265009 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.264972 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" Jun 09 12:35:13.277157 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.277127 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:35:13.306543 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.306473 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-98d765c7f-2fw6t"] Jun 09 12:35:13.310448 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:35:13.310421 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd6da96_28ea_47a0_b935_b389c8d132d8.slice/crio-9857d0702f1c6e6f47f3f93016d900bcf7ad386028cf3fe3e91ad1c8533e91f9 WatchSource:0}: Error finding container 9857d0702f1c6e6f47f3f93016d900bcf7ad386028cf3fe3e91ad1c8533e91f9: Status 404 returned error can't find the container with id 9857d0702f1c6e6f47f3f93016d900bcf7ad386028cf3fe3e91ad1c8533e91f9 Jun 09 12:35:13.400954 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.400928 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84"] Jun 09 12:35:13.419224 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.419196 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7948fc977c-qjhgz"] Jun 09 12:35:13.423435 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.423355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-98d765c7f-2fw6t" event={"ID":"0bd6da96-28ea-47a0-b935-b389c8d132d8","Type":"ContainerStarted","Data":"c85c64c7223b1915bdd48061672904e635dd6f65915f6c52e2851d9083064c66"} Jun 09 12:35:13.423435 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.423404 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-98d765c7f-2fw6t" event={"ID":"0bd6da96-28ea-47a0-b935-b389c8d132d8","Type":"ContainerStarted","Data":"9857d0702f1c6e6f47f3f93016d900bcf7ad386028cf3fe3e91ad1c8533e91f9"} Jun 09 12:35:13.424433 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:35:13.424405 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d19277_5428_4b35_8e21_8b0d561e7ad1.slice/crio-d65f7ee953df154325f19f6520d681442236c97acb6f541a16f0e8104668a90d WatchSource:0}: Error finding container d65f7ee953df154325f19f6520d681442236c97acb6f541a16f0e8104668a90d: Status 404 returned error can't find the container with id d65f7ee953df154325f19f6520d681442236c97acb6f541a16f0e8104668a90d Jun 09 12:35:13.456995 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:13.456957 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-98d765c7f-2fw6t" podStartSLOduration=16.456938159 podStartE2EDuration="16.456938159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:13.456041036 +0000 UTC m=+211.153527991" watchObservedRunningTime="2026-06-09 12:35:13.456938159 +0000 UTC m=+211.154425089" Jun 09 12:35:14.174348 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:14.174315 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:35:14.177897 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:14.177873 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:35:14.226682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:14.226614 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:14.428240 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:14.428150 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" event={"ID":"a3d19277-5428-4b35-8e21-8b0d561e7ad1","Type":"ContainerStarted","Data":"75256b741a67927caa4f64a90aac9bdf84450e9baeac8e8731e9d0c2014d18ec"} Jun 09 12:35:14.428240 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:14.428208 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" event={"ID":"a3d19277-5428-4b35-8e21-8b0d561e7ad1","Type":"ContainerStarted","Data":"d65f7ee953df154325f19f6520d681442236c97acb6f541a16f0e8104668a90d"} Jun 09 12:35:14.428765 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:14.428280 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:35:14.429436 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:14.429412 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" event={"ID":"06b10a38-580d-4b48-9a1f-aa7a73bf2109","Type":"ContainerStarted","Data":"58be0f06e0944813ca06dd0077ad5cca2e61e95f1ee8c8967115f41c1a0f4b54"} Jun 09 12:35:14.429713 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:14.429693 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:35:14.431028 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:14.431012 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-98d765c7f-2fw6t" Jun 09 12:35:14.460211 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:14.460173 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" podStartSLOduration=17.460161989 podStartE2EDuration="17.460161989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:14.459744873 +0000 UTC m=+212.157231801" watchObservedRunningTime="2026-06-09 12:35:14.460161989 +0000 UTC m=+212.157648936" Jun 09 12:35:14.617717 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:14.617643 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:14.794947 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:14.794892 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:15.000124 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:15.000089 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:15.392804 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:15.392783 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:15.504351 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:15.504331 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:15.830689 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:15.830659 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:16.437340 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:16.437299 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" event={"ID":"06b10a38-580d-4b48-9a1f-aa7a73bf2109","Type":"ContainerStarted","Data":"80d278f82882a7daa11b4eeb6151c1c1534999a2837b4134819b55abd9ba94ae"} Jun 09 12:35:16.437494 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:16.437355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" event={"ID":"06b10a38-580d-4b48-9a1f-aa7a73bf2109","Type":"ContainerStarted","Data":"fe7d347c9e6af76daff55e525b87833f1f14dc76ab8e87e5dc529fb07218d198"} Jun 09 12:35:16.472463 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:16.472415 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zls84" podStartSLOduration=17.52532471 podStartE2EDuration="19.472400226s" totalImagesPullingTime="1.947075516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:16.471813157 +0000 UTC m=+214.169300089" watchObservedRunningTime="2026-06-09 12:35:16.472400226 +0000 UTC m=+214.169887179" Jun 09 12:35:16.608394 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:16.608369 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:16.839892 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:16.839863 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:17.041356 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:17.041322 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:17.268864 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:17.268835 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:18.450887 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:18.450858 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:20.825039 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:20.825008 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:20.910899 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:20.910834 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:21.775195 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:21.775168 2564 scope.go:117] "RemoveContainer" containerID="d0af22acff796821eecf8993e92059a3d86564b66e8d99c5e2a452eda0c2f492" Jun 09 12:35:22.455813 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:22.455788 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/2.log" Jun 09 12:35:22.456202 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:22.456185 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/1.log" Jun 09 12:35:22.456244 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:22.456219 2564 generic.go:356] "Generic (PLEG): container finished" podID="7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68" containerID="dd3c844e04cf54f9bf7902738fa7f37227f8f4ad424a1edc90493d5a2e28df82" exitCode=255 Jun 09 12:35:22.456274 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:22.456261 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" event={"ID":"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68","Type":"ContainerDied","Data":"dd3c844e04cf54f9bf7902738fa7f37227f8f4ad424a1edc90493d5a2e28df82"} Jun 09 12:35:22.456314 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:22.456304 2564 scope.go:117] "RemoveContainer" containerID="d0af22acff796821eecf8993e92059a3d86564b66e8d99c5e2a452eda0c2f492" Jun 09 12:35:22.456611 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:22.456589 2564 scope.go:117] "RemoveContainer" containerID="dd3c844e04cf54f9bf7902738fa7f37227f8f4ad424a1edc90493d5a2e28df82" Jun 09 12:35:22.456792 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:22.456772 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-gldp6_openshift-console-operator(7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68)\"" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" podUID="7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68" Jun 09 12:35:23.461055 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:23.461028 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/2.log" Jun 09 12:35:24.771152 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:24.771121 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:24.866568 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:24.866540 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:27.658218 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:27.658176 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:35:27.658614 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:27.658237 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:35:27.658614 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:27.658499 2564 scope.go:117] "RemoveContainer" containerID="dd3c844e04cf54f9bf7902738fa7f37227f8f4ad424a1edc90493d5a2e28df82" Jun 09 12:35:27.658707 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:27.658660 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-gldp6_openshift-console-operator(7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68)\"" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" podUID="7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68" Jun 09 12:35:28.778851 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.778826 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bz7m6"] Jun 09 12:35:28.782631 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.782609 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.784883 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.784861 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 12:35:28.785350 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.785332 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 12:35:28.785410 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.785355 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 12:35:28.785472 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.785457 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2pflr\"" Jun 09 12:35:28.788006 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.787991 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 12:35:28.803540 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.803518 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bz7m6"] Jun 09 12:35:28.809701 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.809667 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7948fc977c-qjhgz"] Jun 09 12:35:28.813928 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.813907 2564 patch_prober.go:28] interesting pod/image-registry-7948fc977c-qjhgz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 12:35:28.814008 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.813951 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" podUID="a3d19277-5428-4b35-8e21-8b0d561e7ad1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:35:28.854683 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.854662 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75df887df-n6q27"] Jun 09 12:35:28.857306 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.857293 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:28.873903 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.873883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-data-volume\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.874003 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.873911 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbd8s\" (UniqueName: \"kubernetes.io/projected/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-kube-api-access-xbd8s\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.874003 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.873932 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.874003 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.873967 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.874003 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.873986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-crio-socket\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.877195 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.877175 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:28.880112 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.880084 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75df887df-n6q27"] Jun 09 12:35:28.975348 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-registry-certificates\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:28.975348 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975305 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-registry-tls\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:28.975348 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-image-registry-private-configuration\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:28.975348 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975344 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5cs4\" (UniqueName: \"kubernetes.io/projected/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-kube-api-access-t5cs4\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:28.975584 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-installation-pull-secrets\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:28.975584 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975462 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-data-volume\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.975584 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975480 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-ca-trust-extracted\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:28.975584 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975500 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbd8s\" (UniqueName: \"kubernetes.io/projected/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-kube-api-access-xbd8s\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.975740 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975589 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.975740 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.975740 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975628 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-crio-socket\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.975740 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-trusted-ca\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:28.975740 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-bound-sa-token\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:28.975740 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975731 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-crio-socket\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.976009 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.975811 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-data-volume\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.976128 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.976111 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.977963 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.977941 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:28.997543 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:28.997515 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbd8s\" (UniqueName: \"kubernetes.io/projected/b80db2bd-1e4e-4ed1-a710-4635c2ffcab3-kube-api-access-xbd8s\") pod \"insights-runtime-extractor-bz7m6\" (UID: \"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3\") " pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:29.076748 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.076727 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-ca-trust-extracted\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.076830 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.076772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-trusted-ca\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.076830 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.076787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-bound-sa-token\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.076830 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.076809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-registry-certificates\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.076830 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.076824 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-registry-tls\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.077088 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.076846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-image-registry-private-configuration\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.077088 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.076870 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5cs4\" (UniqueName: \"kubernetes.io/projected/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-kube-api-access-t5cs4\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.077088 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.076897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-installation-pull-secrets\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.077304 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.077138 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-ca-trust-extracted\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.077731 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.077707 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-registry-certificates\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.077808 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.077720 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-trusted-ca\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.079147 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.079122 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-registry-tls\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.079241 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.079225 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-installation-pull-secrets\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.079327 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.079312 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-image-registry-private-configuration\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.091216 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.091199 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bz7m6" Jun 09 12:35:29.113387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.113361 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-bound-sa-token\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.117000 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.116979 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5cs4\" (UniqueName: \"kubernetes.io/projected/9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4-kube-api-access-t5cs4\") pod \"image-registry-75df887df-n6q27\" (UID: \"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4\") " pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.165739 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.165710 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.170868 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.170814 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:29.291064 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.291007 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bz7m6"] Jun 09 12:35:29.295034 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:35:29.295007 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80db2bd_1e4e_4ed1_a710_4635c2ffcab3.slice/crio-6475d60384ef5e0a7c21f23a0df95c1fd987210a9805d1866ae87176ac48e842 WatchSource:0}: Error finding container 6475d60384ef5e0a7c21f23a0df95c1fd987210a9805d1866ae87176ac48e842: Status 404 returned error can't find the container with id 6475d60384ef5e0a7c21f23a0df95c1fd987210a9805d1866ae87176ac48e842 Jun 09 12:35:29.321311 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.321289 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75df887df-n6q27"] Jun 09 12:35:29.324453 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:35:29.324426 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b470b27_7a1f_4f1f_bbfb_e3e3554ce4a4.slice/crio-ca9b4115392458757a4702938f9ecf280676b1c413ae923bea055e9c3464e4f1 WatchSource:0}: Error finding container ca9b4115392458757a4702938f9ecf280676b1c413ae923bea055e9c3464e4f1: Status 404 returned error can't find the container with id ca9b4115392458757a4702938f9ecf280676b1c413ae923bea055e9c3464e4f1 Jun 09 12:35:29.482211 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.482179 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75df887df-n6q27" event={"ID":"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4","Type":"ContainerStarted","Data":"bcf90aeac5679b552ea292c47c029f14cc9564cf2acc271d74ae1791787416c4"} Jun 09 12:35:29.482393 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.482227 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75df887df-n6q27" event={"ID":"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4","Type":"ContainerStarted","Data":"ca9b4115392458757a4702938f9ecf280676b1c413ae923bea055e9c3464e4f1"} Jun 09 12:35:29.482393 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.482331 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:35:29.483856 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.483835 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bz7m6" event={"ID":"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3","Type":"ContainerStarted","Data":"1f048dcfb2e0dc93867b941b07d92a7034a736cab2efc00386c0327d7fc2b497"} Jun 09 12:35:29.483943 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.483880 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bz7m6" event={"ID":"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3","Type":"ContainerStarted","Data":"6475d60384ef5e0a7c21f23a0df95c1fd987210a9805d1866ae87176ac48e842"} Jun 09 12:35:29.504859 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:29.504774 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75df887df-n6q27" podStartSLOduration=1.5047589000000001 podStartE2EDuration="1.5047589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:35:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:29.504137315 +0000 UTC m=+227.201624243" watchObservedRunningTime="2026-06-09 12:35:29.5047589 +0000 UTC m=+227.202245828" Jun 09 12:35:30.488783 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:30.488750 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bz7m6" event={"ID":"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3","Type":"ContainerStarted","Data":"48a8e3432522ddf3db309198e3913893de3b887dd5a7089a2e61c646829aa503"} Jun 09 12:35:31.866971 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:31.866941 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:31.965779 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:31.965750 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:32.497764 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:32.497733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bz7m6" event={"ID":"b80db2bd-1e4e-4ed1-a710-4635c2ffcab3","Type":"ContainerStarted","Data":"263bfd306b09651a08642c666b2fb0390f01c07fcb2b5006d6ca90a6855165c1"} Jun 09 12:35:32.525808 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:32.525762 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bz7m6" podStartSLOduration=2.229283996 podStartE2EDuration="4.525748445s" totalImagesPullingTime="2.296464449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:35:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:32.524846801 +0000 UTC m=+230.222333741" watchObservedRunningTime="2026-06-09 12:35:32.525748445 +0000 UTC m=+230.223235405" Jun 09 12:35:32.734924 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:32.734862 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:32.921659 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:32.921584 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:33.404322 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:33.404291 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:36.993776 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:36.993742 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:37.088268 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:37.088237 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:37.427920 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:37.427817 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:38.813757 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:38.813724 2564 patch_prober.go:28] interesting pod/image-registry-7948fc977c-qjhgz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 12:35:38.814107 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:38.813768 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" podUID="a3d19277-5428-4b35-8e21-8b0d561e7ad1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:35:39.689350 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:39.689304 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:40.775268 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:40.775235 2564 scope.go:117] "RemoveContainer" containerID="dd3c844e04cf54f9bf7902738fa7f37227f8f4ad424a1edc90493d5a2e28df82" Jun 09 12:35:40.775675 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:40.775387 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-gldp6_openshift-console-operator(7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68)\"" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" podUID="7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68" Jun 09 12:35:41.196814 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.196785 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:41.403548 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.403482 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:41.520958 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.520885 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8msz8"] Jun 09 12:35:41.524128 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.524103 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:41.525695 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.525673 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.527965 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.527936 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 12:35:41.528289 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.528273 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f9plm\"" Jun 09 12:35:41.528719 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.528703 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 12:35:41.528932 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.528918 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 12:35:41.529049 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.529033 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 12:35:41.530470 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.530452 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 12:35:41.530572 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.530524 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 12:35:41.571258 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.571241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11514555-5302-437a-83e1-ac5d5e126faf-sys\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.571345 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.571276 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11514555-5302-437a-83e1-ac5d5e126faf-metrics-client-ca\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.571345 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.571293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.571345 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.571309 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pq6g\" (UniqueName: \"kubernetes.io/projected/11514555-5302-437a-83e1-ac5d5e126faf-kube-api-access-6pq6g\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.571450 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.571384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-accelerators-collector-config\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.571450 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.571432 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-wtmp\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.571512 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.571461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-tls\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.571512 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.571479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11514555-5302-437a-83e1-ac5d5e126faf-root\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.571512 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.571499 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-textfile\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.672352 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.672325 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-accelerators-collector-config\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.672474 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.672359 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-wtmp\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.672474 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.672385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-tls\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.672474 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.672409 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11514555-5302-437a-83e1-ac5d5e126faf-root\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.672474 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.672470 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11514555-5302-437a-83e1-ac5d5e126faf-root\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.672705 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.672502 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-textfile\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.672705 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.672525 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-wtmp\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.672705 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.672587 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11514555-5302-437a-83e1-ac5d5e126faf-sys\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.672705 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.672624 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11514555-5302-437a-83e1-ac5d5e126faf-metrics-client-ca\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.672839 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.672643 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.672959 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.672926 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11514555-5302-437a-83e1-ac5d5e126faf-sys\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.673036 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.673016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pq6g\" (UniqueName: \"kubernetes.io/projected/11514555-5302-437a-83e1-ac5d5e126faf-kube-api-access-6pq6g\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.673133 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.673106 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-textfile\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.674590 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.673493 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-accelerators-collector-config\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.674590 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.673832 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11514555-5302-437a-83e1-ac5d5e126faf-metrics-client-ca\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.677585 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.675998 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.678410 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.678391 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11514555-5302-437a-83e1-ac5d5e126faf-node-exporter-tls\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.686382 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.686332 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pq6g\" (UniqueName: \"kubernetes.io/projected/11514555-5302-437a-83e1-ac5d5e126faf-kube-api-access-6pq6g\") pod \"node-exporter-8msz8\" (UID: \"11514555-5302-437a-83e1-ac5d5e126faf\") " pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.686461 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.686393 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:41.835140 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.835072 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8msz8" Jun 09 12:35:41.845750 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:35:41.845721 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11514555_5302_437a_83e1_ac5d5e126faf.slice/crio-0534f4cb43fb5110de2334cbc89755fbc1acaff23866ea8c433a591d1941d2af WatchSource:0}: Error finding container 0534f4cb43fb5110de2334cbc89755fbc1acaff23866ea8c433a591d1941d2af: Status 404 returned error can't find the container with id 0534f4cb43fb5110de2334cbc89755fbc1acaff23866ea8c433a591d1941d2af Jun 09 12:35:41.900546 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:41.900481 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:42.308408 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:42.308376 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:42.467930 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:42.467896 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:42.532761 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:42.532727 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8msz8" event={"ID":"11514555-5302-437a-83e1-ac5d5e126faf","Type":"ContainerStarted","Data":"0534f4cb43fb5110de2334cbc89755fbc1acaff23866ea8c433a591d1941d2af"} Jun 09 12:35:42.578709 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:42.578642 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:42.969839 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:42.969805 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:43.537469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:43.537435 2564 generic.go:356] "Generic (PLEG): container finished" podID="11514555-5302-437a-83e1-ac5d5e126faf" containerID="5f52fc03648b0f6074eeca6d883487fb7c8ba6d587528182f5e1f1ba9f6724a1" exitCode=0 Jun 09 12:35:43.537643 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:43.537521 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8msz8" event={"ID":"11514555-5302-437a-83e1-ac5d5e126faf","Type":"ContainerDied","Data":"5f52fc03648b0f6074eeca6d883487fb7c8ba6d587528182f5e1f1ba9f6724a1"} Jun 09 12:35:44.158165 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:44.158134 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:44.258312 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:44.258280 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:44.498422 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:44.498391 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:44.542725 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:44.542694 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8msz8" event={"ID":"11514555-5302-437a-83e1-ac5d5e126faf","Type":"ContainerStarted","Data":"a1ef82f383fa7252233915e5b6785a4c97c9dc66ebd438ad2f61373971bc40f1"} Jun 09 12:35:44.542849 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:44.542739 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8msz8" event={"ID":"11514555-5302-437a-83e1-ac5d5e126faf","Type":"ContainerStarted","Data":"9659696c0a93bce93fda35a86187ffb154d50ff2b774f3a17e76bbcfa29a8764"} Jun 09 12:35:44.560911 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:44.560871 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8msz8" podStartSLOduration=2.679037993 podStartE2EDuration="3.560858065s" totalImagesPullingTime="818.638464ms" totalInitContainerRuntime="63.181608ms" isStatefulPod=true podCreationTimestamp="2026-06-09 12:35:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:44.560132143 +0000 UTC m=+242.257619064" watchObservedRunningTime="2026-06-09 12:35:44.560858065 +0000 UTC m=+242.258344994" Jun 09 12:35:44.562491 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:44.562472 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:44.632820 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:44.632802 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:44.746479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:44.746451 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:45.970807 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:45.970771 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:46.053096 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:46.053061 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:46.199638 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:46.199608 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:46.595888 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:46.595860 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:47.897183 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:47.897146 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:48.813831 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:48.813802 2564 patch_prober.go:28] interesting pod/image-registry-7948fc977c-qjhgz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 12:35:48.813993 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:48.813844 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" podUID="a3d19277-5428-4b35-8e21-8b0d561e7ad1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:35:49.170243 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:49.170169 2564 patch_prober.go:28] interesting pod/image-registry-75df887df-n6q27 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 12:35:49.170243 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:49.170215 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75df887df-n6q27" podUID="9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:35:50.493376 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:50.493345 2564 patch_prober.go:28] interesting pod/image-registry-75df887df-n6q27 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 12:35:50.493792 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:50.493389 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75df887df-n6q27" podUID="9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:35:52.775816 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:52.775780 2564 scope.go:117] "RemoveContainer" containerID="dd3c844e04cf54f9bf7902738fa7f37227f8f4ad424a1edc90493d5a2e28df82" Jun 09 12:35:53.572057 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.572031 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/2.log" Jun 09 12:35:53.572257 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.572113 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" event={"ID":"7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68","Type":"ContainerStarted","Data":"58df21dfc4d35e4ca7fced018c0330c2c4afb24f41f7376a48d425f7243d87a9"} Jun 09 12:35:53.572386 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.572366 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:35:53.597193 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.597135 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" podStartSLOduration=54.127878134 podStartE2EDuration="56.597100254s" totalImagesPullingTime="2.46922212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:53.596415776 +0000 UTC m=+251.293902708" watchObservedRunningTime="2026-06-09 12:35:53.597100254 +0000 UTC m=+251.294587178" Jun 09 12:35:53.622328 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.622304 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-gldp6" Jun 09 12:35:53.817602 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.817551 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-dfqlb"] Jun 09 12:35:53.820591 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.820553 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-dfqlb" Jun 09 12:35:53.826996 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.826943 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-25czp\"" Jun 09 12:35:53.826996 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.826950 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 12:35:53.828615 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.828584 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" podUID="a3d19277-5428-4b35-8e21-8b0d561e7ad1" containerName="registry" containerID="cri-o://75256b741a67927caa4f64a90aac9bdf84450e9baeac8e8731e9d0c2014d18ec" gracePeriod=30 Jun 09 12:35:53.830120 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.830101 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 12:35:53.836227 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.836201 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-dfqlb"] Jun 09 12:35:53.863478 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.863456 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84rxk\" (UniqueName: \"kubernetes.io/projected/5fec9619-45d9-4202-b140-d4cccf7392d8-kube-api-access-84rxk\") pod \"downloads-6657875f97-dfqlb\" (UID: \"5fec9619-45d9-4202-b140-d4cccf7392d8\") " pod="openshift-console/downloads-6657875f97-dfqlb" Jun 09 12:35:53.882243 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.882220 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:53.963884 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.963856 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84rxk\" (UniqueName: \"kubernetes.io/projected/5fec9619-45d9-4202-b140-d4cccf7392d8-kube-api-access-84rxk\") pod \"downloads-6657875f97-dfqlb\" (UID: \"5fec9619-45d9-4202-b140-d4cccf7392d8\") " pod="openshift-console/downloads-6657875f97-dfqlb" Jun 09 12:35:53.985157 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:53.985131 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84rxk\" (UniqueName: \"kubernetes.io/projected/5fec9619-45d9-4202-b140-d4cccf7392d8-kube-api-access-84rxk\") pod \"downloads-6657875f97-dfqlb\" (UID: \"5fec9619-45d9-4202-b140-d4cccf7392d8\") " pod="openshift-console/downloads-6657875f97-dfqlb" Jun 09 12:35:54.006269 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.006242 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:54.063404 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.063379 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:35:54.129452 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.129383 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-dfqlb" Jun 09 12:35:54.166463 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.166432 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3d19277-5428-4b35-8e21-8b0d561e7ad1-image-registry-private-configuration\") pod \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " Jun 09 12:35:54.166653 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.166471 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls\") pod \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " Jun 09 12:35:54.166653 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.166500 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3d19277-5428-4b35-8e21-8b0d561e7ad1-installation-pull-secrets\") pod \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " Jun 09 12:35:54.166653 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.166622 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz5vt\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-kube-api-access-bz5vt\") pod \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " Jun 09 12:35:54.166823 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.166675 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-bound-sa-token\") pod \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " Jun 09 12:35:54.166823 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.166785 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3d19277-5428-4b35-8e21-8b0d561e7ad1-ca-trust-extracted\") pod \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " Jun 09 12:35:54.166938 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.166837 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-certificates\") pod \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " Jun 09 12:35:54.166938 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.166908 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3d19277-5428-4b35-8e21-8b0d561e7ad1-trusted-ca\") pod \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\" (UID: \"a3d19277-5428-4b35-8e21-8b0d561e7ad1\") " Jun 09 12:35:54.167450 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.167389 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a3d19277-5428-4b35-8e21-8b0d561e7ad1" (UID: "a3d19277-5428-4b35-8e21-8b0d561e7ad1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:35:54.167595 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.167544 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3d19277-5428-4b35-8e21-8b0d561e7ad1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a3d19277-5428-4b35-8e21-8b0d561e7ad1" (UID: "a3d19277-5428-4b35-8e21-8b0d561e7ad1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:35:54.169124 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.169097 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a3d19277-5428-4b35-8e21-8b0d561e7ad1" (UID: "a3d19277-5428-4b35-8e21-8b0d561e7ad1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:35:54.169246 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.169122 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3d19277-5428-4b35-8e21-8b0d561e7ad1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a3d19277-5428-4b35-8e21-8b0d561e7ad1" (UID: "a3d19277-5428-4b35-8e21-8b0d561e7ad1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:35:54.169246 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.169211 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3d19277-5428-4b35-8e21-8b0d561e7ad1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a3d19277-5428-4b35-8e21-8b0d561e7ad1" (UID: "a3d19277-5428-4b35-8e21-8b0d561e7ad1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:35:54.169358 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.169340 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-kube-api-access-bz5vt" (OuterVolumeSpecName: "kube-api-access-bz5vt") pod "a3d19277-5428-4b35-8e21-8b0d561e7ad1" (UID: "a3d19277-5428-4b35-8e21-8b0d561e7ad1"). InnerVolumeSpecName "kube-api-access-bz5vt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:35:54.169675 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.169660 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a3d19277-5428-4b35-8e21-8b0d561e7ad1" (UID: "a3d19277-5428-4b35-8e21-8b0d561e7ad1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:35:54.175473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.175440 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3d19277-5428-4b35-8e21-8b0d561e7ad1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a3d19277-5428-4b35-8e21-8b0d561e7ad1" (UID: "a3d19277-5428-4b35-8e21-8b0d561e7ad1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:35:54.208979 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.208945 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:54.263105 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.263073 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-dfqlb"] Jun 09 12:35:54.265676 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:35:54.265653 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fec9619_45d9_4202_b140_d4cccf7392d8.slice/crio-fd955b3b53249959b4100759d163b7ffe51cb1d078ee8978dc7d705e10c77be3 WatchSource:0}: Error finding container fd955b3b53249959b4100759d163b7ffe51cb1d078ee8978dc7d705e10c77be3: Status 404 returned error can't find the container with id fd955b3b53249959b4100759d163b7ffe51cb1d078ee8978dc7d705e10c77be3 Jun 09 12:35:54.267712 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.267688 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a3d19277-5428-4b35-8e21-8b0d561e7ad1-trusted-ca\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:35:54.267825 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.267718 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a3d19277-5428-4b35-8e21-8b0d561e7ad1-image-registry-private-configuration\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:35:54.267825 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.267733 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-tls\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:35:54.267825 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.267747 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a3d19277-5428-4b35-8e21-8b0d561e7ad1-installation-pull-secrets\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:35:54.267825 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.267769 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz5vt\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-kube-api-access-bz5vt\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:35:54.267825 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.267781 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3d19277-5428-4b35-8e21-8b0d561e7ad1-bound-sa-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:35:54.267825 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.267789 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a3d19277-5428-4b35-8e21-8b0d561e7ad1-ca-trust-extracted\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:35:54.267825 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.267797 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a3d19277-5428-4b35-8e21-8b0d561e7ad1-registry-certificates\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:35:54.308676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.308646 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:54.430810 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.430737 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:54.526088 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.526057 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:54.576440 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.576415 2564 generic.go:356] "Generic (PLEG): container finished" podID="a3d19277-5428-4b35-8e21-8b0d561e7ad1" containerID="75256b741a67927caa4f64a90aac9bdf84450e9baeac8e8731e9d0c2014d18ec" exitCode=0 Jun 09 12:35:54.576612 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.576458 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" Jun 09 12:35:54.576612 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.576485 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" event={"ID":"a3d19277-5428-4b35-8e21-8b0d561e7ad1","Type":"ContainerDied","Data":"75256b741a67927caa4f64a90aac9bdf84450e9baeac8e8731e9d0c2014d18ec"} Jun 09 12:35:54.576612 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.576527 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7948fc977c-qjhgz" event={"ID":"a3d19277-5428-4b35-8e21-8b0d561e7ad1","Type":"ContainerDied","Data":"d65f7ee953df154325f19f6520d681442236c97acb6f541a16f0e8104668a90d"} Jun 09 12:35:54.576612 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.576542 2564 scope.go:117] "RemoveContainer" containerID="75256b741a67927caa4f64a90aac9bdf84450e9baeac8e8731e9d0c2014d18ec" Jun 09 12:35:54.577687 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.577658 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-dfqlb" event={"ID":"5fec9619-45d9-4202-b140-d4cccf7392d8","Type":"ContainerStarted","Data":"fd955b3b53249959b4100759d163b7ffe51cb1d078ee8978dc7d705e10c77be3"} Jun 09 12:35:54.584408 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.584395 2564 scope.go:117] "RemoveContainer" containerID="75256b741a67927caa4f64a90aac9bdf84450e9baeac8e8731e9d0c2014d18ec" Jun 09 12:35:54.584702 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:35:54.584672 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75256b741a67927caa4f64a90aac9bdf84450e9baeac8e8731e9d0c2014d18ec\": container with ID starting with 75256b741a67927caa4f64a90aac9bdf84450e9baeac8e8731e9d0c2014d18ec not found: ID does not exist" containerID="75256b741a67927caa4f64a90aac9bdf84450e9baeac8e8731e9d0c2014d18ec" Jun 09 12:35:54.584797 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.584709 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75256b741a67927caa4f64a90aac9bdf84450e9baeac8e8731e9d0c2014d18ec"} err="failed to get container status \"75256b741a67927caa4f64a90aac9bdf84450e9baeac8e8731e9d0c2014d18ec\": rpc error: code = NotFound desc = could not find container \"75256b741a67927caa4f64a90aac9bdf84450e9baeac8e8731e9d0c2014d18ec\": container with ID starting with 75256b741a67927caa4f64a90aac9bdf84450e9baeac8e8731e9d0c2014d18ec not found: ID does not exist" Jun 09 12:35:54.601056 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.601036 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7948fc977c-qjhgz"] Jun 09 12:35:54.609653 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.609634 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7948fc977c-qjhgz"] Jun 09 12:35:54.671605 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.671576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:35:54.673715 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.673696 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/731e3c8f-34be-4caa-bc70-fba5d3fa2b08-metrics-certs\") pod \"network-metrics-daemon-m7szl\" (UID: \"731e3c8f-34be-4caa-bc70-fba5d3fa2b08\") " pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:35:54.776802 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.776771 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4k8hn\"" Jun 09 12:35:54.784487 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.784427 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3d19277-5428-4b35-8e21-8b0d561e7ad1" path="/var/lib/kubelet/pods/a3d19277-5428-4b35-8e21-8b0d561e7ad1/volumes" Jun 09 12:35:54.784663 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.784617 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7szl" Jun 09 12:35:54.876660 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.876630 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:54.931997 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.931963 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m7szl"] Jun 09 12:35:54.936409 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:35:54.936380 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod731e3c8f_34be_4caa_bc70_fba5d3fa2b08.slice/crio-97c0cabcb9531fd38cda712c161edbf7cb8f9422f3086d7ee9b2e29abada05f0 WatchSource:0}: Error finding container 97c0cabcb9531fd38cda712c161edbf7cb8f9422f3086d7ee9b2e29abada05f0: Status 404 returned error can't find the container with id 97c0cabcb9531fd38cda712c161edbf7cb8f9422f3086d7ee9b2e29abada05f0 Jun 09 12:35:54.969848 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:54.969816 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:55.583696 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:55.583659 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m7szl" event={"ID":"731e3c8f-34be-4caa-bc70-fba5d3fa2b08","Type":"ContainerStarted","Data":"97c0cabcb9531fd38cda712c161edbf7cb8f9422f3086d7ee9b2e29abada05f0"} Jun 09 12:35:55.703430 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:55.703399 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:55.898400 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:55.898278 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:55.999855 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:55.999822 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:56.376539 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:56.376504 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:56.497163 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:56.497128 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:56.589366 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:56.589328 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m7szl" event={"ID":"731e3c8f-34be-4caa-bc70-fba5d3fa2b08","Type":"ContainerStarted","Data":"0e0687433b0eb97bcf3cb357f96973e50e36df16fc6954fb5aea0ef650c3df13"} Jun 09 12:35:56.589543 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:56.589395 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m7szl" event={"ID":"731e3c8f-34be-4caa-bc70-fba5d3fa2b08","Type":"ContainerStarted","Data":"7004efa5a5e46c83192e62a1c94557f421659f7f9cb90c4353c15d4b97c0e0d7"} Jun 09 12:35:56.611417 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:56.611361 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m7szl" podStartSLOduration=253.528619685 podStartE2EDuration="4m14.611337913s" totalImagesPullingTime="1.082718228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:35:56.608266725 +0000 UTC m=+254.305753656" watchObservedRunningTime="2026-06-09 12:35:56.611337913 +0000 UTC m=+254.308824843" Jun 09 12:35:56.654495 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:56.654456 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:56.756065 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:56.755983 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:56.834632 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:56.834584 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:57.074981 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:57.074898 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:57.168648 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:57.168619 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:35:59.171026 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:59.170995 2564 patch_prober.go:28] interesting pod/image-registry-75df887df-n6q27 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 12:35:59.171378 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:35:59.171048 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75df887df-n6q27" podUID="9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:36:00.493848 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:00.493803 2564 patch_prober.go:28] interesting pod/image-registry-75df887df-n6q27 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 12:36:00.494260 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:00.493861 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75df887df-n6q27" podUID="9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:36:03.538357 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.538324 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-594d549f8d-q5qpx"] Jun 09 12:36:03.538899 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.538641 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3d19277-5428-4b35-8e21-8b0d561e7ad1" containerName="registry" Jun 09 12:36:03.538899 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.538658 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3d19277-5428-4b35-8e21-8b0d561e7ad1" containerName="registry" Jun 09 12:36:03.538899 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.538744 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3d19277-5428-4b35-8e21-8b0d561e7ad1" containerName="registry" Jun 09 12:36:03.542709 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.542681 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.546207 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.546008 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2z4t2\"" Jun 09 12:36:03.546207 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.546023 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 12:36:03.546207 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.546009 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 12:36:03.546207 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.546095 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 12:36:03.546207 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.546011 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 12:36:03.546547 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.546249 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 12:36:03.552917 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.552865 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-594d549f8d-q5qpx"] Jun 09 12:36:03.640745 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.640710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-oauth-config\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.640933 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.640773 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-service-ca\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.640933 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.640796 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-config\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.640933 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.640815 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-serving-cert\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.640933 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.640835 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-oauth-serving-cert\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.640933 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.640875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb6jv\" (UniqueName: \"kubernetes.io/projected/0bb1b815-a256-42a7-8d4b-b8d185f021e5-kube-api-access-xb6jv\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.741670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.741634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-oauth-config\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.741833 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.741682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-service-ca\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.741833 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.741709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-config\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.741833 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.741807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-serving-cert\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.741947 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.741844 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-oauth-serving-cert\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.741947 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.741861 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb6jv\" (UniqueName: \"kubernetes.io/projected/0bb1b815-a256-42a7-8d4b-b8d185f021e5-kube-api-access-xb6jv\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.742411 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.742381 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-config\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.742526 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.742473 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-oauth-serving-cert\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.742526 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.742515 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-service-ca\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.744153 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.744133 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-oauth-config\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.744253 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.744241 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-serving-cert\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.749986 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.749966 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb6jv\" (UniqueName: \"kubernetes.io/projected/0bb1b815-a256-42a7-8d4b-b8d185f021e5-kube-api-access-xb6jv\") pod \"console-594d549f8d-q5qpx\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.854452 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.854362 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:03.993630 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:03.993603 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-594d549f8d-q5qpx"] Jun 09 12:36:03.996878 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:36:03.996840 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb1b815_a256_42a7_8d4b_b8d185f021e5.slice/crio-a481ba35e6cd1d17b75e3c32de3ebe1538472ae1dd1a55ab926f7db5a3db52d7 WatchSource:0}: Error finding container a481ba35e6cd1d17b75e3c32de3ebe1538472ae1dd1a55ab926f7db5a3db52d7: Status 404 returned error can't find the container with id a481ba35e6cd1d17b75e3c32de3ebe1538472ae1dd1a55ab926f7db5a3db52d7 Jun 09 12:36:04.619336 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:04.619266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594d549f8d-q5qpx" event={"ID":"0bb1b815-a256-42a7-8d4b-b8d185f021e5","Type":"ContainerStarted","Data":"a481ba35e6cd1d17b75e3c32de3ebe1538472ae1dd1a55ab926f7db5a3db52d7"} Jun 09 12:36:08.520086 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:08.520053 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:09.170777 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:09.170741 2564 patch_prober.go:28] interesting pod/image-registry-75df887df-n6q27 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 12:36:09.170960 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:09.170806 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75df887df-n6q27" podUID="9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:36:09.170960 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:09.170854 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:36:09.171354 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:09.171331 2564 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"bcf90aeac5679b552ea292c47c029f14cc9564cf2acc271d74ae1791787416c4"} pod="openshift-image-registry/image-registry-75df887df-n6q27" containerMessage="Container registry failed liveness probe, will be restarted" Jun 09 12:36:09.175676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:09.175649 2564 patch_prober.go:28] interesting pod/image-registry-75df887df-n6q27 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 12:36:09.175797 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:09.175694 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75df887df-n6q27" podUID="9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:36:09.636054 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:09.636009 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:09.757932 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:09.757902 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:09.820150 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:09.820115 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:12.145015 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.144979 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-657748b57f-vj67k"] Jun 09 12:36:12.148468 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.148445 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.159881 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.159858 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 12:36:12.162899 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.162878 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657748b57f-vj67k"] Jun 09 12:36:12.216123 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.216086 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-service-ca\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.216286 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.216129 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5ks5\" (UniqueName: \"kubernetes.io/projected/1bded00d-97c6-4b3a-8224-9906b425402e-kube-api-access-w5ks5\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.216286 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.216156 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-oauth-serving-cert\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.216286 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.216240 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bded00d-97c6-4b3a-8224-9906b425402e-console-oauth-config\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.216419 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.216295 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bded00d-97c6-4b3a-8224-9906b425402e-console-serving-cert\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.216419 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.216347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-console-config\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.216419 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.216369 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-trusted-ca-bundle\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.317378 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.317346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bded00d-97c6-4b3a-8224-9906b425402e-console-serving-cert\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.317785 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.317401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-console-config\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.317785 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.317520 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-trusted-ca-bundle\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.317785 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.317631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-service-ca\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.317785 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.317665 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5ks5\" (UniqueName: \"kubernetes.io/projected/1bded00d-97c6-4b3a-8224-9906b425402e-kube-api-access-w5ks5\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.317785 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.317703 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-oauth-serving-cert\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.317785 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.317744 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bded00d-97c6-4b3a-8224-9906b425402e-console-oauth-config\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.318226 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.318205 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-console-config\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.318463 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.318435 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-trusted-ca-bundle\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.318786 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.318763 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-service-ca\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.318786 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.318780 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-oauth-serving-cert\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.320256 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.320235 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bded00d-97c6-4b3a-8224-9906b425402e-console-serving-cert\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.320463 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.320446 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bded00d-97c6-4b3a-8224-9906b425402e-console-oauth-config\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.326939 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.326921 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5ks5\" (UniqueName: \"kubernetes.io/projected/1bded00d-97c6-4b3a-8224-9906b425402e-kube-api-access-w5ks5\") pod \"console-657748b57f-vj67k\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:12.330455 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.330433 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:12.399870 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.399741 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:12.458933 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:12.458895 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:14.246520 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:14.246409 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657748b57f-vj67k"] Jun 09 12:36:14.248927 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:36:14.248901 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bded00d_97c6_4b3a_8224_9906b425402e.slice/crio-383b6bcbf38365542c1c3fb83bcd5e7354408092ed4891e23e11234e52571c72 WatchSource:0}: Error finding container 383b6bcbf38365542c1c3fb83bcd5e7354408092ed4891e23e11234e52571c72: Status 404 returned error can't find the container with id 383b6bcbf38365542c1c3fb83bcd5e7354408092ed4891e23e11234e52571c72 Jun 09 12:36:14.659643 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:14.659600 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594d549f8d-q5qpx" event={"ID":"0bb1b815-a256-42a7-8d4b-b8d185f021e5","Type":"ContainerStarted","Data":"f005e755d94b0f337c5bf6803ff3597bdc6aba35c20a73c4a95b0b08c1f80273"} Jun 09 12:36:14.661739 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:14.661348 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-dfqlb" event={"ID":"5fec9619-45d9-4202-b140-d4cccf7392d8","Type":"ContainerStarted","Data":"03428c3e0d208fc3de0655fe18913aed2b97d8b883ab3cbd2f1b205acc35af3d"} Jun 09 12:36:14.661739 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:14.661399 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-dfqlb" Jun 09 12:36:14.663364 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:14.663239 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657748b57f-vj67k" event={"ID":"1bded00d-97c6-4b3a-8224-9906b425402e","Type":"ContainerStarted","Data":"11f118701c5aa91a58aa6351711f8b6548e99969c69b71981e19bccf0d9a9528"} Jun 09 12:36:14.663364 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:14.663283 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657748b57f-vj67k" event={"ID":"1bded00d-97c6-4b3a-8224-9906b425402e","Type":"ContainerStarted","Data":"383b6bcbf38365542c1c3fb83bcd5e7354408092ed4891e23e11234e52571c72"} Jun 09 12:36:14.677082 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:14.677058 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-dfqlb" Jun 09 12:36:14.682872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:14.682818 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-594d549f8d-q5qpx" podStartSLOduration=1.5721337979999999 podStartE2EDuration="11.682800833s" totalImagesPullingTime="10.110667035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:36:14.681878286 +0000 UTC m=+272.379365215" watchObservedRunningTime="2026-06-09 12:36:14.682800833 +0000 UTC m=+272.380287762" Jun 09 12:36:14.698796 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:14.698740 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-dfqlb" podStartSLOduration=1.8231422080000002 podStartE2EDuration="21.698718603s" totalImagesPullingTime="19.875576395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:35:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:36:14.698467682 +0000 UTC m=+272.395954632" watchObservedRunningTime="2026-06-09 12:36:14.698718603 +0000 UTC m=+272.396205547" Jun 09 12:36:14.718275 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:14.718214 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-657748b57f-vj67k" podStartSLOduration=2.7181937659999997 podStartE2EDuration="2.718193766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:36:14.717943475 +0000 UTC m=+272.415430428" watchObservedRunningTime="2026-06-09 12:36:14.718193766 +0000 UTC m=+272.415680696" Jun 09 12:36:18.206199 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:18.206155 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:18.292766 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:18.292711 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:19.176343 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:19.176304 2564 patch_prober.go:28] interesting pod/image-registry-75df887df-n6q27 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 12:36:19.176519 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:19.176362 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75df887df-n6q27" podUID="9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:36:21.493019 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:21.492986 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:21.557620 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:21.557581 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:22.459101 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:22.459058 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:22.459293 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:22.459131 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:22.460640 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:22.460613 2564 patch_prober.go:28] interesting pod/console-657748b57f-vj67k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 09 12:36:22.460756 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:22.460663 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-657748b57f-vj67k" podUID="1bded00d-97c6-4b3a-8224-9906b425402e" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 09 12:36:23.263180 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:36:23.263137 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w7l97" podUID="75004378-a4fe-48db-9825-2d3cf54da59a" Jun 09 12:36:23.699742 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:23.699714 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w7l97" Jun 09 12:36:23.854835 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:23.854800 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:23.855007 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:23.854941 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:36:23.856133 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:23.856103 2564 patch_prober.go:28] interesting pod/console-594d549f8d-q5qpx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 09 12:36:23.856502 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:23.856145 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-594d549f8d-q5qpx" podUID="0bb1b815-a256-42a7-8d4b-b8d185f021e5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 09 12:36:27.046763 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:27.046726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:36:27.048933 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:27.048914 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75004378-a4fe-48db-9825-2d3cf54da59a-metrics-tls\") pod \"dns-default-w7l97\" (UID: \"75004378-a4fe-48db-9825-2d3cf54da59a\") " pod="openshift-dns/dns-default-w7l97" Jun 09 12:36:27.302190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:27.302117 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b8l29\"" Jun 09 12:36:27.310682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:27.310666 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w7l97" Jun 09 12:36:27.477223 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:27.477196 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w7l97"] Jun 09 12:36:27.480300 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:36:27.480272 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75004378_a4fe_48db_9825_2d3cf54da59a.slice/crio-6f97346da279ffe0787d55fd86cfe529a796317327042534a36d558b0dcfc4f2 WatchSource:0}: Error finding container 6f97346da279ffe0787d55fd86cfe529a796317327042534a36d558b0dcfc4f2: Status 404 returned error can't find the container with id 6f97346da279ffe0787d55fd86cfe529a796317327042534a36d558b0dcfc4f2 Jun 09 12:36:27.714322 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:27.714292 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w7l97" event={"ID":"75004378-a4fe-48db-9825-2d3cf54da59a","Type":"ContainerStarted","Data":"6f97346da279ffe0787d55fd86cfe529a796317327042534a36d558b0dcfc4f2"} Jun 09 12:36:29.176100 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:29.176067 2564 patch_prober.go:28] interesting pod/image-registry-75df887df-n6q27 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 12:36:29.176590 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:29.176115 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-75df887df-n6q27" podUID="9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:36:30.725213 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:30.725178 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w7l97" event={"ID":"75004378-a4fe-48db-9825-2d3cf54da59a","Type":"ContainerStarted","Data":"3f86cc64b96475ec4c48f80fde8a9def8358dca3fdc236b8323d268aaa7526f2"} Jun 09 12:36:30.725761 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:30.725268 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w7l97" event={"ID":"75004378-a4fe-48db-9825-2d3cf54da59a","Type":"ContainerStarted","Data":"30fd64bfa768c6544f84356b9dfd45d30a57a4aef2facc23dd56757f47a1e092"} Jun 09 12:36:30.725761 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:30.725311 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w7l97" Jun 09 12:36:30.746753 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:30.746708 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w7l97" podStartSLOduration=251.525405751 podStartE2EDuration="4m13.746692194s" totalImagesPullingTime="2.221286443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:36:30.74595934 +0000 UTC m=+288.443446271" watchObservedRunningTime="2026-06-09 12:36:30.746692194 +0000 UTC m=+288.444179123" Jun 09 12:36:31.027686 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:31.027607 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:32.459353 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:32.459321 2564 patch_prober.go:28] interesting pod/console-657748b57f-vj67k container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 09 12:36:32.459833 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:32.459373 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-657748b57f-vj67k" podUID="1bded00d-97c6-4b3a-8224-9906b425402e" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 09 12:36:33.195733 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:33.195707 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8msz8_11514555-5302-437a-83e1-ac5d5e126faf/init-textfile/0.log" Jun 09 12:36:33.396413 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:33.396383 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8msz8_11514555-5302-437a-83e1-ac5d5e126faf/node-exporter/0.log" Jun 09 12:36:33.599002 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:33.598973 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8msz8_11514555-5302-437a-83e1-ac5d5e126faf/kube-rbac-proxy/0.log" Jun 09 12:36:33.854957 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:33.854883 2564 patch_prober.go:28] interesting pod/console-594d549f8d-q5qpx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 09 12:36:33.854957 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:33.854928 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-594d549f8d-q5qpx" podUID="0bb1b815-a256-42a7-8d4b-b8d185f021e5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 09 12:36:34.192384 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:34.192291 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-75df887df-n6q27" podUID="9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4" containerName="registry" containerID="cri-o://bcf90aeac5679b552ea292c47c029f14cc9564cf2acc271d74ae1791787416c4" gracePeriod=30 Jun 09 12:36:35.744302 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:35.744267 2564 generic.go:356] "Generic (PLEG): container finished" podID="9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4" containerID="bcf90aeac5679b552ea292c47c029f14cc9564cf2acc271d74ae1791787416c4" exitCode=0 Jun 09 12:36:35.744788 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:35.744343 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75df887df-n6q27" event={"ID":"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4","Type":"ContainerDied","Data":"bcf90aeac5679b552ea292c47c029f14cc9564cf2acc271d74ae1791787416c4"} Jun 09 12:36:35.744788 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:35.744438 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75df887df-n6q27" event={"ID":"9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4","Type":"ContainerStarted","Data":"d990d96f2c117d3d4af6d2b0b0a9e8b81b38eea748a1f20f0b5801548bf4c99c"} Jun 09 12:36:35.744788 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:35.744711 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:36:37.753321 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:37.753293 2564 generic.go:356] "Generic (PLEG): container finished" podID="f3920251-511e-4176-b31e-2f9f479ed9a6" containerID="485ef0e9c6107f90eff10e6dd336f60004a2bb0b0ad6a2c35dde7d99bd7dd70a" exitCode=255 Jun 09 12:36:37.753758 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:37.753344 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" event={"ID":"f3920251-511e-4176-b31e-2f9f479ed9a6","Type":"ContainerDied","Data":"485ef0e9c6107f90eff10e6dd336f60004a2bb0b0ad6a2c35dde7d99bd7dd70a"} Jun 09 12:36:37.753758 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:37.753379 2564 scope.go:117] "RemoveContainer" containerID="9b3fde99406ed21a03f99ec999a744ef8cc4cb55935882ce7ffd6b7da1566a72" Jun 09 12:36:37.759418 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:37.759397 2564 scope.go:117] "RemoveContainer" containerID="485ef0e9c6107f90eff10e6dd336f60004a2bb0b0ad6a2c35dde7d99bd7dd70a" Jun 09 12:36:37.759594 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:36:37.759575 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5_open-cluster-management-agent-addon(f3920251-511e-4176-b31e-2f9f479ed9a6)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" podUID="f3920251-511e-4176-b31e-2f9f479ed9a6" Jun 09 12:36:38.402417 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:38.402387 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/2.log" Jun 09 12:36:38.597966 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:38.597937 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/3.log" Jun 09 12:36:38.796884 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:38.796853 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-594d549f8d-q5qpx_0bb1b815-a256-42a7-8d4b-b8d185f021e5/console/0.log" Jun 09 12:36:38.807284 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:38.807264 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:38.904714 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:38.904684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:38.997620 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:38.997589 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-657748b57f-vj67k_1bded00d-97c6-4b3a-8224-9906b425402e/console/0.log" Jun 09 12:36:39.197353 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:39.197329 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-dfqlb_5fec9619-45d9-4202-b140-d4cccf7392d8/download-server/0.log" Jun 09 12:36:39.309170 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:39.309133 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:39.382619 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:39.382591 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:40.119815 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:40.119784 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:40.196265 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:40.196241 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w7l97_75004378-a4fe-48db-9825-2d3cf54da59a/dns/0.log" Jun 09 12:36:40.220750 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:40.220726 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:40.395532 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:40.395457 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w7l97_75004378-a4fe-48db-9825-2d3cf54da59a/kube-rbac-proxy/0.log" Jun 09 12:36:40.599512 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:40.599488 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fcwvm_cf20c681-6757-49db-ac7a-3070a1d69d4c/dns-node-resolver/0.log" Jun 09 12:36:40.704240 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:40.704212 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:40.731228 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:40.731202 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w7l97" Jun 09 12:36:40.805417 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:40.805387 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:41.396018 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:41.395993 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75df887df-n6q27_9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4/registry/1.log" Jun 09 12:36:41.795986 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:41.795958 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qlfnh_fed43365-44f8-4220-87ec-327acf7f874f/node-ca/0.log" Jun 09 12:36:42.197715 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.197682 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-98d765c7f-2fw6t_0bd6da96-28ea-47a0-b935-b389c8d132d8/router/0.log" Jun 09 12:36:42.253999 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.253971 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" Jun 09 12:36:42.254335 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.254310 2564 scope.go:117] "RemoveContainer" containerID="485ef0e9c6107f90eff10e6dd336f60004a2bb0b0ad6a2c35dde7d99bd7dd70a" Jun 09 12:36:42.254471 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:36:42.254453 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5_open-cluster-management-agent-addon(f3920251-511e-4176-b31e-2f9f479ed9a6)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" podUID="f3920251-511e-4176-b31e-2f9f479ed9a6" Jun 09 12:36:42.396120 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.396092 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8q6ht_fc101d88-babb-4b12-a41c-5054275e8682/serve-healthcheck-canary/0.log" Jun 09 12:36:42.463442 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.463369 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:42.467451 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.467428 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:36:42.531822 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.531786 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-594d549f8d-q5qpx"] Jun 09 12:36:42.675527 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.675493 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:42.717881 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.717857 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/2.log" Jun 09 12:36:42.718029 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.717981 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/2.log" Jun 09 12:36:42.723542 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.723524 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgb8g_593b1faa-5b02-4e90-b05c-d3b4724e8de9/ovn-acl-logging/0.log" Jun 09 12:36:42.723888 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.723873 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgb8g_593b1faa-5b02-4e90-b05c-d3b4724e8de9/ovn-acl-logging/0.log" Jun 09 12:36:42.728878 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.728862 2564 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 12:36:42.746594 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.746538 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:42.853337 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:42.853189 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:43.127157 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:43.008701 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:43.127157 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:43.109098 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:47.073412 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:47.073379 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:47.287011 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:47.286975 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:47.381410 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:47.381335 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:47.919245 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:47.919214 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:48.016535 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:48.016499 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:48.830607 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:48.830550 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:49.736977 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:49.736943 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:49.838609 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:49.838574 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:54.758830 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:54.758800 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:54.859799 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:54.859769 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:56.752851 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:56.752822 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75df887df-n6q27" Jun 09 12:36:56.780783 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:56.780759 2564 scope.go:117] "RemoveContainer" containerID="485ef0e9c6107f90eff10e6dd336f60004a2bb0b0ad6a2c35dde7d99bd7dd70a" Jun 09 12:36:56.910756 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:56.910723 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:56.972241 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:56.972212 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:57.032751 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:57.032652 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:57.107245 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:57.107200 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:36:57.836483 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:36:57.836448 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b5788fcfb-qg7c5" event={"ID":"f3920251-511e-4176-b31e-2f9f479ed9a6","Type":"ContainerStarted","Data":"989ccf1bd615d97c71e19c4a7caec87fcc75b22651a51296c58fa499fafde3c6"} Jun 09 12:37:00.857609 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:00.857581 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:37:01.166315 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:01.166229 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:37:07.552237 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.552185 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-594d549f8d-q5qpx" podUID="0bb1b815-a256-42a7-8d4b-b8d185f021e5" containerName="console" containerID="cri-o://f005e755d94b0f337c5bf6803ff3597bdc6aba35c20a73c4a95b0b08c1f80273" gracePeriod=15 Jun 09 12:37:07.783964 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.783943 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:37:07.863609 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.863518 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-config\") pod \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " Jun 09 12:37:07.863609 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.863549 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-serving-cert\") pod \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " Jun 09 12:37:07.863609 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.863605 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb6jv\" (UniqueName: \"kubernetes.io/projected/0bb1b815-a256-42a7-8d4b-b8d185f021e5-kube-api-access-xb6jv\") pod \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " Jun 09 12:37:07.863872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.863674 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-service-ca\") pod \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " Jun 09 12:37:07.863872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.863690 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-oauth-serving-cert\") pod \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " Jun 09 12:37:07.863872 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.863717 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-oauth-config\") pod \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\" (UID: \"0bb1b815-a256-42a7-8d4b-b8d185f021e5\") " Jun 09 12:37:07.864035 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.864012 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-service-ca" (OuterVolumeSpecName: "service-ca") pod "0bb1b815-a256-42a7-8d4b-b8d185f021e5" (UID: "0bb1b815-a256-42a7-8d4b-b8d185f021e5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:07.864083 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.864023 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-config" (OuterVolumeSpecName: "console-config") pod "0bb1b815-a256-42a7-8d4b-b8d185f021e5" (UID: "0bb1b815-a256-42a7-8d4b-b8d185f021e5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:07.864142 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.864086 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0bb1b815-a256-42a7-8d4b-b8d185f021e5" (UID: "0bb1b815-a256-42a7-8d4b-b8d185f021e5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:07.865816 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.865793 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0bb1b815-a256-42a7-8d4b-b8d185f021e5" (UID: "0bb1b815-a256-42a7-8d4b-b8d185f021e5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:07.865922 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.865833 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bb1b815-a256-42a7-8d4b-b8d185f021e5-kube-api-access-xb6jv" (OuterVolumeSpecName: "kube-api-access-xb6jv") pod "0bb1b815-a256-42a7-8d4b-b8d185f021e5" (UID: "0bb1b815-a256-42a7-8d4b-b8d185f021e5"). InnerVolumeSpecName "kube-api-access-xb6jv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:37:07.865922 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.865888 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0bb1b815-a256-42a7-8d4b-b8d185f021e5" (UID: "0bb1b815-a256-42a7-8d4b-b8d185f021e5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:07.870689 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.870638 2564 generic.go:356] "Generic (PLEG): container finished" podID="0bb1b815-a256-42a7-8d4b-b8d185f021e5" containerID="f005e755d94b0f337c5bf6803ff3597bdc6aba35c20a73c4a95b0b08c1f80273" exitCode=0 Jun 09 12:37:07.870804 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.870687 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594d549f8d-q5qpx" Jun 09 12:37:07.870804 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.870702 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594d549f8d-q5qpx" event={"ID":"0bb1b815-a256-42a7-8d4b-b8d185f021e5","Type":"ContainerDied","Data":"f005e755d94b0f337c5bf6803ff3597bdc6aba35c20a73c4a95b0b08c1f80273"} Jun 09 12:37:07.870804 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.870765 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594d549f8d-q5qpx" event={"ID":"0bb1b815-a256-42a7-8d4b-b8d185f021e5","Type":"ContainerDied","Data":"a481ba35e6cd1d17b75e3c32de3ebe1538472ae1dd1a55ab926f7db5a3db52d7"} Jun 09 12:37:07.870948 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.870795 2564 scope.go:117] "RemoveContainer" containerID="f005e755d94b0f337c5bf6803ff3597bdc6aba35c20a73c4a95b0b08c1f80273" Jun 09 12:37:07.879724 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.879708 2564 scope.go:117] "RemoveContainer" containerID="f005e755d94b0f337c5bf6803ff3597bdc6aba35c20a73c4a95b0b08c1f80273" Jun 09 12:37:07.879964 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:37:07.879944 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f005e755d94b0f337c5bf6803ff3597bdc6aba35c20a73c4a95b0b08c1f80273\": container with ID starting with f005e755d94b0f337c5bf6803ff3597bdc6aba35c20a73c4a95b0b08c1f80273 not found: ID does not exist" containerID="f005e755d94b0f337c5bf6803ff3597bdc6aba35c20a73c4a95b0b08c1f80273" Jun 09 12:37:07.880010 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.879974 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f005e755d94b0f337c5bf6803ff3597bdc6aba35c20a73c4a95b0b08c1f80273"} err="failed to get container status \"f005e755d94b0f337c5bf6803ff3597bdc6aba35c20a73c4a95b0b08c1f80273\": rpc error: code = NotFound desc = could not find container \"f005e755d94b0f337c5bf6803ff3597bdc6aba35c20a73c4a95b0b08c1f80273\": container with ID starting with f005e755d94b0f337c5bf6803ff3597bdc6aba35c20a73c4a95b0b08c1f80273 not found: ID does not exist" Jun 09 12:37:07.894812 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.894786 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-594d549f8d-q5qpx"] Jun 09 12:37:07.896909 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.896889 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-594d549f8d-q5qpx"] Jun 09 12:37:07.964858 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.964832 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-service-ca\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.964858 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.964853 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-oauth-serving-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.964978 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.964863 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-oauth-config\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.964978 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.964872 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-config\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.964978 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.964882 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bb1b815-a256-42a7-8d4b-b8d185f021e5-console-serving-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:37:07.964978 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:07.964891 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb6jv\" (UniqueName: \"kubernetes.io/projected/0bb1b815-a256-42a7-8d4b-b8d185f021e5-kube-api-access-xb6jv\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:37:08.779543 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:08.779510 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bb1b815-a256-42a7-8d4b-b8d185f021e5" path="/var/lib/kubelet/pods/0bb1b815-a256-42a7-8d4b-b8d185f021e5/volumes" Jun 09 12:37:10.112235 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.112206 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bdbcf7db-g268x"] Jun 09 12:37:10.112631 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.112499 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bb1b815-a256-42a7-8d4b-b8d185f021e5" containerName="console" Jun 09 12:37:10.112631 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.112510 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bb1b815-a256-42a7-8d4b-b8d185f021e5" containerName="console" Jun 09 12:37:10.112631 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.112582 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bb1b815-a256-42a7-8d4b-b8d185f021e5" containerName="console" Jun 09 12:37:10.115372 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.115353 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.127249 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.127225 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bdbcf7db-g268x"] Jun 09 12:37:10.169665 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.169632 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:37:10.180592 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.180547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-service-ca\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.180727 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.180603 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-oauth-config\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.180727 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.180629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-serving-cert\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.180727 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.180673 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-trusted-ca-bundle\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.180727 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.180689 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf8fx\" (UniqueName: \"kubernetes.io/projected/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-kube-api-access-pf8fx\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.180727 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.180708 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-oauth-serving-cert\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.180727 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.180723 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-config\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.269206 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.269179 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:37:10.281474 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.281446 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-oauth-config\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.281586 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.281484 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-serving-cert\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.281586 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.281518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-trusted-ca-bundle\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.281586 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.281539 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf8fx\" (UniqueName: \"kubernetes.io/projected/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-kube-api-access-pf8fx\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.281586 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.281580 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-oauth-serving-cert\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.281798 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.281606 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-config\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.281798 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.281664 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-service-ca\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.282382 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.282358 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-oauth-serving-cert\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.282474 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.282395 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-service-ca\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.282474 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.282458 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-config\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.282545 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.282499 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-trusted-ca-bundle\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.284042 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.284018 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-serving-cert\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.284118 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.284100 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-oauth-config\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.289742 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.289723 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf8fx\" (UniqueName: \"kubernetes.io/projected/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-kube-api-access-pf8fx\") pod \"console-5bdbcf7db-g268x\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.424819 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.424748 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:10.547420 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.547385 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bdbcf7db-g268x"] Jun 09 12:37:10.550432 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:37:10.550409 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0929efe2_e3d5_435d_9f40_c6c8921d5d9d.slice/crio-e3e11a432a4f4365d315a53f792e61b9f035058bfb1efff3fbdbe95febc88b2e WatchSource:0}: Error finding container e3e11a432a4f4365d315a53f792e61b9f035058bfb1efff3fbdbe95febc88b2e: Status 404 returned error can't find the container with id e3e11a432a4f4365d315a53f792e61b9f035058bfb1efff3fbdbe95febc88b2e Jun 09 12:37:10.884118 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.884089 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bdbcf7db-g268x" event={"ID":"0929efe2-e3d5-435d-9f40-c6c8921d5d9d","Type":"ContainerStarted","Data":"ce86287e5e0d98c1eae5679b42e571483e6af9be2332e9acb6399444f8be9851"} Jun 09 12:37:10.884289 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.884137 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bdbcf7db-g268x" event={"ID":"0929efe2-e3d5-435d-9f40-c6c8921d5d9d","Type":"ContainerStarted","Data":"e3e11a432a4f4365d315a53f792e61b9f035058bfb1efff3fbdbe95febc88b2e"} Jun 09 12:37:10.906519 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:10.906474 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bdbcf7db-g268x" podStartSLOduration=0.906458923 podStartE2EDuration="906.458923ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:37:10.905055853 +0000 UTC m=+328.602542782" watchObservedRunningTime="2026-06-09 12:37:10.906458923 +0000 UTC m=+328.603945851" Jun 09 12:37:20.425342 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:20.425298 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:20.425794 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:20.425362 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:20.429998 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:20.429974 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:20.923010 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:20.922983 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:37:20.972469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:20.972440 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657748b57f-vj67k"] Jun 09 12:37:21.080908 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:21.080872 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:37:21.182406 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:21.182336 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:37:21.282359 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:21.282336 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:37:45.995296 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:45.995256 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-657748b57f-vj67k" podUID="1bded00d-97c6-4b3a-8224-9906b425402e" containerName="console" containerID="cri-o://11f118701c5aa91a58aa6351711f8b6548e99969c69b71981e19bccf0d9a9528" gracePeriod=15 Jun 09 12:37:46.242271 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.242244 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:37:46.345132 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.345062 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5ks5\" (UniqueName: \"kubernetes.io/projected/1bded00d-97c6-4b3a-8224-9906b425402e-kube-api-access-w5ks5\") pod \"1bded00d-97c6-4b3a-8224-9906b425402e\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " Jun 09 12:37:46.345132 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.345098 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bded00d-97c6-4b3a-8224-9906b425402e-console-oauth-config\") pod \"1bded00d-97c6-4b3a-8224-9906b425402e\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " Jun 09 12:37:46.345132 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.345125 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-trusted-ca-bundle\") pod \"1bded00d-97c6-4b3a-8224-9906b425402e\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " Jun 09 12:37:46.345386 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.345156 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-oauth-serving-cert\") pod \"1bded00d-97c6-4b3a-8224-9906b425402e\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " Jun 09 12:37:46.345386 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.345172 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bded00d-97c6-4b3a-8224-9906b425402e-console-serving-cert\") pod \"1bded00d-97c6-4b3a-8224-9906b425402e\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " Jun 09 12:37:46.345386 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.345206 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-service-ca\") pod \"1bded00d-97c6-4b3a-8224-9906b425402e\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " Jun 09 12:37:46.345386 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.345220 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-console-config\") pod \"1bded00d-97c6-4b3a-8224-9906b425402e\" (UID: \"1bded00d-97c6-4b3a-8224-9906b425402e\") " Jun 09 12:37:46.345628 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.345589 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1bded00d-97c6-4b3a-8224-9906b425402e" (UID: "1bded00d-97c6-4b3a-8224-9906b425402e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:46.345702 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.345629 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-service-ca" (OuterVolumeSpecName: "service-ca") pod "1bded00d-97c6-4b3a-8224-9906b425402e" (UID: "1bded00d-97c6-4b3a-8224-9906b425402e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:46.345702 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.345649 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1bded00d-97c6-4b3a-8224-9906b425402e" (UID: "1bded00d-97c6-4b3a-8224-9906b425402e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:46.345771 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.345715 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-console-config" (OuterVolumeSpecName: "console-config") pod "1bded00d-97c6-4b3a-8224-9906b425402e" (UID: "1bded00d-97c6-4b3a-8224-9906b425402e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:37:46.347266 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.347246 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bded00d-97c6-4b3a-8224-9906b425402e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1bded00d-97c6-4b3a-8224-9906b425402e" (UID: "1bded00d-97c6-4b3a-8224-9906b425402e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:46.347738 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.347712 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bded00d-97c6-4b3a-8224-9906b425402e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1bded00d-97c6-4b3a-8224-9906b425402e" (UID: "1bded00d-97c6-4b3a-8224-9906b425402e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:37:46.347793 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.347722 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bded00d-97c6-4b3a-8224-9906b425402e-kube-api-access-w5ks5" (OuterVolumeSpecName: "kube-api-access-w5ks5") pod "1bded00d-97c6-4b3a-8224-9906b425402e" (UID: "1bded00d-97c6-4b3a-8224-9906b425402e"). InnerVolumeSpecName "kube-api-access-w5ks5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:37:46.445888 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.445865 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5ks5\" (UniqueName: \"kubernetes.io/projected/1bded00d-97c6-4b3a-8224-9906b425402e-kube-api-access-w5ks5\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:37:46.445888 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.445887 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bded00d-97c6-4b3a-8224-9906b425402e-console-oauth-config\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:37:46.446035 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.445897 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-trusted-ca-bundle\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:37:46.446035 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.445907 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-oauth-serving-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:37:46.446035 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.445915 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bded00d-97c6-4b3a-8224-9906b425402e-console-serving-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:37:46.446035 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.445923 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-service-ca\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:37:46.446035 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:46.445930 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bded00d-97c6-4b3a-8224-9906b425402e-console-config\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:37:47.007211 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:47.007172 2564 generic.go:356] "Generic (PLEG): container finished" podID="1bded00d-97c6-4b3a-8224-9906b425402e" containerID="11f118701c5aa91a58aa6351711f8b6548e99969c69b71981e19bccf0d9a9528" exitCode=0 Jun 09 12:37:47.007658 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:47.007220 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657748b57f-vj67k" Jun 09 12:37:47.007658 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:47.007262 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657748b57f-vj67k" event={"ID":"1bded00d-97c6-4b3a-8224-9906b425402e","Type":"ContainerDied","Data":"11f118701c5aa91a58aa6351711f8b6548e99969c69b71981e19bccf0d9a9528"} Jun 09 12:37:47.007658 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:47.007324 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657748b57f-vj67k" event={"ID":"1bded00d-97c6-4b3a-8224-9906b425402e","Type":"ContainerDied","Data":"383b6bcbf38365542c1c3fb83bcd5e7354408092ed4891e23e11234e52571c72"} Jun 09 12:37:47.007658 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:47.007372 2564 scope.go:117] "RemoveContainer" containerID="11f118701c5aa91a58aa6351711f8b6548e99969c69b71981e19bccf0d9a9528" Jun 09 12:37:47.015277 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:47.015261 2564 scope.go:117] "RemoveContainer" containerID="11f118701c5aa91a58aa6351711f8b6548e99969c69b71981e19bccf0d9a9528" Jun 09 12:37:47.015539 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:37:47.015519 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11f118701c5aa91a58aa6351711f8b6548e99969c69b71981e19bccf0d9a9528\": container with ID starting with 11f118701c5aa91a58aa6351711f8b6548e99969c69b71981e19bccf0d9a9528 not found: ID does not exist" containerID="11f118701c5aa91a58aa6351711f8b6548e99969c69b71981e19bccf0d9a9528" Jun 09 12:37:47.015603 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:47.015548 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11f118701c5aa91a58aa6351711f8b6548e99969c69b71981e19bccf0d9a9528"} err="failed to get container status \"11f118701c5aa91a58aa6351711f8b6548e99969c69b71981e19bccf0d9a9528\": rpc error: code = NotFound desc = could not find container \"11f118701c5aa91a58aa6351711f8b6548e99969c69b71981e19bccf0d9a9528\": container with ID starting with 11f118701c5aa91a58aa6351711f8b6548e99969c69b71981e19bccf0d9a9528 not found: ID does not exist" Jun 09 12:37:47.026205 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:47.026183 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657748b57f-vj67k"] Jun 09 12:37:47.038038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:47.037989 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-657748b57f-vj67k"] Jun 09 12:37:48.779025 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:48.778990 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bded00d-97c6-4b3a-8224-9906b425402e" path="/var/lib/kubelet/pods/1bded00d-97c6-4b3a-8224-9906b425402e/volumes" Jun 09 12:37:58.044778 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:58.044743 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:37:58.102836 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:37:58.102807 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:16.152879 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:16.152847 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:16.216900 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:16.216868 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:23.670396 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:23.670366 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:28.086723 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:28.086648 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:28.188244 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:28.188215 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:39.777891 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:39.777833 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:39.876435 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:39.876400 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:40.106506 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:40.106425 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:51.571211 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.571174 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75d4497bfd-f2nq4"] Jun 09 12:38:51.571758 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.571417 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bded00d-97c6-4b3a-8224-9906b425402e" containerName="console" Jun 09 12:38:51.571758 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.571429 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bded00d-97c6-4b3a-8224-9906b425402e" containerName="console" Jun 09 12:38:51.571758 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.571482 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bded00d-97c6-4b3a-8224-9906b425402e" containerName="console" Jun 09 12:38:51.573989 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.573960 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.586545 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.586518 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d4497bfd-f2nq4"] Jun 09 12:38:51.633484 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.633461 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:51.694285 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.694258 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:51.717323 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.717299 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-service-ca\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.717451 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.717328 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-config\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.717451 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.717358 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5pw7\" (UniqueName: \"kubernetes.io/projected/e7ec3002-494d-4aee-817a-9727de4ef5c7-kube-api-access-v5pw7\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.717451 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.717397 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-oauth-config\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.717451 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.717426 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-serving-cert\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.717451 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.717444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-trusted-ca-bundle\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.717656 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.717476 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-oauth-serving-cert\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.755671 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.755642 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:51.818158 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.818129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5pw7\" (UniqueName: \"kubernetes.io/projected/e7ec3002-494d-4aee-817a-9727de4ef5c7-kube-api-access-v5pw7\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.818261 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.818166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-oauth-config\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.818261 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.818184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-serving-cert\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.818261 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.818203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-trusted-ca-bundle\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.818261 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.818235 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-oauth-serving-cert\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.818469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.818276 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-service-ca\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.818469 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.818302 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-config\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.819098 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.819074 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-config\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.819215 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.819117 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-oauth-serving-cert\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.819271 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.819236 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-service-ca\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.819271 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.819255 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-trusted-ca-bundle\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.820639 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.820610 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-serving-cert\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.820754 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.820734 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-oauth-config\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.827371 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.827316 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5pw7\" (UniqueName: \"kubernetes.io/projected/e7ec3002-494d-4aee-817a-9727de4ef5c7-kube-api-access-v5pw7\") pod \"console-75d4497bfd-f2nq4\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:51.883180 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:51.883143 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:38:52.010106 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:52.010077 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d4497bfd-f2nq4"] Jun 09 12:38:52.013357 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:38:52.013330 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ec3002_494d_4aee_817a_9727de4ef5c7.slice/crio-8b4e386433ebc7636d969d262fe10de1b1953a367e0f262faa9f72c86a9df1b1 WatchSource:0}: Error finding container 8b4e386433ebc7636d969d262fe10de1b1953a367e0f262faa9f72c86a9df1b1: Status 404 returned error can't find the container with id 8b4e386433ebc7636d969d262fe10de1b1953a367e0f262faa9f72c86a9df1b1 Jun 09 12:38:52.232983 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:52.232949 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d4497bfd-f2nq4" event={"ID":"e7ec3002-494d-4aee-817a-9727de4ef5c7","Type":"ContainerStarted","Data":"d0bdeecb342c761e8b41ee976ca7af26ca005c6e3e9d362af4860e5f06e493c5"} Jun 09 12:38:52.233143 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:52.232999 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d4497bfd-f2nq4" event={"ID":"e7ec3002-494d-4aee-817a-9727de4ef5c7","Type":"ContainerStarted","Data":"8b4e386433ebc7636d969d262fe10de1b1953a367e0f262faa9f72c86a9df1b1"} Jun 09 12:38:52.251386 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:52.251341 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75d4497bfd-f2nq4" podStartSLOduration=1.251327071 podStartE2EDuration="1.251327071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:38:52.250011519 +0000 UTC m=+429.947498447" watchObservedRunningTime="2026-06-09 12:38:52.251327071 +0000 UTC m=+429.948814000" Jun 09 12:38:52.355209 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:52.355127 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:52.456624 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:52.456594 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:54.514625 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:54.514533 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:38:54.574651 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:38:54.574621 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:39:01.884259 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:01.884208 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:39:01.884659 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:01.884291 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:39:01.889186 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:01.889164 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:39:02.279004 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:02.278973 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:39:02.326882 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:02.326849 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bdbcf7db-g268x"] Jun 09 12:39:02.436468 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:02.436438 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:39:02.499701 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:02.499665 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:39:02.557091 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:02.557025 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:39:24.287283 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:24.287249 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:39:24.374717 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:24.374684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:39:27.349815 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.349749 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5bdbcf7db-g268x" podUID="0929efe2-e3d5-435d-9f40-c6c8921d5d9d" containerName="console" containerID="cri-o://ce86287e5e0d98c1eae5679b42e571483e6af9be2332e9acb6399444f8be9851" gracePeriod=15 Jun 09 12:39:27.582084 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.582061 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:39:27.683144 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.683053 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf8fx\" (UniqueName: \"kubernetes.io/projected/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-kube-api-access-pf8fx\") pod \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " Jun 09 12:39:27.683144 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.683094 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-serving-cert\") pod \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " Jun 09 12:39:27.683144 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.683121 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-oauth-serving-cert\") pod \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " Jun 09 12:39:27.683404 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.683164 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-service-ca\") pod \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " Jun 09 12:39:27.683404 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.683238 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-oauth-config\") pod \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " Jun 09 12:39:27.683404 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.683262 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-trusted-ca-bundle\") pod \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " Jun 09 12:39:27.683404 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.683287 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-config\") pod \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\" (UID: \"0929efe2-e3d5-435d-9f40-c6c8921d5d9d\") " Jun 09 12:39:27.683622 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.683596 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0929efe2-e3d5-435d-9f40-c6c8921d5d9d" (UID: "0929efe2-e3d5-435d-9f40-c6c8921d5d9d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:39:27.683684 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.683603 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-service-ca" (OuterVolumeSpecName: "service-ca") pod "0929efe2-e3d5-435d-9f40-c6c8921d5d9d" (UID: "0929efe2-e3d5-435d-9f40-c6c8921d5d9d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:39:27.683811 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.683767 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0929efe2-e3d5-435d-9f40-c6c8921d5d9d" (UID: "0929efe2-e3d5-435d-9f40-c6c8921d5d9d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:39:27.683941 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.683834 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-config" (OuterVolumeSpecName: "console-config") pod "0929efe2-e3d5-435d-9f40-c6c8921d5d9d" (UID: "0929efe2-e3d5-435d-9f40-c6c8921d5d9d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:39:27.685318 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.685292 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-kube-api-access-pf8fx" (OuterVolumeSpecName: "kube-api-access-pf8fx") pod "0929efe2-e3d5-435d-9f40-c6c8921d5d9d" (UID: "0929efe2-e3d5-435d-9f40-c6c8921d5d9d"). InnerVolumeSpecName "kube-api-access-pf8fx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:39:27.685405 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.685319 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0929efe2-e3d5-435d-9f40-c6c8921d5d9d" (UID: "0929efe2-e3d5-435d-9f40-c6c8921d5d9d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:39:27.685405 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.685371 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0929efe2-e3d5-435d-9f40-c6c8921d5d9d" (UID: "0929efe2-e3d5-435d-9f40-c6c8921d5d9d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:39:27.784004 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.783960 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-service-ca\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:39:27.784004 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.783998 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-oauth-config\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:39:27.784004 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.784008 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-trusted-ca-bundle\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:39:27.784004 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.784017 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-config\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:39:27.784259 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.784027 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pf8fx\" (UniqueName: \"kubernetes.io/projected/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-kube-api-access-pf8fx\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:39:27.784259 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.784037 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-console-serving-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:39:27.784259 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:27.784045 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0929efe2-e3d5-435d-9f40-c6c8921d5d9d-oauth-serving-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:39:28.363927 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:28.363896 2564 generic.go:356] "Generic (PLEG): container finished" podID="0929efe2-e3d5-435d-9f40-c6c8921d5d9d" containerID="ce86287e5e0d98c1eae5679b42e571483e6af9be2332e9acb6399444f8be9851" exitCode=0 Jun 09 12:39:28.364352 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:28.363939 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bdbcf7db-g268x" Jun 09 12:39:28.364352 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:28.363972 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bdbcf7db-g268x" event={"ID":"0929efe2-e3d5-435d-9f40-c6c8921d5d9d","Type":"ContainerDied","Data":"ce86287e5e0d98c1eae5679b42e571483e6af9be2332e9acb6399444f8be9851"} Jun 09 12:39:28.364352 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:28.364017 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bdbcf7db-g268x" event={"ID":"0929efe2-e3d5-435d-9f40-c6c8921d5d9d","Type":"ContainerDied","Data":"e3e11a432a4f4365d315a53f792e61b9f035058bfb1efff3fbdbe95febc88b2e"} Jun 09 12:39:28.364352 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:28.364036 2564 scope.go:117] "RemoveContainer" containerID="ce86287e5e0d98c1eae5679b42e571483e6af9be2332e9acb6399444f8be9851" Jun 09 12:39:28.374250 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:28.373940 2564 scope.go:117] "RemoveContainer" containerID="ce86287e5e0d98c1eae5679b42e571483e6af9be2332e9acb6399444f8be9851" Jun 09 12:39:28.374327 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:39:28.374257 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce86287e5e0d98c1eae5679b42e571483e6af9be2332e9acb6399444f8be9851\": container with ID starting with ce86287e5e0d98c1eae5679b42e571483e6af9be2332e9acb6399444f8be9851 not found: ID does not exist" containerID="ce86287e5e0d98c1eae5679b42e571483e6af9be2332e9acb6399444f8be9851" Jun 09 12:39:28.374327 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:28.374290 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce86287e5e0d98c1eae5679b42e571483e6af9be2332e9acb6399444f8be9851"} err="failed to get container status \"ce86287e5e0d98c1eae5679b42e571483e6af9be2332e9acb6399444f8be9851\": rpc error: code = NotFound desc = could not find container \"ce86287e5e0d98c1eae5679b42e571483e6af9be2332e9acb6399444f8be9851\": container with ID starting with ce86287e5e0d98c1eae5679b42e571483e6af9be2332e9acb6399444f8be9851 not found: ID does not exist" Jun 09 12:39:28.385832 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:28.385809 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bdbcf7db-g268x"] Jun 09 12:39:28.389789 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:28.389769 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bdbcf7db-g268x"] Jun 09 12:39:28.778534 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:28.778499 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0929efe2-e3d5-435d-9f40-c6c8921d5d9d" path="/var/lib/kubelet/pods/0929efe2-e3d5-435d-9f40-c6c8921d5d9d/volumes" Jun 09 12:39:38.466897 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.466858 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x"] Jun 09 12:39:38.467353 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.467246 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0929efe2-e3d5-435d-9f40-c6c8921d5d9d" containerName="console" Jun 09 12:39:38.467353 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.467263 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0929efe2-e3d5-435d-9f40-c6c8921d5d9d" containerName="console" Jun 09 12:39:38.467353 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.467330 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0929efe2-e3d5-435d-9f40-c6c8921d5d9d" containerName="console" Jun 09 12:39:38.470191 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.470170 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" Jun 09 12:39:38.472762 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.472742 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:39:38.472863 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.472779 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:39:38.473308 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.473293 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xckbn\"" Jun 09 12:39:38.482677 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.482656 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x"] Jun 09 12:39:38.564748 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.564719 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/988484d0-de3b-44fb-ae25-353154ebcd70-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x\" (UID: \"988484d0-de3b-44fb-ae25-353154ebcd70\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" Jun 09 12:39:38.564857 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.564762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg8jc\" (UniqueName: \"kubernetes.io/projected/988484d0-de3b-44fb-ae25-353154ebcd70-kube-api-access-tg8jc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x\" (UID: \"988484d0-de3b-44fb-ae25-353154ebcd70\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" Jun 09 12:39:38.564857 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.564822 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/988484d0-de3b-44fb-ae25-353154ebcd70-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x\" (UID: \"988484d0-de3b-44fb-ae25-353154ebcd70\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" Jun 09 12:39:38.665188 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.665159 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/988484d0-de3b-44fb-ae25-353154ebcd70-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x\" (UID: \"988484d0-de3b-44fb-ae25-353154ebcd70\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" Jun 09 12:39:38.665269 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.665202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/988484d0-de3b-44fb-ae25-353154ebcd70-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x\" (UID: \"988484d0-de3b-44fb-ae25-353154ebcd70\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" Jun 09 12:39:38.665348 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.665324 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg8jc\" (UniqueName: \"kubernetes.io/projected/988484d0-de3b-44fb-ae25-353154ebcd70-kube-api-access-tg8jc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x\" (UID: \"988484d0-de3b-44fb-ae25-353154ebcd70\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" Jun 09 12:39:38.665499 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.665484 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/988484d0-de3b-44fb-ae25-353154ebcd70-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x\" (UID: \"988484d0-de3b-44fb-ae25-353154ebcd70\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" Jun 09 12:39:38.665588 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.665514 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/988484d0-de3b-44fb-ae25-353154ebcd70-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x\" (UID: \"988484d0-de3b-44fb-ae25-353154ebcd70\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" Jun 09 12:39:38.674212 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.674189 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg8jc\" (UniqueName: \"kubernetes.io/projected/988484d0-de3b-44fb-ae25-353154ebcd70-kube-api-access-tg8jc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x\" (UID: \"988484d0-de3b-44fb-ae25-353154ebcd70\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" Jun 09 12:39:38.778505 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.778442 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" Jun 09 12:39:38.901446 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.901281 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x"] Jun 09 12:39:38.904128 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:39:38.904100 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod988484d0_de3b_44fb_ae25_353154ebcd70.slice/crio-1a8b67b1179ee6df11736404de7bbd4d4450fd64b3f61ccb59149fd778583640 WatchSource:0}: Error finding container 1a8b67b1179ee6df11736404de7bbd4d4450fd64b3f61ccb59149fd778583640: Status 404 returned error can't find the container with id 1a8b67b1179ee6df11736404de7bbd4d4450fd64b3f61ccb59149fd778583640 Jun 09 12:39:38.906109 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:38.906089 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:39:39.403371 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:39.403332 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" event={"ID":"988484d0-de3b-44fb-ae25-353154ebcd70","Type":"ContainerStarted","Data":"1a8b67b1179ee6df11736404de7bbd4d4450fd64b3f61ccb59149fd778583640"} Jun 09 12:39:47.434589 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:47.434539 2564 generic.go:356] "Generic (PLEG): container finished" podID="988484d0-de3b-44fb-ae25-353154ebcd70" containerID="fa8c86981be28b06af6f3d3ac81760798c796774b72e57481673f2ef659a7009" exitCode=0 Jun 09 12:39:47.434963 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:47.434614 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" event={"ID":"988484d0-de3b-44fb-ae25-353154ebcd70","Type":"ContainerDied","Data":"fa8c86981be28b06af6f3d3ac81760798c796774b72e57481673f2ef659a7009"} Jun 09 12:39:49.442801 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:49.442765 2564 generic.go:356] "Generic (PLEG): container finished" podID="988484d0-de3b-44fb-ae25-353154ebcd70" containerID="f0520d059dba075471d7b0c7fe6f36cfe274c4aae6a5a94f2d11de16467505ca" exitCode=0 Jun 09 12:39:49.443183 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:49.442849 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" event={"ID":"988484d0-de3b-44fb-ae25-353154ebcd70","Type":"ContainerDied","Data":"f0520d059dba075471d7b0c7fe6f36cfe274c4aae6a5a94f2d11de16467505ca"} Jun 09 12:39:57.478774 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:57.478735 2564 generic.go:356] "Generic (PLEG): container finished" podID="988484d0-de3b-44fb-ae25-353154ebcd70" containerID="0b352e8c87acff0509e242a0daee56f25e0d6f3f59324017ea7fa4104eea3189" exitCode=0 Jun 09 12:39:57.479165 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:57.478810 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" event={"ID":"988484d0-de3b-44fb-ae25-353154ebcd70","Type":"ContainerDied","Data":"0b352e8c87acff0509e242a0daee56f25e0d6f3f59324017ea7fa4104eea3189"} Jun 09 12:39:58.601161 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:58.601136 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" Jun 09 12:39:58.728333 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:58.728297 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/988484d0-de3b-44fb-ae25-353154ebcd70-util\") pod \"988484d0-de3b-44fb-ae25-353154ebcd70\" (UID: \"988484d0-de3b-44fb-ae25-353154ebcd70\") " Jun 09 12:39:58.728514 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:58.728366 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/988484d0-de3b-44fb-ae25-353154ebcd70-bundle\") pod \"988484d0-de3b-44fb-ae25-353154ebcd70\" (UID: \"988484d0-de3b-44fb-ae25-353154ebcd70\") " Jun 09 12:39:58.728514 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:58.728423 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg8jc\" (UniqueName: \"kubernetes.io/projected/988484d0-de3b-44fb-ae25-353154ebcd70-kube-api-access-tg8jc\") pod \"988484d0-de3b-44fb-ae25-353154ebcd70\" (UID: \"988484d0-de3b-44fb-ae25-353154ebcd70\") " Jun 09 12:39:58.729129 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:58.729094 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/988484d0-de3b-44fb-ae25-353154ebcd70-bundle" (OuterVolumeSpecName: "bundle") pod "988484d0-de3b-44fb-ae25-353154ebcd70" (UID: "988484d0-de3b-44fb-ae25-353154ebcd70"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:39:58.730669 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:58.730640 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/988484d0-de3b-44fb-ae25-353154ebcd70-kube-api-access-tg8jc" (OuterVolumeSpecName: "kube-api-access-tg8jc") pod "988484d0-de3b-44fb-ae25-353154ebcd70" (UID: "988484d0-de3b-44fb-ae25-353154ebcd70"). InnerVolumeSpecName "kube-api-access-tg8jc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:39:58.732389 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:58.732363 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/988484d0-de3b-44fb-ae25-353154ebcd70-util" (OuterVolumeSpecName: "util") pod "988484d0-de3b-44fb-ae25-353154ebcd70" (UID: "988484d0-de3b-44fb-ae25-353154ebcd70"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:39:58.829546 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:58.829519 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/988484d0-de3b-44fb-ae25-353154ebcd70-bundle\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:39:58.829546 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:58.829543 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg8jc\" (UniqueName: \"kubernetes.io/projected/988484d0-de3b-44fb-ae25-353154ebcd70-kube-api-access-tg8jc\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:39:58.829546 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:58.829553 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/988484d0-de3b-44fb-ae25-353154ebcd70-util\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:39:59.487824 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:59.487799 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" Jun 09 12:39:59.487981 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:59.487799 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d7bc2x" event={"ID":"988484d0-de3b-44fb-ae25-353154ebcd70","Type":"ContainerDied","Data":"1a8b67b1179ee6df11736404de7bbd4d4450fd64b3f61ccb59149fd778583640"} Jun 09 12:39:59.487981 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:39:59.487916 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a8b67b1179ee6df11736404de7bbd4d4450fd64b3f61ccb59149fd778583640" Jun 09 12:40:04.511396 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:04.511367 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:05.355731 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:05.355699 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:06.153200 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:06.153171 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:06.254861 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:06.254824 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:08.318311 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:08.318274 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:08.382294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:08.382265 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:10.870921 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:10.870891 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:11.007457 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.007425 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:11.409698 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.409670 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:11.568983 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.568952 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:11.782649 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.782620 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb"] Jun 09 12:40:11.782878 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.782867 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="988484d0-de3b-44fb-ae25-353154ebcd70" containerName="util" Jun 09 12:40:11.782921 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.782880 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="988484d0-de3b-44fb-ae25-353154ebcd70" containerName="util" Jun 09 12:40:11.782921 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.782891 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="988484d0-de3b-44fb-ae25-353154ebcd70" containerName="extract" Jun 09 12:40:11.782921 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.782896 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="988484d0-de3b-44fb-ae25-353154ebcd70" containerName="extract" Jun 09 12:40:11.782921 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.782907 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="988484d0-de3b-44fb-ae25-353154ebcd70" containerName="pull" Jun 09 12:40:11.782921 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.782913 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="988484d0-de3b-44fb-ae25-353154ebcd70" containerName="pull" Jun 09 12:40:11.783066 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.782956 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="988484d0-de3b-44fb-ae25-353154ebcd70" containerName="extract" Jun 09 12:40:11.784878 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.784861 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" Jun 09 12:40:11.787639 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.787615 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:40:11.787755 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.787648 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xckbn\"" Jun 09 12:40:11.788214 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.788200 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:40:11.803669 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.803642 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb"] Jun 09 12:40:11.923479 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.923450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c379995-01f7-4676-b771-986e4296a0a9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb\" (UID: \"8c379995-01f7-4676-b771-986e4296a0a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" Jun 09 12:40:11.923859 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.923508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c379995-01f7-4676-b771-986e4296a0a9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb\" (UID: \"8c379995-01f7-4676-b771-986e4296a0a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" Jun 09 12:40:11.923859 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:11.923549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8svg\" (UniqueName: \"kubernetes.io/projected/8c379995-01f7-4676-b771-986e4296a0a9-kube-api-access-m8svg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb\" (UID: \"8c379995-01f7-4676-b771-986e4296a0a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" Jun 09 12:40:12.024870 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:12.024837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8svg\" (UniqueName: \"kubernetes.io/projected/8c379995-01f7-4676-b771-986e4296a0a9-kube-api-access-m8svg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb\" (UID: \"8c379995-01f7-4676-b771-986e4296a0a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" Jun 09 12:40:12.025018 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:12.024875 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c379995-01f7-4676-b771-986e4296a0a9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb\" (UID: \"8c379995-01f7-4676-b771-986e4296a0a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" Jun 09 12:40:12.025018 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:12.024946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c379995-01f7-4676-b771-986e4296a0a9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb\" (UID: \"8c379995-01f7-4676-b771-986e4296a0a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" Jun 09 12:40:12.025270 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:12.025253 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c379995-01f7-4676-b771-986e4296a0a9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb\" (UID: \"8c379995-01f7-4676-b771-986e4296a0a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" Jun 09 12:40:12.025320 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:12.025293 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c379995-01f7-4676-b771-986e4296a0a9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb\" (UID: \"8c379995-01f7-4676-b771-986e4296a0a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" Jun 09 12:40:12.042392 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:12.042334 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8svg\" (UniqueName: \"kubernetes.io/projected/8c379995-01f7-4676-b771-986e4296a0a9-kube-api-access-m8svg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb\" (UID: \"8c379995-01f7-4676-b771-986e4296a0a9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" Jun 09 12:40:12.093266 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:12.093247 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" Jun 09 12:40:12.217276 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:12.217251 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb"] Jun 09 12:40:12.219384 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:40:12.219358 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c379995_01f7_4676_b771_986e4296a0a9.slice/crio-2fb239fda52f0c431953ea178e1f4e73ce9962735fc1a0d4e4284e406ec20149 WatchSource:0}: Error finding container 2fb239fda52f0c431953ea178e1f4e73ce9962735fc1a0d4e4284e406ec20149: Status 404 returned error can't find the container with id 2fb239fda52f0c431953ea178e1f4e73ce9962735fc1a0d4e4284e406ec20149 Jun 09 12:40:12.531924 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:12.531889 2564 generic.go:356] "Generic (PLEG): container finished" podID="8c379995-01f7-4676-b771-986e4296a0a9" containerID="ac240834342d4d25526f1bfeaf1c86b6318ad90f4de1d1ce150af6939225253e" exitCode=0 Jun 09 12:40:12.532066 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:12.531981 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" event={"ID":"8c379995-01f7-4676-b771-986e4296a0a9","Type":"ContainerDied","Data":"ac240834342d4d25526f1bfeaf1c86b6318ad90f4de1d1ce150af6939225253e"} Jun 09 12:40:12.532066 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:12.532034 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" event={"ID":"8c379995-01f7-4676-b771-986e4296a0a9","Type":"ContainerStarted","Data":"2fb239fda52f0c431953ea178e1f4e73ce9962735fc1a0d4e4284e406ec20149"} Jun 09 12:40:14.183730 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:14.183690 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:14.321690 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:14.321661 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:14.394691 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:14.394658 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:14.774305 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:14.774275 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:15.544668 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:15.544639 2564 generic.go:356] "Generic (PLEG): container finished" podID="8c379995-01f7-4676-b771-986e4296a0a9" containerID="2b5067b72218b951afe4451fcb02bb58718eb9986f3b99d9467f809461f69feb" exitCode=0 Jun 09 12:40:15.545150 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:15.544721 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" event={"ID":"8c379995-01f7-4676-b771-986e4296a0a9","Type":"ContainerDied","Data":"2b5067b72218b951afe4451fcb02bb58718eb9986f3b99d9467f809461f69feb"} Jun 09 12:40:16.550211 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:16.550171 2564 generic.go:356] "Generic (PLEG): container finished" podID="8c379995-01f7-4676-b771-986e4296a0a9" containerID="a7f1c4dd51af12f94cd5a31c335d6b3a19d26ffaeb6c32912f3e824e965c1e5b" exitCode=0 Jun 09 12:40:16.550679 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:16.550222 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" event={"ID":"8c379995-01f7-4676-b771-986e4296a0a9","Type":"ContainerDied","Data":"a7f1c4dd51af12f94cd5a31c335d6b3a19d26ffaeb6c32912f3e824e965c1e5b"} Jun 09 12:40:17.675819 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:17.675760 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" Jun 09 12:40:17.769263 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:17.769232 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c379995-01f7-4676-b771-986e4296a0a9-bundle\") pod \"8c379995-01f7-4676-b771-986e4296a0a9\" (UID: \"8c379995-01f7-4676-b771-986e4296a0a9\") " Jun 09 12:40:17.769263 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:17.769264 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c379995-01f7-4676-b771-986e4296a0a9-util\") pod \"8c379995-01f7-4676-b771-986e4296a0a9\" (UID: \"8c379995-01f7-4676-b771-986e4296a0a9\") " Jun 09 12:40:17.769488 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:17.769283 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8svg\" (UniqueName: \"kubernetes.io/projected/8c379995-01f7-4676-b771-986e4296a0a9-kube-api-access-m8svg\") pod \"8c379995-01f7-4676-b771-986e4296a0a9\" (UID: \"8c379995-01f7-4676-b771-986e4296a0a9\") " Jun 09 12:40:17.769706 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:17.769663 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c379995-01f7-4676-b771-986e4296a0a9-bundle" (OuterVolumeSpecName: "bundle") pod "8c379995-01f7-4676-b771-986e4296a0a9" (UID: "8c379995-01f7-4676-b771-986e4296a0a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:40:17.771310 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:17.771288 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c379995-01f7-4676-b771-986e4296a0a9-kube-api-access-m8svg" (OuterVolumeSpecName: "kube-api-access-m8svg") pod "8c379995-01f7-4676-b771-986e4296a0a9" (UID: "8c379995-01f7-4676-b771-986e4296a0a9"). InnerVolumeSpecName "kube-api-access-m8svg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:40:17.846987 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:17.846922 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c379995-01f7-4676-b771-986e4296a0a9-util" (OuterVolumeSpecName: "util") pod "8c379995-01f7-4676-b771-986e4296a0a9" (UID: "8c379995-01f7-4676-b771-986e4296a0a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:40:17.869918 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:17.869897 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c379995-01f7-4676-b771-986e4296a0a9-bundle\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:40:17.869918 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:17.869919 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c379995-01f7-4676-b771-986e4296a0a9-util\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:40:17.870054 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:17.869932 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8svg\" (UniqueName: \"kubernetes.io/projected/8c379995-01f7-4676-b771-986e4296a0a9-kube-api-access-m8svg\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:40:18.559004 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:18.558974 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" Jun 09 12:40:18.559190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:18.558978 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2mpdb" event={"ID":"8c379995-01f7-4676-b771-986e4296a0a9","Type":"ContainerDied","Data":"2fb239fda52f0c431953ea178e1f4e73ce9962735fc1a0d4e4284e406ec20149"} Jun 09 12:40:18.559190 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:18.559086 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2fb239fda52f0c431953ea178e1f4e73ce9962735fc1a0d4e4284e406ec20149" Jun 09 12:40:20.133816 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:20.133786 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:20.220726 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:20.220687 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:22.315544 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:22.315511 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:22.430483 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:22.430458 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:22.582720 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:22.582645 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:23.807055 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.807018 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6dlzt"] Jun 09 12:40:23.807432 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.807297 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c379995-01f7-4676-b771-986e4296a0a9" containerName="pull" Jun 09 12:40:23.807432 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.807309 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c379995-01f7-4676-b771-986e4296a0a9" containerName="pull" Jun 09 12:40:23.807432 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.807325 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c379995-01f7-4676-b771-986e4296a0a9" containerName="extract" Jun 09 12:40:23.807432 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.807331 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c379995-01f7-4676-b771-986e4296a0a9" containerName="extract" Jun 09 12:40:23.807432 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.807344 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c379995-01f7-4676-b771-986e4296a0a9" containerName="util" Jun 09 12:40:23.807432 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.807351 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c379995-01f7-4676-b771-986e4296a0a9" containerName="util" Jun 09 12:40:23.807432 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.807406 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c379995-01f7-4676-b771-986e4296a0a9" containerName="extract" Jun 09 12:40:23.810145 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.810130 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6dlzt" Jun 09 12:40:23.812535 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.812509 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 12:40:23.812689 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.812581 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:40:23.813124 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.813105 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5k4kp\"" Jun 09 12:40:23.815122 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.815097 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b67324e-87e3-4cb5-9a2e-2d51dc9022f3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6dlzt\" (UID: \"2b67324e-87e3-4cb5-9a2e-2d51dc9022f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6dlzt" Jun 09 12:40:23.815221 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.815156 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hn4j\" (UniqueName: \"kubernetes.io/projected/2b67324e-87e3-4cb5-9a2e-2d51dc9022f3-kube-api-access-2hn4j\") pod \"openshift-lws-operator-fd8ccff4c-6dlzt\" (UID: \"2b67324e-87e3-4cb5-9a2e-2d51dc9022f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6dlzt" Jun 09 12:40:23.816360 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.816341 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6dlzt"] Jun 09 12:40:23.916281 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.916257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b67324e-87e3-4cb5-9a2e-2d51dc9022f3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6dlzt\" (UID: \"2b67324e-87e3-4cb5-9a2e-2d51dc9022f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6dlzt" Jun 09 12:40:23.916379 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.916321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hn4j\" (UniqueName: \"kubernetes.io/projected/2b67324e-87e3-4cb5-9a2e-2d51dc9022f3-kube-api-access-2hn4j\") pod \"openshift-lws-operator-fd8ccff4c-6dlzt\" (UID: \"2b67324e-87e3-4cb5-9a2e-2d51dc9022f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6dlzt" Jun 09 12:40:23.916701 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.916683 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b67324e-87e3-4cb5-9a2e-2d51dc9022f3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6dlzt\" (UID: \"2b67324e-87e3-4cb5-9a2e-2d51dc9022f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6dlzt" Jun 09 12:40:23.925551 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:23.925531 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hn4j\" (UniqueName: \"kubernetes.io/projected/2b67324e-87e3-4cb5-9a2e-2d51dc9022f3-kube-api-access-2hn4j\") pod \"openshift-lws-operator-fd8ccff4c-6dlzt\" (UID: \"2b67324e-87e3-4cb5-9a2e-2d51dc9022f3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6dlzt" Jun 09 12:40:24.120355 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:24.120266 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6dlzt" Jun 09 12:40:24.248704 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:24.248677 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6dlzt"] Jun 09 12:40:24.252343 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:40:24.252320 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b67324e_87e3_4cb5_9a2e_2d51dc9022f3.slice/crio-993623f79cc99d902f4f33f6303b174dd60e978d92508f36e94fbaf026d6e5c4 WatchSource:0}: Error finding container 993623f79cc99d902f4f33f6303b174dd60e978d92508f36e94fbaf026d6e5c4: Status 404 returned error can't find the container with id 993623f79cc99d902f4f33f6303b174dd60e978d92508f36e94fbaf026d6e5c4 Jun 09 12:40:24.583460 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:24.583426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6dlzt" event={"ID":"2b67324e-87e3-4cb5-9a2e-2d51dc9022f3","Type":"ContainerStarted","Data":"993623f79cc99d902f4f33f6303b174dd60e978d92508f36e94fbaf026d6e5c4"} Jun 09 12:40:26.592575 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:26.592528 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6dlzt" event={"ID":"2b67324e-87e3-4cb5-9a2e-2d51dc9022f3","Type":"ContainerStarted","Data":"b2b184b7006f656132cfea2ad653cd72c1d6c18694b90c74c00801ccbffafc90"} Jun 09 12:40:26.613005 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:26.612962 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6dlzt" podStartSLOduration=1.469323447 podStartE2EDuration="3.612946378s" totalImagesPullingTime="2.143622931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:40:26.612230644 +0000 UTC m=+524.309717595" watchObservedRunningTime="2026-06-09 12:40:26.612946378 +0000 UTC m=+524.310433307" Jun 09 12:40:27.409432 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:27.409400 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:27.509084 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:27.509056 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:28.721496 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:28.721464 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:29.376484 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.376452 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7"] Jun 09 12:40:29.422372 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.422341 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7"] Jun 09 12:40:29.422509 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.422383 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" Jun 09 12:40:29.425030 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.425013 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:40:29.425784 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.425767 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:40:29.425891 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.425828 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xckbn\"" Jun 09 12:40:29.456439 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.456412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feabb495-b905-4d8d-bad3-99d1ff4d1705-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7\" (UID: \"feabb495-b905-4d8d-bad3-99d1ff4d1705\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" Jun 09 12:40:29.456577 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.456455 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feabb495-b905-4d8d-bad3-99d1ff4d1705-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7\" (UID: \"feabb495-b905-4d8d-bad3-99d1ff4d1705\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" Jun 09 12:40:29.456577 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.456476 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhcf6\" (UniqueName: \"kubernetes.io/projected/feabb495-b905-4d8d-bad3-99d1ff4d1705-kube-api-access-dhcf6\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7\" (UID: \"feabb495-b905-4d8d-bad3-99d1ff4d1705\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" Jun 09 12:40:29.485387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.485362 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:29.556836 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.556803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feabb495-b905-4d8d-bad3-99d1ff4d1705-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7\" (UID: \"feabb495-b905-4d8d-bad3-99d1ff4d1705\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" Jun 09 12:40:29.556985 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.556854 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feabb495-b905-4d8d-bad3-99d1ff4d1705-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7\" (UID: \"feabb495-b905-4d8d-bad3-99d1ff4d1705\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" Jun 09 12:40:29.556985 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.556882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhcf6\" (UniqueName: \"kubernetes.io/projected/feabb495-b905-4d8d-bad3-99d1ff4d1705-kube-api-access-dhcf6\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7\" (UID: \"feabb495-b905-4d8d-bad3-99d1ff4d1705\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" Jun 09 12:40:29.557180 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.557160 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feabb495-b905-4d8d-bad3-99d1ff4d1705-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7\" (UID: \"feabb495-b905-4d8d-bad3-99d1ff4d1705\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" Jun 09 12:40:29.557234 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.557211 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feabb495-b905-4d8d-bad3-99d1ff4d1705-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7\" (UID: \"feabb495-b905-4d8d-bad3-99d1ff4d1705\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" Jun 09 12:40:29.566209 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.566189 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhcf6\" (UniqueName: \"kubernetes.io/projected/feabb495-b905-4d8d-bad3-99d1ff4d1705-kube-api-access-dhcf6\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7\" (UID: \"feabb495-b905-4d8d-bad3-99d1ff4d1705\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" Jun 09 12:40:29.730928 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.730901 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" Jun 09 12:40:29.891611 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:29.891550 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7"] Jun 09 12:40:29.894091 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:40:29.894061 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeabb495_b905_4d8d_bad3_99d1ff4d1705.slice/crio-7380e5d72de8cf7856fb2e54c68d39fff57515309d01cf131460fa5515b67bde WatchSource:0}: Error finding container 7380e5d72de8cf7856fb2e54c68d39fff57515309d01cf131460fa5515b67bde: Status 404 returned error can't find the container with id 7380e5d72de8cf7856fb2e54c68d39fff57515309d01cf131460fa5515b67bde Jun 09 12:40:30.609138 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:30.609103 2564 generic.go:356] "Generic (PLEG): container finished" podID="feabb495-b905-4d8d-bad3-99d1ff4d1705" containerID="b8b4763ee667a78d63e40ed020d89a6fea17aa104942db3752d6d8cb6828a301" exitCode=0 Jun 09 12:40:30.609286 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:30.609183 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" event={"ID":"feabb495-b905-4d8d-bad3-99d1ff4d1705","Type":"ContainerDied","Data":"b8b4763ee667a78d63e40ed020d89a6fea17aa104942db3752d6d8cb6828a301"} Jun 09 12:40:30.609286 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:30.609228 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" event={"ID":"feabb495-b905-4d8d-bad3-99d1ff4d1705","Type":"ContainerStarted","Data":"7380e5d72de8cf7856fb2e54c68d39fff57515309d01cf131460fa5515b67bde"} Jun 09 12:40:31.614393 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:31.614361 2564 generic.go:356] "Generic (PLEG): container finished" podID="feabb495-b905-4d8d-bad3-99d1ff4d1705" containerID="0d19366ea26131818be3ab498333e305d0c713df45d1da514f02f8de922fca2f" exitCode=0 Jun 09 12:40:31.614770 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:31.614412 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" event={"ID":"feabb495-b905-4d8d-bad3-99d1ff4d1705","Type":"ContainerDied","Data":"0d19366ea26131818be3ab498333e305d0c713df45d1da514f02f8de922fca2f"} Jun 09 12:40:32.621886 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:32.621841 2564 generic.go:356] "Generic (PLEG): container finished" podID="feabb495-b905-4d8d-bad3-99d1ff4d1705" containerID="4a6e69b7d0e4b3dc8d5ba9796bd0b00bd32e367d60fd9c8f7cb501adc4effb7b" exitCode=0 Jun 09 12:40:32.622251 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:32.621921 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" event={"ID":"feabb495-b905-4d8d-bad3-99d1ff4d1705","Type":"ContainerDied","Data":"4a6e69b7d0e4b3dc8d5ba9796bd0b00bd32e367d60fd9c8f7cb501adc4effb7b"} Jun 09 12:40:33.744057 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:33.744035 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" Jun 09 12:40:33.786595 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:33.786551 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feabb495-b905-4d8d-bad3-99d1ff4d1705-bundle\") pod \"feabb495-b905-4d8d-bad3-99d1ff4d1705\" (UID: \"feabb495-b905-4d8d-bad3-99d1ff4d1705\") " Jun 09 12:40:33.786742 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:33.786602 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhcf6\" (UniqueName: \"kubernetes.io/projected/feabb495-b905-4d8d-bad3-99d1ff4d1705-kube-api-access-dhcf6\") pod \"feabb495-b905-4d8d-bad3-99d1ff4d1705\" (UID: \"feabb495-b905-4d8d-bad3-99d1ff4d1705\") " Jun 09 12:40:33.786742 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:33.786619 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feabb495-b905-4d8d-bad3-99d1ff4d1705-util\") pod \"feabb495-b905-4d8d-bad3-99d1ff4d1705\" (UID: \"feabb495-b905-4d8d-bad3-99d1ff4d1705\") " Jun 09 12:40:33.787243 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:33.787216 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feabb495-b905-4d8d-bad3-99d1ff4d1705-bundle" (OuterVolumeSpecName: "bundle") pod "feabb495-b905-4d8d-bad3-99d1ff4d1705" (UID: "feabb495-b905-4d8d-bad3-99d1ff4d1705"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:40:33.788489 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:33.788466 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feabb495-b905-4d8d-bad3-99d1ff4d1705-kube-api-access-dhcf6" (OuterVolumeSpecName: "kube-api-access-dhcf6") pod "feabb495-b905-4d8d-bad3-99d1ff4d1705" (UID: "feabb495-b905-4d8d-bad3-99d1ff4d1705"). InnerVolumeSpecName "kube-api-access-dhcf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:40:33.792260 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:33.792242 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feabb495-b905-4d8d-bad3-99d1ff4d1705-util" (OuterVolumeSpecName: "util") pod "feabb495-b905-4d8d-bad3-99d1ff4d1705" (UID: "feabb495-b905-4d8d-bad3-99d1ff4d1705"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:40:33.887781 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:33.887721 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feabb495-b905-4d8d-bad3-99d1ff4d1705-bundle\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:40:33.887781 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:33.887744 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhcf6\" (UniqueName: \"kubernetes.io/projected/feabb495-b905-4d8d-bad3-99d1ff4d1705-kube-api-access-dhcf6\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:40:33.887781 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:33.887753 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feabb495-b905-4d8d-bad3-99d1ff4d1705-util\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:40:34.630527 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:34.630495 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" Jun 09 12:40:34.630527 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:34.630517 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdm68k7" event={"ID":"feabb495-b905-4d8d-bad3-99d1ff4d1705","Type":"ContainerDied","Data":"7380e5d72de8cf7856fb2e54c68d39fff57515309d01cf131460fa5515b67bde"} Jun 09 12:40:34.630781 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:34.630602 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7380e5d72de8cf7856fb2e54c68d39fff57515309d01cf131460fa5515b67bde" Jun 09 12:40:39.893008 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:39.892979 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:40.998270 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:40.998233 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:41.168596 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:41.168549 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:41.549981 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:41.549954 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:42.053827 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.053791 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:42.163344 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.163312 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:42.247681 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.247647 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss"] Jun 09 12:40:42.247922 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.247911 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feabb495-b905-4d8d-bad3-99d1ff4d1705" containerName="pull" Jun 09 12:40:42.247964 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.247923 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="feabb495-b905-4d8d-bad3-99d1ff4d1705" containerName="pull" Jun 09 12:40:42.247964 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.247933 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feabb495-b905-4d8d-bad3-99d1ff4d1705" containerName="extract" Jun 09 12:40:42.247964 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.247938 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="feabb495-b905-4d8d-bad3-99d1ff4d1705" containerName="extract" Jun 09 12:40:42.247964 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.247945 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feabb495-b905-4d8d-bad3-99d1ff4d1705" containerName="util" Jun 09 12:40:42.247964 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.247951 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="feabb495-b905-4d8d-bad3-99d1ff4d1705" containerName="util" Jun 09 12:40:42.248110 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.247987 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="feabb495-b905-4d8d-bad3-99d1ff4d1705" containerName="extract" Jun 09 12:40:42.250222 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.250206 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.255592 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.255571 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 12:40:42.255843 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.255826 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 12:40:42.255925 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.255842 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 12:40:42.255925 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.255834 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 12:40:42.257998 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.257981 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2wp74\"" Jun 09 12:40:42.295005 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.294978 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss"] Jun 09 12:40:42.349880 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.349812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e82d2312-95f2-4bd9-8bc5-140dfe07998a-tmp\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.349880 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.349851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e82d2312-95f2-4bd9-8bc5-140dfe07998a-manifests\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.350005 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.349891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e82d2312-95f2-4bd9-8bc5-140dfe07998a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.350005 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.349914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e82d2312-95f2-4bd9-8bc5-140dfe07998a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.350005 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.349937 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fs8z\" (UniqueName: \"kubernetes.io/projected/e82d2312-95f2-4bd9-8bc5-140dfe07998a-kube-api-access-8fs8z\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.450532 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.450508 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e82d2312-95f2-4bd9-8bc5-140dfe07998a-tmp\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.450648 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.450542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e82d2312-95f2-4bd9-8bc5-140dfe07998a-manifests\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.450648 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.450593 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e82d2312-95f2-4bd9-8bc5-140dfe07998a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.450648 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.450617 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e82d2312-95f2-4bd9-8bc5-140dfe07998a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.450764 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.450651 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fs8z\" (UniqueName: \"kubernetes.io/projected/e82d2312-95f2-4bd9-8bc5-140dfe07998a-kube-api-access-8fs8z\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.451035 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.451016 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e82d2312-95f2-4bd9-8bc5-140dfe07998a-manifests\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.452811 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.452790 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e82d2312-95f2-4bd9-8bc5-140dfe07998a-tmp\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.453086 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.453067 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e82d2312-95f2-4bd9-8bc5-140dfe07998a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.453152 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.453075 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e82d2312-95f2-4bd9-8bc5-140dfe07998a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.464756 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.464736 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fs8z\" (UniqueName: \"kubernetes.io/projected/e82d2312-95f2-4bd9-8bc5-140dfe07998a-kube-api-access-8fs8z\") pod \"opendatahub-operator-controller-manager-6b4c856db4-js8ss\" (UID: \"e82d2312-95f2-4bd9-8bc5-140dfe07998a\") " pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.559472 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.559441 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:42.704262 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.704241 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss"] Jun 09 12:40:42.707002 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:40:42.706977 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode82d2312_95f2_4bd9_8bc5_140dfe07998a.slice/crio-ddb1f3ce2bd2474bff3b7e2257380c4978e59b240cedda038820e8693e192a88 WatchSource:0}: Error finding container ddb1f3ce2bd2474bff3b7e2257380c4978e59b240cedda038820e8693e192a88: Status 404 returned error can't find the container with id ddb1f3ce2bd2474bff3b7e2257380c4978e59b240cedda038820e8693e192a88 Jun 09 12:40:42.744543 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.744514 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:42.852382 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.852351 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:42.949768 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:42.949734 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:43.055905 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:43.055876 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:43.152528 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:43.152496 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:43.258082 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:43.258010 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:40:43.665928 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:43.665824 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" event={"ID":"e82d2312-95f2-4bd9-8bc5-140dfe07998a","Type":"ContainerStarted","Data":"ddb1f3ce2bd2474bff3b7e2257380c4978e59b240cedda038820e8693e192a88"} Jun 09 12:40:45.674487 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:45.674453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" event={"ID":"e82d2312-95f2-4bd9-8bc5-140dfe07998a","Type":"ContainerStarted","Data":"87213cae8a991ae5e13c929aaad13e2732f2aae1fe266b0f4717bf3df8f30224"} Jun 09 12:40:46.679582 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:46.679530 2564 generic.go:356] "Generic (PLEG): container finished" podID="e82d2312-95f2-4bd9-8bc5-140dfe07998a" containerID="87213cae8a991ae5e13c929aaad13e2732f2aae1fe266b0f4717bf3df8f30224" exitCode=0 Jun 09 12:40:46.679935 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:46.679618 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" event={"ID":"e82d2312-95f2-4bd9-8bc5-140dfe07998a","Type":"ContainerDied","Data":"87213cae8a991ae5e13c929aaad13e2732f2aae1fe266b0f4717bf3df8f30224"} Jun 09 12:40:47.685871 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:47.685833 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" event={"ID":"e82d2312-95f2-4bd9-8bc5-140dfe07998a","Type":"ContainerStarted","Data":"003d546acb3f95850957a76a64d6ed9d4302f2e9b9415d51376b472c6d41b92e"} Jun 09 12:40:47.686281 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:47.685934 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:40:47.716714 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:47.716659 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" podStartSLOduration=1.642639001 podStartE2EDuration="5.716639774s" totalImagesPullingTime="3.166753172s" totalInitContainerRuntime="907.247601ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:40:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:40:47.714427079 +0000 UTC m=+545.411914028" watchObservedRunningTime="2026-06-09 12:40:47.716639774 +0000 UTC m=+545.414126705" Jun 09 12:40:58.692459 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:40:58.692428 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b4c856db4-js8ss" Jun 09 12:41:01.284537 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:01.284504 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:01.445835 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:01.445770 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:01.574834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:01.574758 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:01.699001 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:01.698968 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:01.857367 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:01.857289 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:01.956062 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:01.956033 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m"] Jun 09 12:41:01.962754 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:01.962735 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m" Jun 09 12:41:01.966295 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:01.966274 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tqb88\"" Jun 09 12:41:01.966800 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:01.966778 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 12:41:01.967038 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:01.967024 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 12:41:01.975195 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:01.975172 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m"] Jun 09 12:41:02.097731 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.097701 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7g4h\" (UniqueName: \"kubernetes.io/projected/aad4e827-9b32-4c99-b26f-1b90410e2fd6-kube-api-access-s7g4h\") pod \"kube-auth-proxy-79dfc5c477-r6w7m\" (UID: \"aad4e827-9b32-4c99-b26f-1b90410e2fd6\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m" Jun 09 12:41:02.097883 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.097749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad4e827-9b32-4c99-b26f-1b90410e2fd6-tmp\") pod \"kube-auth-proxy-79dfc5c477-r6w7m\" (UID: \"aad4e827-9b32-4c99-b26f-1b90410e2fd6\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m" Jun 09 12:41:02.097883 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.097832 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad4e827-9b32-4c99-b26f-1b90410e2fd6-tls-certs\") pod \"kube-auth-proxy-79dfc5c477-r6w7m\" (UID: \"aad4e827-9b32-4c99-b26f-1b90410e2fd6\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m" Jun 09 12:41:02.102039 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.102013 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-bk9pc"] Jun 09 12:41:02.104110 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.104093 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-bk9pc" Jun 09 12:41:02.110146 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.110079 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 12:41:02.110455 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.110322 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jd662\"" Jun 09 12:41:02.135725 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.135702 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-bk9pc"] Jun 09 12:41:02.198690 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.198655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad4e827-9b32-4c99-b26f-1b90410e2fd6-tls-certs\") pod \"kube-auth-proxy-79dfc5c477-r6w7m\" (UID: \"aad4e827-9b32-4c99-b26f-1b90410e2fd6\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m" Jun 09 12:41:02.198868 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.198696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7g4h\" (UniqueName: \"kubernetes.io/projected/aad4e827-9b32-4c99-b26f-1b90410e2fd6-kube-api-access-s7g4h\") pod \"kube-auth-proxy-79dfc5c477-r6w7m\" (UID: \"aad4e827-9b32-4c99-b26f-1b90410e2fd6\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m" Jun 09 12:41:02.198868 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.198733 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk7jr\" (UniqueName: \"kubernetes.io/projected/d414bef9-4c94-4bf6-baeb-6e606622767e-kube-api-access-xk7jr\") pod \"odh-model-controller-6dc94f689f-bk9pc\" (UID: \"d414bef9-4c94-4bf6-baeb-6e606622767e\") " pod="opendatahub/odh-model-controller-6dc94f689f-bk9pc" Jun 09 12:41:02.198868 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.198766 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d414bef9-4c94-4bf6-baeb-6e606622767e-cert\") pod \"odh-model-controller-6dc94f689f-bk9pc\" (UID: \"d414bef9-4c94-4bf6-baeb-6e606622767e\") " pod="opendatahub/odh-model-controller-6dc94f689f-bk9pc" Jun 09 12:41:02.198868 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.198797 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad4e827-9b32-4c99-b26f-1b90410e2fd6-tmp\") pod \"kube-auth-proxy-79dfc5c477-r6w7m\" (UID: \"aad4e827-9b32-4c99-b26f-1b90410e2fd6\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m" Jun 09 12:41:02.201418 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.201392 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aad4e827-9b32-4c99-b26f-1b90410e2fd6-tmp\") pod \"kube-auth-proxy-79dfc5c477-r6w7m\" (UID: \"aad4e827-9b32-4c99-b26f-1b90410e2fd6\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m" Jun 09 12:41:02.201554 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.201462 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad4e827-9b32-4c99-b26f-1b90410e2fd6-tls-certs\") pod \"kube-auth-proxy-79dfc5c477-r6w7m\" (UID: \"aad4e827-9b32-4c99-b26f-1b90410e2fd6\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m" Jun 09 12:41:02.214963 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.214935 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7g4h\" (UniqueName: \"kubernetes.io/projected/aad4e827-9b32-4c99-b26f-1b90410e2fd6-kube-api-access-s7g4h\") pod \"kube-auth-proxy-79dfc5c477-r6w7m\" (UID: \"aad4e827-9b32-4c99-b26f-1b90410e2fd6\") " pod="openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m" Jun 09 12:41:02.220167 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.220138 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:02.272132 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.272102 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m" Jun 09 12:41:02.299947 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.299915 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk7jr\" (UniqueName: \"kubernetes.io/projected/d414bef9-4c94-4bf6-baeb-6e606622767e-kube-api-access-xk7jr\") pod \"odh-model-controller-6dc94f689f-bk9pc\" (UID: \"d414bef9-4c94-4bf6-baeb-6e606622767e\") " pod="opendatahub/odh-model-controller-6dc94f689f-bk9pc" Jun 09 12:41:02.300353 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.299969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d414bef9-4c94-4bf6-baeb-6e606622767e-cert\") pod \"odh-model-controller-6dc94f689f-bk9pc\" (UID: \"d414bef9-4c94-4bf6-baeb-6e606622767e\") " pod="opendatahub/odh-model-controller-6dc94f689f-bk9pc" Jun 09 12:41:02.300353 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:41:02.300118 2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 12:41:02.300353 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:41:02.300181 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d414bef9-4c94-4bf6-baeb-6e606622767e-cert podName:d414bef9-4c94-4bf6-baeb-6e606622767e nodeName:}" failed. No retries permitted until 2026-06-09 12:41:02.800162156 +0000 UTC m=+560.497649066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d414bef9-4c94-4bf6-baeb-6e606622767e-cert") pod "odh-model-controller-6dc94f689f-bk9pc" (UID: "d414bef9-4c94-4bf6-baeb-6e606622767e") : secret "odh-model-controller-webhook-cert" not found Jun 09 12:41:02.309607 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.309578 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk7jr\" (UniqueName: \"kubernetes.io/projected/d414bef9-4c94-4bf6-baeb-6e606622767e-kube-api-access-xk7jr\") pod \"odh-model-controller-6dc94f689f-bk9pc\" (UID: \"d414bef9-4c94-4bf6-baeb-6e606622767e\") " pod="opendatahub/odh-model-controller-6dc94f689f-bk9pc" Jun 09 12:41:02.325473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.325436 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:02.409086 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.409037 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m"] Jun 09 12:41:02.411421 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:41:02.411393 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad4e827_9b32_4c99_b26f_1b90410e2fd6.slice/crio-0baffae326b5a385a437c007d8b8038e81fadec21260df4a435e76652d9835ba WatchSource:0}: Error finding container 0baffae326b5a385a437c007d8b8038e81fadec21260df4a435e76652d9835ba: Status 404 returned error can't find the container with id 0baffae326b5a385a437c007d8b8038e81fadec21260df4a435e76652d9835ba Jun 09 12:41:02.412998 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.412961 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:02.755759 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.755721 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m" event={"ID":"aad4e827-9b32-4c99-b26f-1b90410e2fd6","Type":"ContainerStarted","Data":"0baffae326b5a385a437c007d8b8038e81fadec21260df4a435e76652d9835ba"} Jun 09 12:41:02.792232 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.792186 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:02.804535 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.804510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d414bef9-4c94-4bf6-baeb-6e606622767e-cert\") pod \"odh-model-controller-6dc94f689f-bk9pc\" (UID: \"d414bef9-4c94-4bf6-baeb-6e606622767e\") " pod="opendatahub/odh-model-controller-6dc94f689f-bk9pc" Jun 09 12:41:02.806890 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:02.806873 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d414bef9-4c94-4bf6-baeb-6e606622767e-cert\") pod \"odh-model-controller-6dc94f689f-bk9pc\" (UID: \"d414bef9-4c94-4bf6-baeb-6e606622767e\") " pod="opendatahub/odh-model-controller-6dc94f689f-bk9pc" Jun 09 12:41:03.013612 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.013509 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-bk9pc" Jun 09 12:41:03.017611 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.017588 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-r68d8"] Jun 09 12:41:03.019913 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.019888 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-r68d8" Jun 09 12:41:03.021243 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.021219 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:03.022186 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.022092 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 12:41:03.034702 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.034619 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-r68d8"] Jun 09 12:41:03.107990 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.107953 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/721a08c6-6741-49ea-a7c4-ba73532c50e3-tls-certs\") pod \"model-serving-api-5dd488fc48-r68d8\" (UID: \"721a08c6-6741-49ea-a7c4-ba73532c50e3\") " pod="opendatahub/model-serving-api-5dd488fc48-r68d8" Jun 09 12:41:03.108154 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.108034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9svt7\" (UniqueName: \"kubernetes.io/projected/721a08c6-6741-49ea-a7c4-ba73532c50e3-kube-api-access-9svt7\") pod \"model-serving-api-5dd488fc48-r68d8\" (UID: \"721a08c6-6741-49ea-a7c4-ba73532c50e3\") " pod="opendatahub/model-serving-api-5dd488fc48-r68d8" Jun 09 12:41:03.179252 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.179168 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-bk9pc"] Jun 09 12:41:03.184029 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:41:03.183995 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd414bef9_4c94_4bf6_baeb_6e606622767e.slice/crio-c74c69790738ffc06e4957eaae13dd42ff90cbf893007c7afcb578bd36c039d8 WatchSource:0}: Error finding container c74c69790738ffc06e4957eaae13dd42ff90cbf893007c7afcb578bd36c039d8: Status 404 returned error can't find the container with id c74c69790738ffc06e4957eaae13dd42ff90cbf893007c7afcb578bd36c039d8 Jun 09 12:41:03.209076 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.209048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9svt7\" (UniqueName: \"kubernetes.io/projected/721a08c6-6741-49ea-a7c4-ba73532c50e3-kube-api-access-9svt7\") pod \"model-serving-api-5dd488fc48-r68d8\" (UID: \"721a08c6-6741-49ea-a7c4-ba73532c50e3\") " pod="opendatahub/model-serving-api-5dd488fc48-r68d8" Jun 09 12:41:03.209185 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.209146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/721a08c6-6741-49ea-a7c4-ba73532c50e3-tls-certs\") pod \"model-serving-api-5dd488fc48-r68d8\" (UID: \"721a08c6-6741-49ea-a7c4-ba73532c50e3\") " pod="opendatahub/model-serving-api-5dd488fc48-r68d8" Jun 09 12:41:03.209308 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:41:03.209291 2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 09 12:41:03.209363 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:41:03.209357 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/721a08c6-6741-49ea-a7c4-ba73532c50e3-tls-certs podName:721a08c6-6741-49ea-a7c4-ba73532c50e3 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:03.70933794 +0000 UTC m=+561.406824850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/721a08c6-6741-49ea-a7c4-ba73532c50e3-tls-certs") pod "model-serving-api-5dd488fc48-r68d8" (UID: "721a08c6-6741-49ea-a7c4-ba73532c50e3") : secret "model-serving-api-tls" not found Jun 09 12:41:03.222720 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.221594 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9svt7\" (UniqueName: \"kubernetes.io/projected/721a08c6-6741-49ea-a7c4-ba73532c50e3-kube-api-access-9svt7\") pod \"model-serving-api-5dd488fc48-r68d8\" (UID: \"721a08c6-6741-49ea-a7c4-ba73532c50e3\") " pod="opendatahub/model-serving-api-5dd488fc48-r68d8" Jun 09 12:41:03.597390 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.597359 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:03.715084 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.715051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/721a08c6-6741-49ea-a7c4-ba73532c50e3-tls-certs\") pod \"model-serving-api-5dd488fc48-r68d8\" (UID: \"721a08c6-6741-49ea-a7c4-ba73532c50e3\") " pod="opendatahub/model-serving-api-5dd488fc48-r68d8" Jun 09 12:41:03.717906 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.717861 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/721a08c6-6741-49ea-a7c4-ba73532c50e3-tls-certs\") pod \"model-serving-api-5dd488fc48-r68d8\" (UID: \"721a08c6-6741-49ea-a7c4-ba73532c50e3\") " pod="opendatahub/model-serving-api-5dd488fc48-r68d8" Jun 09 12:41:03.763525 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.763486 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-bk9pc" event={"ID":"d414bef9-4c94-4bf6-baeb-6e606622767e","Type":"ContainerStarted","Data":"c74c69790738ffc06e4957eaae13dd42ff90cbf893007c7afcb578bd36c039d8"} Jun 09 12:41:03.909966 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.909870 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w"] Jun 09 12:41:03.913187 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.913162 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" Jun 09 12:41:03.916382 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.916326 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:41:03.916822 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.916798 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xckbn\"" Jun 09 12:41:03.919070 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.919042 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:41:03.927414 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.926882 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w"] Jun 09 12:41:03.935273 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:03.935249 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-r68d8" Jun 09 12:41:04.018612 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:04.018371 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78846405-7568-4f6b-b12b-532ff62780fc-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w\" (UID: \"78846405-7568-4f6b-b12b-532ff62780fc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" Jun 09 12:41:04.018612 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:04.018415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78846405-7568-4f6b-b12b-532ff62780fc-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w\" (UID: \"78846405-7568-4f6b-b12b-532ff62780fc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" Jun 09 12:41:04.018612 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:04.018473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bsdt\" (UniqueName: \"kubernetes.io/projected/78846405-7568-4f6b-b12b-532ff62780fc-kube-api-access-8bsdt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w\" (UID: \"78846405-7568-4f6b-b12b-532ff62780fc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" Jun 09 12:41:04.120738 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:04.119635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78846405-7568-4f6b-b12b-532ff62780fc-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w\" (UID: \"78846405-7568-4f6b-b12b-532ff62780fc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" Jun 09 12:41:04.120738 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:04.119677 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78846405-7568-4f6b-b12b-532ff62780fc-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w\" (UID: \"78846405-7568-4f6b-b12b-532ff62780fc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" Jun 09 12:41:04.120738 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:04.119737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bsdt\" (UniqueName: \"kubernetes.io/projected/78846405-7568-4f6b-b12b-532ff62780fc-kube-api-access-8bsdt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w\" (UID: \"78846405-7568-4f6b-b12b-532ff62780fc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" Jun 09 12:41:04.120738 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:04.120417 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78846405-7568-4f6b-b12b-532ff62780fc-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w\" (UID: \"78846405-7568-4f6b-b12b-532ff62780fc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" Jun 09 12:41:04.120738 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:04.120689 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78846405-7568-4f6b-b12b-532ff62780fc-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w\" (UID: \"78846405-7568-4f6b-b12b-532ff62780fc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" Jun 09 12:41:04.140684 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:04.140615 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bsdt\" (UniqueName: \"kubernetes.io/projected/78846405-7568-4f6b-b12b-532ff62780fc-kube-api-access-8bsdt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w\" (UID: \"78846405-7568-4f6b-b12b-532ff62780fc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" Jun 09 12:41:04.237799 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:04.237577 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" Jun 09 12:41:04.662547 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:04.662467 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:04.770849 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:04.770780 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:07.051301 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:07.051138 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-r68d8"] Jun 09 12:41:07.054621 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:41:07.054554 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod721a08c6_6741_49ea_a7c4_ba73532c50e3.slice/crio-c6a0e127b4253ef3c6a17f9ff207fa826db2f8ee1f153ed9759e5a700d162dfb WatchSource:0}: Error finding container c6a0e127b4253ef3c6a17f9ff207fa826db2f8ee1f153ed9759e5a700d162dfb: Status 404 returned error can't find the container with id c6a0e127b4253ef3c6a17f9ff207fa826db2f8ee1f153ed9759e5a700d162dfb Jun 09 12:41:07.082252 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:07.082220 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w"] Jun 09 12:41:07.087326 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:41:07.087301 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78846405_7568_4f6b_b12b_532ff62780fc.slice/crio-98d9145e9e2aec10e8fcf36983ccbfcd0d791396b61c5a20a66a316bc98c23da WatchSource:0}: Error finding container 98d9145e9e2aec10e8fcf36983ccbfcd0d791396b61c5a20a66a316bc98c23da: Status 404 returned error can't find the container with id 98d9145e9e2aec10e8fcf36983ccbfcd0d791396b61c5a20a66a316bc98c23da Jun 09 12:41:07.785682 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:07.785645 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-bk9pc" event={"ID":"d414bef9-4c94-4bf6-baeb-6e606622767e","Type":"ContainerStarted","Data":"2d817196dadd933aa421e9a02e6292316fbf283e68436a901ed37545f3483569"} Jun 09 12:41:07.785838 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:07.785774 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-bk9pc" Jun 09 12:41:07.787459 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:07.787432 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m" event={"ID":"aad4e827-9b32-4c99-b26f-1b90410e2fd6","Type":"ContainerStarted","Data":"4aa2f3d7ff404aa5b83760f46c26e28f06f42ca06532c30cdde92e1d9f218a88"} Jun 09 12:41:07.788651 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:07.788594 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-r68d8" event={"ID":"721a08c6-6741-49ea-a7c4-ba73532c50e3","Type":"ContainerStarted","Data":"c6a0e127b4253ef3c6a17f9ff207fa826db2f8ee1f153ed9759e5a700d162dfb"} Jun 09 12:41:07.790270 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:07.790237 2564 generic.go:356] "Generic (PLEG): container finished" podID="78846405-7568-4f6b-b12b-532ff62780fc" containerID="25280d4f8b282b17aeeeaf0039bbd5965d423572e8268baf24c08f7220654615" exitCode=0 Jun 09 12:41:07.790383 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:07.790296 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" event={"ID":"78846405-7568-4f6b-b12b-532ff62780fc","Type":"ContainerDied","Data":"25280d4f8b282b17aeeeaf0039bbd5965d423572e8268baf24c08f7220654615"} Jun 09 12:41:07.790383 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:07.790377 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" event={"ID":"78846405-7568-4f6b-b12b-532ff62780fc","Type":"ContainerStarted","Data":"98d9145e9e2aec10e8fcf36983ccbfcd0d791396b61c5a20a66a316bc98c23da"} Jun 09 12:41:07.803952 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:07.803910 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-bk9pc" podStartSLOduration=2.064386749 podStartE2EDuration="5.803894195s" totalImagesPullingTime="3.739507446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:07.80195157 +0000 UTC m=+565.499438499" watchObservedRunningTime="2026-06-09 12:41:07.803894195 +0000 UTC m=+565.501381125" Jun 09 12:41:09.740545 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:09.740509 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:09.801385 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:09.801351 2564 generic.go:356] "Generic (PLEG): container finished" podID="78846405-7568-4f6b-b12b-532ff62780fc" containerID="99210f4fddc2a2454dec977e3125ed4cf0c9c6810cb621e88bc4f0e48402adfc" exitCode=0 Jun 09 12:41:09.801542 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:09.801434 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" event={"ID":"78846405-7568-4f6b-b12b-532ff62780fc","Type":"ContainerDied","Data":"99210f4fddc2a2454dec977e3125ed4cf0c9c6810cb621e88bc4f0e48402adfc"} Jun 09 12:41:09.803035 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:09.802948 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-r68d8" event={"ID":"721a08c6-6741-49ea-a7c4-ba73532c50e3","Type":"ContainerStarted","Data":"2a3077e403c993d328b2326f835f724d316d4fc44b0a34e2099808ae344131f8"} Jun 09 12:41:09.803112 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:09.803090 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-r68d8" Jun 09 12:41:09.850216 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:09.850165 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79dfc5c477-r6w7m" podStartSLOduration=4.354184775 podStartE2EDuration="8.850144749s" totalImagesPullingTime="4.495959974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:07.848128963 +0000 UTC m=+565.545615893" watchObservedRunningTime="2026-06-09 12:41:09.850144749 +0000 UTC m=+567.547631681" Jun 09 12:41:09.909338 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:09.908852 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-r68d8" podStartSLOduration=6.218983967 podStartE2EDuration="7.908831821s" totalImagesPullingTime="1.689847854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:09.903570716 +0000 UTC m=+567.601057636" watchObservedRunningTime="2026-06-09 12:41:09.908831821 +0000 UTC m=+567.606318751" Jun 09 12:41:10.808353 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:10.808324 2564 generic.go:356] "Generic (PLEG): container finished" podID="78846405-7568-4f6b-b12b-532ff62780fc" containerID="60f8825a3891200b82c1569d31183fdbcc670c5b7e0dae72949f776b097fab85" exitCode=0 Jun 09 12:41:10.808750 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:10.808388 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" event={"ID":"78846405-7568-4f6b-b12b-532ff62780fc","Type":"ContainerDied","Data":"60f8825a3891200b82c1569d31183fdbcc670c5b7e0dae72949f776b097fab85"} Jun 09 12:41:11.940526 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:11.940504 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" Jun 09 12:41:12.094530 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:12.094434 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78846405-7568-4f6b-b12b-532ff62780fc-bundle\") pod \"78846405-7568-4f6b-b12b-532ff62780fc\" (UID: \"78846405-7568-4f6b-b12b-532ff62780fc\") " Jun 09 12:41:12.094530 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:12.094505 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78846405-7568-4f6b-b12b-532ff62780fc-util\") pod \"78846405-7568-4f6b-b12b-532ff62780fc\" (UID: \"78846405-7568-4f6b-b12b-532ff62780fc\") " Jun 09 12:41:12.094530 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:12.094526 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bsdt\" (UniqueName: \"kubernetes.io/projected/78846405-7568-4f6b-b12b-532ff62780fc-kube-api-access-8bsdt\") pod \"78846405-7568-4f6b-b12b-532ff62780fc\" (UID: \"78846405-7568-4f6b-b12b-532ff62780fc\") " Jun 09 12:41:12.095601 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:12.095551 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78846405-7568-4f6b-b12b-532ff62780fc-bundle" (OuterVolumeSpecName: "bundle") pod "78846405-7568-4f6b-b12b-532ff62780fc" (UID: "78846405-7568-4f6b-b12b-532ff62780fc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:41:12.096607 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:12.096585 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78846405-7568-4f6b-b12b-532ff62780fc-kube-api-access-8bsdt" (OuterVolumeSpecName: "kube-api-access-8bsdt") pod "78846405-7568-4f6b-b12b-532ff62780fc" (UID: "78846405-7568-4f6b-b12b-532ff62780fc"). InnerVolumeSpecName "kube-api-access-8bsdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:41:12.100486 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:12.100409 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78846405-7568-4f6b-b12b-532ff62780fc-util" (OuterVolumeSpecName: "util") pod "78846405-7568-4f6b-b12b-532ff62780fc" (UID: "78846405-7568-4f6b-b12b-532ff62780fc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:41:12.195844 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:12.195803 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78846405-7568-4f6b-b12b-532ff62780fc-bundle\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:41:12.195844 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:12.195836 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78846405-7568-4f6b-b12b-532ff62780fc-util\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:41:12.195844 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:12.195845 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bsdt\" (UniqueName: \"kubernetes.io/projected/78846405-7568-4f6b-b12b-532ff62780fc-kube-api-access-8bsdt\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:41:12.819483 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:12.819454 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" event={"ID":"78846405-7568-4f6b-b12b-532ff62780fc","Type":"ContainerDied","Data":"98d9145e9e2aec10e8fcf36983ccbfcd0d791396b61c5a20a66a316bc98c23da"} Jun 09 12:41:12.819612 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:12.819486 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06nns9w" Jun 09 12:41:12.819612 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:12.819498 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98d9145e9e2aec10e8fcf36983ccbfcd0d791396b61c5a20a66a316bc98c23da" Jun 09 12:41:14.219626 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.219593 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:14.364774 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.364744 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:14.371658 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.371625 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-gpbcm"] Jun 09 12:41:14.372428 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.372406 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78846405-7568-4f6b-b12b-532ff62780fc" containerName="pull" Jun 09 12:41:14.372576 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.372545 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="78846405-7568-4f6b-b12b-532ff62780fc" containerName="pull" Jun 09 12:41:14.372695 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.372684 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78846405-7568-4f6b-b12b-532ff62780fc" containerName="util" Jun 09 12:41:14.372771 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.372762 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="78846405-7568-4f6b-b12b-532ff62780fc" containerName="util" Jun 09 12:41:14.372888 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.372877 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78846405-7568-4f6b-b12b-532ff62780fc" containerName="extract" Jun 09 12:41:14.372977 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.372968 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="78846405-7568-4f6b-b12b-532ff62780fc" containerName="extract" Jun 09 12:41:14.373215 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.373202 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="78846405-7568-4f6b-b12b-532ff62780fc" containerName="extract" Jun 09 12:41:14.376040 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.376013 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-gpbcm" Jun 09 12:41:14.377358 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.377338 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn"] Jun 09 12:41:14.378103 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.378086 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 09 12:41:14.379086 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.379066 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bw5sd\"" Jun 09 12:41:14.379438 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.379419 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn" Jun 09 12:41:14.381142 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.381121 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-66qjk\"" Jun 09 12:41:14.381244 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.381196 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 12:41:14.395572 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.395542 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-gpbcm"] Jun 09 12:41:14.400594 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.400573 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn"] Jun 09 12:41:14.514747 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.514678 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgg4x\" (UniqueName: \"kubernetes.io/projected/dd02057b-df2e-4290-84b0-be1b40aaa115-kube-api-access-lgg4x\") pod \"llmisvc-controller-manager-864bfd7bc9-px9pn\" (UID: \"dd02057b-df2e-4290-84b0-be1b40aaa115\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn" Jun 09 12:41:14.514747 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.514725 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd02057b-df2e-4290-84b0-be1b40aaa115-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-px9pn\" (UID: \"dd02057b-df2e-4290-84b0-be1b40aaa115\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn" Jun 09 12:41:14.514747 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.514741 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20eb0956-1c38-46bf-828d-21689c5f3bf7-cert\") pod \"kserve-controller-manager-69fc866d76-gpbcm\" (UID: \"20eb0956-1c38-46bf-828d-21689c5f3bf7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-gpbcm" Jun 09 12:41:14.514980 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.514853 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s276l\" (UniqueName: \"kubernetes.io/projected/20eb0956-1c38-46bf-828d-21689c5f3bf7-kube-api-access-s276l\") pod \"kserve-controller-manager-69fc866d76-gpbcm\" (UID: \"20eb0956-1c38-46bf-828d-21689c5f3bf7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-gpbcm" Jun 09 12:41:14.615333 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.615304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s276l\" (UniqueName: \"kubernetes.io/projected/20eb0956-1c38-46bf-828d-21689c5f3bf7-kube-api-access-s276l\") pod \"kserve-controller-manager-69fc866d76-gpbcm\" (UID: \"20eb0956-1c38-46bf-828d-21689c5f3bf7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-gpbcm" Jun 09 12:41:14.615443 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.615349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgg4x\" (UniqueName: \"kubernetes.io/projected/dd02057b-df2e-4290-84b0-be1b40aaa115-kube-api-access-lgg4x\") pod \"llmisvc-controller-manager-864bfd7bc9-px9pn\" (UID: \"dd02057b-df2e-4290-84b0-be1b40aaa115\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn" Jun 09 12:41:14.615443 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.615380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd02057b-df2e-4290-84b0-be1b40aaa115-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-px9pn\" (UID: \"dd02057b-df2e-4290-84b0-be1b40aaa115\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn" Jun 09 12:41:14.615443 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.615395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20eb0956-1c38-46bf-828d-21689c5f3bf7-cert\") pod \"kserve-controller-manager-69fc866d76-gpbcm\" (UID: \"20eb0956-1c38-46bf-828d-21689c5f3bf7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-gpbcm" Jun 09 12:41:14.615553 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:41:14.615479 2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 09 12:41:14.615553 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:41:14.615530 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20eb0956-1c38-46bf-828d-21689c5f3bf7-cert podName:20eb0956-1c38-46bf-828d-21689c5f3bf7 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:15.115514776 +0000 UTC m=+572.813001683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/20eb0956-1c38-46bf-828d-21689c5f3bf7-cert") pod "kserve-controller-manager-69fc866d76-gpbcm" (UID: "20eb0956-1c38-46bf-828d-21689c5f3bf7") : secret "kserve-webhook-server-cert" not found Jun 09 12:41:14.615553 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:41:14.615530 2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 09 12:41:14.615713 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:41:14.615620 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd02057b-df2e-4290-84b0-be1b40aaa115-cert podName:dd02057b-df2e-4290-84b0-be1b40aaa115 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:15.115603163 +0000 UTC m=+572.813090081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dd02057b-df2e-4290-84b0-be1b40aaa115-cert") pod "llmisvc-controller-manager-864bfd7bc9-px9pn" (UID: "dd02057b-df2e-4290-84b0-be1b40aaa115") : secret "llmisvc-webhook-server-cert" not found Jun 09 12:41:14.630919 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.630893 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s276l\" (UniqueName: \"kubernetes.io/projected/20eb0956-1c38-46bf-828d-21689c5f3bf7-kube-api-access-s276l\") pod \"kserve-controller-manager-69fc866d76-gpbcm\" (UID: \"20eb0956-1c38-46bf-828d-21689c5f3bf7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-gpbcm" Jun 09 12:41:14.631011 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.630961 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgg4x\" (UniqueName: \"kubernetes.io/projected/dd02057b-df2e-4290-84b0-be1b40aaa115-kube-api-access-lgg4x\") pod \"llmisvc-controller-manager-864bfd7bc9-px9pn\" (UID: \"dd02057b-df2e-4290-84b0-be1b40aaa115\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn" Jun 09 12:41:14.789756 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:14.789673 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:15.010896 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:15.010862 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:15.120303 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:15.120221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd02057b-df2e-4290-84b0-be1b40aaa115-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-px9pn\" (UID: \"dd02057b-df2e-4290-84b0-be1b40aaa115\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn" Jun 09 12:41:15.120303 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:15.120258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20eb0956-1c38-46bf-828d-21689c5f3bf7-cert\") pod \"kserve-controller-manager-69fc866d76-gpbcm\" (UID: \"20eb0956-1c38-46bf-828d-21689c5f3bf7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-gpbcm" Jun 09 12:41:15.122603 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:15.122581 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dd02057b-df2e-4290-84b0-be1b40aaa115-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-px9pn\" (UID: \"dd02057b-df2e-4290-84b0-be1b40aaa115\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn" Jun 09 12:41:15.122700 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:15.122581 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20eb0956-1c38-46bf-828d-21689c5f3bf7-cert\") pod \"kserve-controller-manager-69fc866d76-gpbcm\" (UID: \"20eb0956-1c38-46bf-828d-21689c5f3bf7\") " pod="opendatahub/kserve-controller-manager-69fc866d76-gpbcm" Jun 09 12:41:15.286917 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:15.286875 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-gpbcm" Jun 09 12:41:15.292192 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:15.292175 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn" Jun 09 12:41:15.443087 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:15.443064 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-gpbcm"] Jun 09 12:41:15.443545 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:41:15.443526 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20eb0956_1c38_46bf_828d_21689c5f3bf7.slice/crio-e72ce3dab19d1274d83f6241be5ce257ce24121b8bfa0f11f685789456541b73 WatchSource:0}: Error finding container e72ce3dab19d1274d83f6241be5ce257ce24121b8bfa0f11f685789456541b73: Status 404 returned error can't find the container with id e72ce3dab19d1274d83f6241be5ce257ce24121b8bfa0f11f685789456541b73 Jun 09 12:41:15.461875 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:15.461854 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn"] Jun 09 12:41:15.463297 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:41:15.463273 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddd02057b_df2e_4290_84b0_be1b40aaa115.slice/crio-bb29e55f8a054ab2e2c72693ee6c19943cc685fa791768f07b865ce8b9407f76 WatchSource:0}: Error finding container bb29e55f8a054ab2e2c72693ee6c19943cc685fa791768f07b865ce8b9407f76: Status 404 returned error can't find the container with id bb29e55f8a054ab2e2c72693ee6c19943cc685fa791768f07b865ce8b9407f76 Jun 09 12:41:15.635869 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:15.635778 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:15.808966 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:15.808938 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:15.834001 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:15.833974 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-gpbcm" event={"ID":"20eb0956-1c38-46bf-828d-21689c5f3bf7","Type":"ContainerStarted","Data":"e72ce3dab19d1274d83f6241be5ce257ce24121b8bfa0f11f685789456541b73"} Jun 09 12:41:15.835105 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:15.835084 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn" event={"ID":"dd02057b-df2e-4290-84b0-be1b40aaa115","Type":"ContainerStarted","Data":"bb29e55f8a054ab2e2c72693ee6c19943cc685fa791768f07b865ce8b9407f76"} Jun 09 12:41:18.798199 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:18.798168 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-bk9pc" Jun 09 12:41:19.409995 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:19.409960 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:19.579097 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:19.579066 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:19.857464 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:19.857423 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-gpbcm" event={"ID":"20eb0956-1c38-46bf-828d-21689c5f3bf7","Type":"ContainerStarted","Data":"b2bfd654f9f28d89af2c1848d872587828abf98dc16a0b7b9061655c9aab72bb"} Jun 09 12:41:19.857906 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:19.857578 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-gpbcm" Jun 09 12:41:19.858939 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:19.858915 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn" event={"ID":"dd02057b-df2e-4290-84b0-be1b40aaa115","Type":"ContainerStarted","Data":"b671e668fec90d8214c42a0741113544733c7d3137dd689f83c65aa997cfd5d3"} Jun 09 12:41:19.859019 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:19.858969 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn" Jun 09 12:41:20.030518 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.030464 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn" podStartSLOduration=2.577356278 podStartE2EDuration="6.030447461s" totalImagesPullingTime="3.453091183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:20.029066555 +0000 UTC m=+577.726553484" watchObservedRunningTime="2026-06-09 12:41:20.030447461 +0000 UTC m=+577.727934406" Jun 09 12:41:20.031774 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.031733 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-gpbcm" podStartSLOduration=2.558343807 podStartE2EDuration="6.031719508s" totalImagesPullingTime="3.473375701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:19.970137629 +0000 UTC m=+577.667624559" watchObservedRunningTime="2026-06-09 12:41:20.031719508 +0000 UTC m=+577.729206440" Jun 09 12:41:20.686983 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.686952 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt"] Jun 09 12:41:20.689525 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.689507 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" Jun 09 12:41:20.694068 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.694047 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:41:20.694474 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.694453 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:41:20.694474 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.694461 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xckbn\"" Jun 09 12:41:20.731429 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.731402 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt"] Jun 09 12:41:20.812461 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.812432 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-r68d8" Jun 09 12:41:20.866384 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.866353 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3354352-e9d7-486f-912b-dfacd93cfa9d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt\" (UID: \"d3354352-e9d7-486f-912b-dfacd93cfa9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" Jun 09 12:41:20.866734 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.866399 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbg8d\" (UniqueName: \"kubernetes.io/projected/d3354352-e9d7-486f-912b-dfacd93cfa9d-kube-api-access-pbg8d\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt\" (UID: \"d3354352-e9d7-486f-912b-dfacd93cfa9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" Jun 09 12:41:20.866734 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.866475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3354352-e9d7-486f-912b-dfacd93cfa9d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt\" (UID: \"d3354352-e9d7-486f-912b-dfacd93cfa9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" Jun 09 12:41:20.967333 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.967303 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbg8d\" (UniqueName: \"kubernetes.io/projected/d3354352-e9d7-486f-912b-dfacd93cfa9d-kube-api-access-pbg8d\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt\" (UID: \"d3354352-e9d7-486f-912b-dfacd93cfa9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" Jun 09 12:41:20.967509 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.967377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3354352-e9d7-486f-912b-dfacd93cfa9d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt\" (UID: \"d3354352-e9d7-486f-912b-dfacd93cfa9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" Jun 09 12:41:20.967791 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.967768 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3354352-e9d7-486f-912b-dfacd93cfa9d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt\" (UID: \"d3354352-e9d7-486f-912b-dfacd93cfa9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" Jun 09 12:41:20.967883 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.967776 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3354352-e9d7-486f-912b-dfacd93cfa9d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt\" (UID: \"d3354352-e9d7-486f-912b-dfacd93cfa9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" Jun 09 12:41:20.968067 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:20.968047 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3354352-e9d7-486f-912b-dfacd93cfa9d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt\" (UID: \"d3354352-e9d7-486f-912b-dfacd93cfa9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" Jun 09 12:41:21.063713 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:21.063675 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbg8d\" (UniqueName: \"kubernetes.io/projected/d3354352-e9d7-486f-912b-dfacd93cfa9d-kube-api-access-pbg8d\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt\" (UID: \"d3354352-e9d7-486f-912b-dfacd93cfa9d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" Jun 09 12:41:21.298932 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:21.298858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" Jun 09 12:41:21.462161 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:41:21.462132 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3354352_e9d7_486f_912b_dfacd93cfa9d.slice/crio-8654aaf7a7659a5d8baab3eb8b47b3f62b57a6248071307002a1fbdb3dcc6632 WatchSource:0}: Error finding container 8654aaf7a7659a5d8baab3eb8b47b3f62b57a6248071307002a1fbdb3dcc6632: Status 404 returned error can't find the container with id 8654aaf7a7659a5d8baab3eb8b47b3f62b57a6248071307002a1fbdb3dcc6632 Jun 09 12:41:21.463174 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:21.463146 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt"] Jun 09 12:41:21.596407 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:21.596377 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:21.855587 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:21.855492 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:21.870199 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:21.870171 2564 generic.go:356] "Generic (PLEG): container finished" podID="d3354352-e9d7-486f-912b-dfacd93cfa9d" containerID="3f80fa0a7482bc6f7290d323db11be1ad7d4242cf89fa708d0b29a118568eae4" exitCode=0 Jun 09 12:41:21.870539 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:21.870204 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" event={"ID":"d3354352-e9d7-486f-912b-dfacd93cfa9d","Type":"ContainerDied","Data":"3f80fa0a7482bc6f7290d323db11be1ad7d4242cf89fa708d0b29a118568eae4"} Jun 09 12:41:21.870539 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:21.870238 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" event={"ID":"d3354352-e9d7-486f-912b-dfacd93cfa9d","Type":"ContainerStarted","Data":"8654aaf7a7659a5d8baab3eb8b47b3f62b57a6248071307002a1fbdb3dcc6632"} Jun 09 12:41:22.052984 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:22.052956 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:22.160912 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:22.160836 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:22.617381 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:22.617337 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:22.876198 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:22.876101 2564 generic.go:356] "Generic (PLEG): container finished" podID="d3354352-e9d7-486f-912b-dfacd93cfa9d" containerID="48514ae176d2e845e000e0f89870f7d67b61565c994117f9284b1e30868a9a55" exitCode=0 Jun 09 12:41:22.876198 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:22.876135 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" event={"ID":"d3354352-e9d7-486f-912b-dfacd93cfa9d","Type":"ContainerDied","Data":"48514ae176d2e845e000e0f89870f7d67b61565c994117f9284b1e30868a9a55"} Jun 09 12:41:23.883521 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:23.883481 2564 generic.go:356] "Generic (PLEG): container finished" podID="d3354352-e9d7-486f-912b-dfacd93cfa9d" containerID="48a2fc6744aead2c565425fda745ed95459fb7e66b2da855af43a7e0d1f90a62" exitCode=0 Jun 09 12:41:23.883901 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:23.883550 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" event={"ID":"d3354352-e9d7-486f-912b-dfacd93cfa9d","Type":"ContainerDied","Data":"48a2fc6744aead2c565425fda745ed95459fb7e66b2da855af43a7e0d1f90a62"} Jun 09 12:41:24.104131 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.104094 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5"] Jun 09 12:41:24.106331 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.106311 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5" Jun 09 12:41:24.110514 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.110493 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 12:41:24.110893 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.110875 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 12:41:24.110983 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.110964 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-pbh2t\"" Jun 09 12:41:24.145782 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.145723 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5"] Jun 09 12:41:24.196518 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.196486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h49xx\" (UniqueName: \"kubernetes.io/projected/1e56c1db-f9ff-471d-9986-75248dcb0460-kube-api-access-h49xx\") pod \"servicemesh-operator3-57f65f65fb-x8tc5\" (UID: \"1e56c1db-f9ff-471d-9986-75248dcb0460\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5" Jun 09 12:41:24.196669 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.196539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1e56c1db-f9ff-471d-9986-75248dcb0460-operator-config\") pod \"servicemesh-operator3-57f65f65fb-x8tc5\" (UID: \"1e56c1db-f9ff-471d-9986-75248dcb0460\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5" Jun 09 12:41:24.297276 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.297247 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h49xx\" (UniqueName: \"kubernetes.io/projected/1e56c1db-f9ff-471d-9986-75248dcb0460-kube-api-access-h49xx\") pod \"servicemesh-operator3-57f65f65fb-x8tc5\" (UID: \"1e56c1db-f9ff-471d-9986-75248dcb0460\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5" Jun 09 12:41:24.297386 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.297290 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1e56c1db-f9ff-471d-9986-75248dcb0460-operator-config\") pod \"servicemesh-operator3-57f65f65fb-x8tc5\" (UID: \"1e56c1db-f9ff-471d-9986-75248dcb0460\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5" Jun 09 12:41:24.299732 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.299714 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1e56c1db-f9ff-471d-9986-75248dcb0460-operator-config\") pod \"servicemesh-operator3-57f65f65fb-x8tc5\" (UID: \"1e56c1db-f9ff-471d-9986-75248dcb0460\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5" Jun 09 12:41:24.314186 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.314157 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h49xx\" (UniqueName: \"kubernetes.io/projected/1e56c1db-f9ff-471d-9986-75248dcb0460-kube-api-access-h49xx\") pod \"servicemesh-operator3-57f65f65fb-x8tc5\" (UID: \"1e56c1db-f9ff-471d-9986-75248dcb0460\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5" Jun 09 12:41:24.415909 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.415831 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5" Jun 09 12:41:24.561993 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.561971 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5"] Jun 09 12:41:24.563530 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:41:24.563496 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e56c1db_f9ff_471d_9986_75248dcb0460.slice/crio-a8d01cfc89dcda8692863dcfe96f9572d8b28c6b8faa661a4a3db4a6bcdade89 WatchSource:0}: Error finding container a8d01cfc89dcda8692863dcfe96f9572d8b28c6b8faa661a4a3db4a6bcdade89: Status 404 returned error can't find the container with id a8d01cfc89dcda8692863dcfe96f9572d8b28c6b8faa661a4a3db4a6bcdade89 Jun 09 12:41:24.889129 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:24.889091 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5" event={"ID":"1e56c1db-f9ff-471d-9986-75248dcb0460","Type":"ContainerStarted","Data":"a8d01cfc89dcda8692863dcfe96f9572d8b28c6b8faa661a4a3db4a6bcdade89"} Jun 09 12:41:25.001059 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:25.001036 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" Jun 09 12:41:25.103460 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:25.103428 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3354352-e9d7-486f-912b-dfacd93cfa9d-util\") pod \"d3354352-e9d7-486f-912b-dfacd93cfa9d\" (UID: \"d3354352-e9d7-486f-912b-dfacd93cfa9d\") " Jun 09 12:41:25.103460 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:25.103463 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3354352-e9d7-486f-912b-dfacd93cfa9d-bundle\") pod \"d3354352-e9d7-486f-912b-dfacd93cfa9d\" (UID: \"d3354352-e9d7-486f-912b-dfacd93cfa9d\") " Jun 09 12:41:25.103717 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:25.103510 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbg8d\" (UniqueName: \"kubernetes.io/projected/d3354352-e9d7-486f-912b-dfacd93cfa9d-kube-api-access-pbg8d\") pod \"d3354352-e9d7-486f-912b-dfacd93cfa9d\" (UID: \"d3354352-e9d7-486f-912b-dfacd93cfa9d\") " Jun 09 12:41:25.104408 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:25.104377 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3354352-e9d7-486f-912b-dfacd93cfa9d-bundle" (OuterVolumeSpecName: "bundle") pod "d3354352-e9d7-486f-912b-dfacd93cfa9d" (UID: "d3354352-e9d7-486f-912b-dfacd93cfa9d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:41:25.105665 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:25.105642 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3354352-e9d7-486f-912b-dfacd93cfa9d-kube-api-access-pbg8d" (OuterVolumeSpecName: "kube-api-access-pbg8d") pod "d3354352-e9d7-486f-912b-dfacd93cfa9d" (UID: "d3354352-e9d7-486f-912b-dfacd93cfa9d"). InnerVolumeSpecName "kube-api-access-pbg8d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:41:25.109129 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:25.109108 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3354352-e9d7-486f-912b-dfacd93cfa9d-util" (OuterVolumeSpecName: "util") pod "d3354352-e9d7-486f-912b-dfacd93cfa9d" (UID: "d3354352-e9d7-486f-912b-dfacd93cfa9d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:41:25.204438 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:25.204416 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3354352-e9d7-486f-912b-dfacd93cfa9d-util\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:41:25.204438 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:25.204439 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3354352-e9d7-486f-912b-dfacd93cfa9d-bundle\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:41:25.204598 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:25.204448 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbg8d\" (UniqueName: \"kubernetes.io/projected/d3354352-e9d7-486f-912b-dfacd93cfa9d-kube-api-access-pbg8d\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:41:25.898208 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:25.898167 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" event={"ID":"d3354352-e9d7-486f-912b-dfacd93cfa9d","Type":"ContainerDied","Data":"8654aaf7a7659a5d8baab3eb8b47b3f62b57a6248071307002a1fbdb3dcc6632"} Jun 09 12:41:25.898660 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:25.898229 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8654aaf7a7659a5d8baab3eb8b47b3f62b57a6248071307002a1fbdb3dcc6632" Jun 09 12:41:25.898660 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:25.898315 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2r6kt" Jun 09 12:41:27.911052 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:27.911016 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5" event={"ID":"1e56c1db-f9ff-471d-9986-75248dcb0460","Type":"ContainerStarted","Data":"216ef0d2b49ba6c5698a3795c3e1d26c8556124e580ce8ae38a920451a487e51"} Jun 09 12:41:27.911463 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:27.911146 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5" Jun 09 12:41:27.939049 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:27.939000 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5" podStartSLOduration=1.203434591 podStartE2EDuration="3.938986344s" totalImagesPullingTime="2.735551753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:27.93512278 +0000 UTC m=+585.632609711" watchObservedRunningTime="2026-06-09 12:41:27.938986344 +0000 UTC m=+585.636473274" Jun 09 12:41:31.491827 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:31.491792 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:31.644554 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:31.644521 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:32.245258 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.245225 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5fd759c44c-szmnv"] Jun 09 12:41:32.245688 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.245660 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3354352-e9d7-486f-912b-dfacd93cfa9d" containerName="extract" Jun 09 12:41:32.245688 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.245691 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3354352-e9d7-486f-912b-dfacd93cfa9d" containerName="extract" Jun 09 12:41:32.245832 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.245704 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3354352-e9d7-486f-912b-dfacd93cfa9d" containerName="pull" Jun 09 12:41:32.245832 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.245713 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3354352-e9d7-486f-912b-dfacd93cfa9d" containerName="pull" Jun 09 12:41:32.245832 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.245731 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3354352-e9d7-486f-912b-dfacd93cfa9d" containerName="util" Jun 09 12:41:32.245832 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.245741 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3354352-e9d7-486f-912b-dfacd93cfa9d" containerName="util" Jun 09 12:41:32.246042 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.245845 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3354352-e9d7-486f-912b-dfacd93cfa9d" containerName="extract" Jun 09 12:41:32.248216 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.248195 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5fd759c44c-szmnv" Jun 09 12:41:32.250613 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.250595 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rbmrz\"" Jun 09 12:41:32.250946 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.250627 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 12:41:32.261496 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.261475 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5fd759c44c-szmnv"] Jun 09 12:41:32.293218 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.293172 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:32.364096 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.364070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6pfw\" (UniqueName: \"kubernetes.io/projected/6d4c6224-ff1a-4b15-813b-40d6cbd4b286-kube-api-access-k6pfw\") pod \"dashboard-redirect-5fd759c44c-szmnv\" (UID: \"6d4c6224-ff1a-4b15-813b-40d6cbd4b286\") " pod="opendatahub/dashboard-redirect-5fd759c44c-szmnv" Jun 09 12:41:32.364236 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.364129 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6d4c6224-ff1a-4b15-813b-40d6cbd4b286-redirect-config\") pod \"dashboard-redirect-5fd759c44c-szmnv\" (UID: \"6d4c6224-ff1a-4b15-813b-40d6cbd4b286\") " pod="opendatahub/dashboard-redirect-5fd759c44c-szmnv" Jun 09 12:41:32.465531 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.465492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6pfw\" (UniqueName: \"kubernetes.io/projected/6d4c6224-ff1a-4b15-813b-40d6cbd4b286-kube-api-access-k6pfw\") pod \"dashboard-redirect-5fd759c44c-szmnv\" (UID: \"6d4c6224-ff1a-4b15-813b-40d6cbd4b286\") " pod="opendatahub/dashboard-redirect-5fd759c44c-szmnv" Jun 09 12:41:32.465693 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.465581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6d4c6224-ff1a-4b15-813b-40d6cbd4b286-redirect-config\") pod \"dashboard-redirect-5fd759c44c-szmnv\" (UID: \"6d4c6224-ff1a-4b15-813b-40d6cbd4b286\") " pod="opendatahub/dashboard-redirect-5fd759c44c-szmnv" Jun 09 12:41:32.466231 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.466212 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6d4c6224-ff1a-4b15-813b-40d6cbd4b286-redirect-config\") pod \"dashboard-redirect-5fd759c44c-szmnv\" (UID: \"6d4c6224-ff1a-4b15-813b-40d6cbd4b286\") " pod="opendatahub/dashboard-redirect-5fd759c44c-szmnv" Jun 09 12:41:32.474775 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.474748 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6pfw\" (UniqueName: \"kubernetes.io/projected/6d4c6224-ff1a-4b15-813b-40d6cbd4b286-kube-api-access-k6pfw\") pod \"dashboard-redirect-5fd759c44c-szmnv\" (UID: \"6d4c6224-ff1a-4b15-813b-40d6cbd4b286\") " pod="opendatahub/dashboard-redirect-5fd759c44c-szmnv" Jun 09 12:41:32.560686 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.560625 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5fd759c44c-szmnv" Jun 09 12:41:32.644767 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.644740 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:32.701002 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:41:32.700957 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4c6224_ff1a_4b15_813b_40d6cbd4b286.slice/crio-fcb0c586560ff2f10e3b839af8e62e6340dad38ecac16b53f01dbed465a33a83 WatchSource:0}: Error finding container fcb0c586560ff2f10e3b839af8e62e6340dad38ecac16b53f01dbed465a33a83: Status 404 returned error can't find the container with id fcb0c586560ff2f10e3b839af8e62e6340dad38ecac16b53f01dbed465a33a83 Jun 09 12:41:32.701669 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.701526 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5fd759c44c-szmnv"] Jun 09 12:41:32.734086 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.734058 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:32.940413 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:32.940318 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5fd759c44c-szmnv" event={"ID":"6d4c6224-ff1a-4b15-813b-40d6cbd4b286","Type":"ContainerStarted","Data":"fcb0c586560ff2f10e3b839af8e62e6340dad38ecac16b53f01dbed465a33a83"} Jun 09 12:41:36.964048 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:36.964015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5fd759c44c-szmnv" event={"ID":"6d4c6224-ff1a-4b15-813b-40d6cbd4b286","Type":"ContainerStarted","Data":"1ec56b685e6b5f391a6ab73d32999e6e414e3c872fd86f4fead9bf19a122ae08"} Jun 09 12:41:38.918593 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:38.918548 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-x8tc5" Jun 09 12:41:38.942115 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:38.942065 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5fd759c44c-szmnv" podStartSLOduration=3.360602684 podStartE2EDuration="6.942049541s" totalImagesPullingTime="3.581446857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:36.993722146 +0000 UTC m=+594.691209075" watchObservedRunningTime="2026-06-09 12:41:38.942049541 +0000 UTC m=+596.639536467" Jun 09 12:41:42.751140 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:42.751107 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/2.log" Jun 09 12:41:42.751588 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:42.751400 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/2.log" Jun 09 12:41:42.756205 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:42.756173 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgb8g_593b1faa-5b02-4e90-b05c-d3b4724e8de9/ovn-acl-logging/0.log" Jun 09 12:41:42.756369 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:42.756353 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgb8g_593b1faa-5b02-4e90-b05c-d3b4724e8de9/ovn-acl-logging/0.log" Jun 09 12:41:48.640833 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.640792 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:48.646179 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.646155 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t"] Jun 09 12:41:48.648310 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.648295 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.650478 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.650463 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 12:41:48.650610 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.650537 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 12:41:48.650610 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.650537 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 12:41:48.650793 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.650779 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tlsrb\"" Jun 09 12:41:48.650859 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.650783 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 12:41:48.661892 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.661865 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t"] Jun 09 12:41:48.688361 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.688325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.688508 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.688377 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.688508 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.688404 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.688508 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.688463 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.688508 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.688500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87psg\" (UniqueName: \"kubernetes.io/projected/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-kube-api-access-87psg\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.688781 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.688527 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.688781 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.688574 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.741713 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.741686 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:48.789354 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.789314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.789472 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.789366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.789472 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.789396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.789472 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.789453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.789637 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.789484 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87psg\" (UniqueName: \"kubernetes.io/projected/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-kube-api-access-87psg\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.789637 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.789511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.789637 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.789536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.790257 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.790232 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.791850 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.791828 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.791956 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.791870 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.791956 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.791879 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.791956 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.791942 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.797418 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.797398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87psg\" (UniqueName: \"kubernetes.io/projected/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-kube-api-access-87psg\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.797897 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.797867 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06469d4b-c49c-4ecd-bb8b-d2d49a516bd4-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-rfc9t\" (UID: \"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:48.957546 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:48.957517 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:49.095388 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:49.095350 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t"] Jun 09 12:41:49.096549 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:41:49.096510 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06469d4b_c49c_4ecd_bb8b_d2d49a516bd4.slice/crio-4cb4d0959cda4e8f545e47535e7d4d1c32f53d83fabf7b11609c39f26d44ceb2 WatchSource:0}: Error finding container 4cb4d0959cda4e8f545e47535e7d4d1c32f53d83fabf7b11609c39f26d44ceb2: Status 404 returned error can't find the container with id 4cb4d0959cda4e8f545e47535e7d4d1c32f53d83fabf7b11609c39f26d44ceb2 Jun 09 12:41:49.223893 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:49.223800 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:50.039002 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:50.038890 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" event={"ID":"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4","Type":"ContainerStarted","Data":"4cb4d0959cda4e8f545e47535e7d4d1c32f53d83fabf7b11609c39f26d44ceb2"} Jun 09 12:41:50.866907 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:50.866867 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-px9pn" Jun 09 12:41:50.870294 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:50.870271 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-gpbcm" Jun 09 12:41:51.541331 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:51.541274 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 12:41:51.541621 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:51.541369 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 12:41:52.055530 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:52.055495 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" event={"ID":"06469d4b-c49c-4ecd-bb8b-d2d49a516bd4","Type":"ContainerStarted","Data":"ca02f5b630abac3d5d49fe0dd07dd5c1f9bf6c10cc0f48a9eaa5d0a6cbbb4c38"} Jun 09 12:41:52.055745 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:52.055692 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:52.057623 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:52.057597 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-rfc9t container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 09 12:41:52.057743 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:52.057651 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" podUID="06469d4b-c49c-4ecd-bb8b-d2d49a516bd4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:41:52.079855 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:52.079805 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" podStartSLOduration=1.637595007 podStartE2EDuration="4.079787659s" totalImagesPullingTime="2.442192652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:52.078199408 +0000 UTC m=+609.775686337" watchObservedRunningTime="2026-06-09 12:41:52.079787659 +0000 UTC m=+609.777274591" Jun 09 12:41:52.351905 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:52.351801 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:52.452745 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:52.452711 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:52.677188 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:52.677111 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:52.831221 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:52.831189 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:53.060451 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:53.060424 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-rfc9t" Jun 09 12:41:53.149645 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:53.149612 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:41:53.269060 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:41:53.269031 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:02.908834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:02.908801 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:03.004109 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:03.004074 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:03.113834 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:03.113771 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:03.827155 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:03.827124 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:04.032869 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:04.032840 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:17.910812 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:17.910776 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-686b498c4f-fgxqp"] Jun 09 12:42:17.922133 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:17.922102 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:17.925288 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:17.925260 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686b498c4f-fgxqp"] Jun 09 12:42:17.979813 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:17.979772 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:18.042675 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.042646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/922082cb-572a-43de-b90e-6fd0f41253fe-service-ca\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.042818 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.042682 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/922082cb-572a-43de-b90e-6fd0f41253fe-trusted-ca-bundle\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.042818 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.042712 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skvqm\" (UniqueName: \"kubernetes.io/projected/922082cb-572a-43de-b90e-6fd0f41253fe-kube-api-access-skvqm\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.042818 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.042732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/922082cb-572a-43de-b90e-6fd0f41253fe-oauth-serving-cert\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.042818 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.042801 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/922082cb-572a-43de-b90e-6fd0f41253fe-console-serving-cert\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.042984 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.042844 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/922082cb-572a-43de-b90e-6fd0f41253fe-console-config\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.042984 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.042866 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/922082cb-572a-43de-b90e-6fd0f41253fe-console-oauth-config\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.143972 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.143930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/922082cb-572a-43de-b90e-6fd0f41253fe-service-ca\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.143972 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.143973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/922082cb-572a-43de-b90e-6fd0f41253fe-trusted-ca-bundle\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.144205 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.144001 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvqm\" (UniqueName: \"kubernetes.io/projected/922082cb-572a-43de-b90e-6fd0f41253fe-kube-api-access-skvqm\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.144205 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.144022 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/922082cb-572a-43de-b90e-6fd0f41253fe-oauth-serving-cert\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.144205 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.144048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/922082cb-572a-43de-b90e-6fd0f41253fe-console-serving-cert\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.144205 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.144074 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/922082cb-572a-43de-b90e-6fd0f41253fe-console-config\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.144205 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.144099 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/922082cb-572a-43de-b90e-6fd0f41253fe-console-oauth-config\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.144873 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.144837 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/922082cb-572a-43de-b90e-6fd0f41253fe-service-ca\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.144873 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.144861 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/922082cb-572a-43de-b90e-6fd0f41253fe-oauth-serving-cert\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.145094 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.144861 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/922082cb-572a-43de-b90e-6fd0f41253fe-console-config\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.145094 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.145003 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/922082cb-572a-43de-b90e-6fd0f41253fe-trusted-ca-bundle\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.146659 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.146643 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/922082cb-572a-43de-b90e-6fd0f41253fe-console-serving-cert\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.146796 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.146777 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/922082cb-572a-43de-b90e-6fd0f41253fe-console-oauth-config\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.152910 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.152889 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skvqm\" (UniqueName: \"kubernetes.io/projected/922082cb-572a-43de-b90e-6fd0f41253fe-kube-api-access-skvqm\") pod \"console-686b498c4f-fgxqp\" (UID: \"922082cb-572a-43de-b90e-6fd0f41253fe\") " pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.233531 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.233501 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:18.369196 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.369170 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686b498c4f-fgxqp"] Jun 09 12:42:18.371746 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:42:18.371720 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922082cb_572a_43de_b90e_6fd0f41253fe.slice/crio-651e49c91c53f8ecd70805f6b9a1f48764257d1b6bc7263eef30262fa79ab103 WatchSource:0}: Error finding container 651e49c91c53f8ecd70805f6b9a1f48764257d1b6bc7263eef30262fa79ab103: Status 404 returned error can't find the container with id 651e49c91c53f8ecd70805f6b9a1f48764257d1b6bc7263eef30262fa79ab103 Jun 09 12:42:18.659177 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.659078 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h"] Jun 09 12:42:18.663162 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.663145 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" Jun 09 12:42:18.665595 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.665572 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 12:42:18.665732 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.665581 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 12:42:18.665836 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.665815 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9zch8\"" Jun 09 12:42:18.672680 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.672658 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h"] Jun 09 12:42:18.849494 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.849450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xvmk\" (UniqueName: \"kubernetes.io/projected/17b62f8c-a428-4790-9822-4a158e7199e3-kube-api-access-6xvmk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h\" (UID: \"17b62f8c-a428-4790-9822-4a158e7199e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" Jun 09 12:42:18.849494 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.849505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17b62f8c-a428-4790-9822-4a158e7199e3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h\" (UID: \"17b62f8c-a428-4790-9822-4a158e7199e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" Jun 09 12:42:18.849771 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.849652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17b62f8c-a428-4790-9822-4a158e7199e3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h\" (UID: \"17b62f8c-a428-4790-9822-4a158e7199e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" Jun 09 12:42:18.955186 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.955148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17b62f8c-a428-4790-9822-4a158e7199e3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h\" (UID: \"17b62f8c-a428-4790-9822-4a158e7199e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" Jun 09 12:42:18.955647 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.955214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xvmk\" (UniqueName: \"kubernetes.io/projected/17b62f8c-a428-4790-9822-4a158e7199e3-kube-api-access-6xvmk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h\" (UID: \"17b62f8c-a428-4790-9822-4a158e7199e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" Jun 09 12:42:18.955774 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.955738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17b62f8c-a428-4790-9822-4a158e7199e3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h\" (UID: \"17b62f8c-a428-4790-9822-4a158e7199e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" Jun 09 12:42:18.955774 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.955756 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17b62f8c-a428-4790-9822-4a158e7199e3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h\" (UID: \"17b62f8c-a428-4790-9822-4a158e7199e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" Jun 09 12:42:18.956517 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.956488 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17b62f8c-a428-4790-9822-4a158e7199e3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h\" (UID: \"17b62f8c-a428-4790-9822-4a158e7199e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" Jun 09 12:42:18.963734 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.963713 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xvmk\" (UniqueName: \"kubernetes.io/projected/17b62f8c-a428-4790-9822-4a158e7199e3-kube-api-access-6xvmk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h\" (UID: \"17b62f8c-a428-4790-9822-4a158e7199e3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" Jun 09 12:42:18.972706 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:18.972678 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" Jun 09 12:42:19.106747 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:42:19.106719 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b62f8c_a428_4790_9822_4a158e7199e3.slice/crio-ea1455ab547ce8c6eab6d22ce2263752cf6735151038e1cbffd35b0b57c8d85c WatchSource:0}: Error finding container ea1455ab547ce8c6eab6d22ce2263752cf6735151038e1cbffd35b0b57c8d85c: Status 404 returned error can't find the container with id ea1455ab547ce8c6eab6d22ce2263752cf6735151038e1cbffd35b0b57c8d85c Jun 09 12:42:19.106892 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.106820 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h"] Jun 09 12:42:19.182369 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.182337 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686b498c4f-fgxqp" event={"ID":"922082cb-572a-43de-b90e-6fd0f41253fe","Type":"ContainerStarted","Data":"efa95e186cf604469976af3a95c7776539f278a170a784f856f9e96672bc5750"} Jun 09 12:42:19.182500 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.182389 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686b498c4f-fgxqp" event={"ID":"922082cb-572a-43de-b90e-6fd0f41253fe","Type":"ContainerStarted","Data":"651e49c91c53f8ecd70805f6b9a1f48764257d1b6bc7263eef30262fa79ab103"} Jun 09 12:42:19.184031 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.183963 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" event={"ID":"17b62f8c-a428-4790-9822-4a158e7199e3","Type":"ContainerStarted","Data":"5566d57988c8b6f8c9bf823baacf7ae3d72e6865e6e60d45fc1a0890db530ca5"} Jun 09 12:42:19.184165 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.184050 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" event={"ID":"17b62f8c-a428-4790-9822-4a158e7199e3","Type":"ContainerStarted","Data":"ea1455ab547ce8c6eab6d22ce2263752cf6735151038e1cbffd35b0b57c8d85c"} Jun 09 12:42:19.203204 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.203161 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-686b498c4f-fgxqp" podStartSLOduration=2.203146979 podStartE2EDuration="2.203146979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:19.2018024 +0000 UTC m=+636.899289349" watchObservedRunningTime="2026-06-09 12:42:19.203146979 +0000 UTC m=+636.900633907" Jun 09 12:42:19.255019 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.254985 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk"] Jun 09 12:42:19.258484 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.258460 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" Jun 09 12:42:19.268228 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.268202 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk"] Jun 09 12:42:19.360187 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.360161 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk4wb\" (UniqueName: \"kubernetes.io/projected/2101c40a-06eb-480c-9131-6ee2af793732-kube-api-access-hk4wb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk\" (UID: \"2101c40a-06eb-480c-9131-6ee2af793732\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" Jun 09 12:42:19.360334 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.360298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2101c40a-06eb-480c-9131-6ee2af793732-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk\" (UID: \"2101c40a-06eb-480c-9131-6ee2af793732\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" Jun 09 12:42:19.360436 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.360383 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2101c40a-06eb-480c-9131-6ee2af793732-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk\" (UID: \"2101c40a-06eb-480c-9131-6ee2af793732\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" Jun 09 12:42:19.461016 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.460944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2101c40a-06eb-480c-9131-6ee2af793732-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk\" (UID: \"2101c40a-06eb-480c-9131-6ee2af793732\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" Jun 09 12:42:19.461016 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.460987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2101c40a-06eb-480c-9131-6ee2af793732-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk\" (UID: \"2101c40a-06eb-480c-9131-6ee2af793732\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" Jun 09 12:42:19.461163 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.461026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk4wb\" (UniqueName: \"kubernetes.io/projected/2101c40a-06eb-480c-9131-6ee2af793732-kube-api-access-hk4wb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk\" (UID: \"2101c40a-06eb-480c-9131-6ee2af793732\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" Jun 09 12:42:19.461387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.461363 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2101c40a-06eb-480c-9131-6ee2af793732-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk\" (UID: \"2101c40a-06eb-480c-9131-6ee2af793732\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" Jun 09 12:42:19.461421 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.461396 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2101c40a-06eb-480c-9131-6ee2af793732-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk\" (UID: \"2101c40a-06eb-480c-9131-6ee2af793732\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" Jun 09 12:42:19.469069 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.469045 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk4wb\" (UniqueName: \"kubernetes.io/projected/2101c40a-06eb-480c-9131-6ee2af793732-kube-api-access-hk4wb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk\" (UID: \"2101c40a-06eb-480c-9131-6ee2af793732\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" Jun 09 12:42:19.577520 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.577485 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" Jun 09 12:42:19.641198 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.640888 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56"] Jun 09 12:42:19.644979 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.644955 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" Jun 09 12:42:19.653186 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.653164 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56"] Jun 09 12:42:19.662435 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.662389 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn6pv\" (UniqueName: \"kubernetes.io/projected/4d38359e-ce8f-4308-9adb-593d823fab31-kube-api-access-kn6pv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56\" (UID: \"4d38359e-ce8f-4308-9adb-593d823fab31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" Jun 09 12:42:19.662605 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.662462 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d38359e-ce8f-4308-9adb-593d823fab31-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56\" (UID: \"4d38359e-ce8f-4308-9adb-593d823fab31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" Jun 09 12:42:19.662605 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.662583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d38359e-ce8f-4308-9adb-593d823fab31-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56\" (UID: \"4d38359e-ce8f-4308-9adb-593d823fab31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" Jun 09 12:42:19.719504 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.719479 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk"] Jun 09 12:42:19.721051 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:42:19.721026 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2101c40a_06eb_480c_9131_6ee2af793732.slice/crio-c28067a29838b55cca9c91d6588dfd05353dcd45fcfd0df688000324191cd056 WatchSource:0}: Error finding container c28067a29838b55cca9c91d6588dfd05353dcd45fcfd0df688000324191cd056: Status 404 returned error can't find the container with id c28067a29838b55cca9c91d6588dfd05353dcd45fcfd0df688000324191cd056 Jun 09 12:42:19.763264 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.763237 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d38359e-ce8f-4308-9adb-593d823fab31-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56\" (UID: \"4d38359e-ce8f-4308-9adb-593d823fab31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" Jun 09 12:42:19.763365 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.763293 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn6pv\" (UniqueName: \"kubernetes.io/projected/4d38359e-ce8f-4308-9adb-593d823fab31-kube-api-access-kn6pv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56\" (UID: \"4d38359e-ce8f-4308-9adb-593d823fab31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" Jun 09 12:42:19.763365 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.763329 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d38359e-ce8f-4308-9adb-593d823fab31-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56\" (UID: \"4d38359e-ce8f-4308-9adb-593d823fab31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" Jun 09 12:42:19.763587 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.763553 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d38359e-ce8f-4308-9adb-593d823fab31-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56\" (UID: \"4d38359e-ce8f-4308-9adb-593d823fab31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" Jun 09 12:42:19.763666 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.763647 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d38359e-ce8f-4308-9adb-593d823fab31-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56\" (UID: \"4d38359e-ce8f-4308-9adb-593d823fab31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" Jun 09 12:42:19.771805 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.771783 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn6pv\" (UniqueName: \"kubernetes.io/projected/4d38359e-ce8f-4308-9adb-593d823fab31-kube-api-access-kn6pv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56\" (UID: \"4d38359e-ce8f-4308-9adb-593d823fab31\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" Jun 09 12:42:19.956395 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:19.956368 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" Jun 09 12:42:20.083894 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.083871 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56"] Jun 09 12:42:20.085804 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:42:20.085768 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d38359e_ce8f_4308_9adb_593d823fab31.slice/crio-b36a1d698bc19a4028a6c8d1650154d336df314128135f61c8e5d6e05dac11f2 WatchSource:0}: Error finding container b36a1d698bc19a4028a6c8d1650154d336df314128135f61c8e5d6e05dac11f2: Status 404 returned error can't find the container with id b36a1d698bc19a4028a6c8d1650154d336df314128135f61c8e5d6e05dac11f2 Jun 09 12:42:20.190107 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.190074 2564 generic.go:356] "Generic (PLEG): container finished" podID="17b62f8c-a428-4790-9822-4a158e7199e3" containerID="5566d57988c8b6f8c9bf823baacf7ae3d72e6865e6e60d45fc1a0890db530ca5" exitCode=0 Jun 09 12:42:20.190327 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.190156 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" event={"ID":"17b62f8c-a428-4790-9822-4a158e7199e3","Type":"ContainerDied","Data":"5566d57988c8b6f8c9bf823baacf7ae3d72e6865e6e60d45fc1a0890db530ca5"} Jun 09 12:42:20.192227 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.192200 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" event={"ID":"4d38359e-ce8f-4308-9adb-593d823fab31","Type":"ContainerStarted","Data":"ff48186acb5400b67d465d3a912c32c94d0091cd7341421264f1f3d871b83c7a"} Jun 09 12:42:20.192329 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.192249 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" event={"ID":"4d38359e-ce8f-4308-9adb-593d823fab31","Type":"ContainerStarted","Data":"b36a1d698bc19a4028a6c8d1650154d336df314128135f61c8e5d6e05dac11f2"} Jun 09 12:42:20.193958 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.193936 2564 generic.go:356] "Generic (PLEG): container finished" podID="2101c40a-06eb-480c-9131-6ee2af793732" containerID="c4401ee4a0e096befa1d766e65d074dd0221ac0fbea19a9ba683ea74251984ba" exitCode=0 Jun 09 12:42:20.194036 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.193990 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" event={"ID":"2101c40a-06eb-480c-9131-6ee2af793732","Type":"ContainerDied","Data":"c4401ee4a0e096befa1d766e65d074dd0221ac0fbea19a9ba683ea74251984ba"} Jun 09 12:42:20.194036 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.194018 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" event={"ID":"2101c40a-06eb-480c-9131-6ee2af793732","Type":"ContainerStarted","Data":"c28067a29838b55cca9c91d6588dfd05353dcd45fcfd0df688000324191cd056"} Jun 09 12:42:20.250130 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.250101 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk"] Jun 09 12:42:20.253390 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.253348 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" Jun 09 12:42:20.262663 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.262640 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk"] Jun 09 12:42:20.266543 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.266522 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk\" (UID: \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" Jun 09 12:42:20.266674 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.266596 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk\" (UID: \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" Jun 09 12:42:20.266756 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.266729 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjlfc\" (UniqueName: \"kubernetes.io/projected/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-kube-api-access-hjlfc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk\" (UID: \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" Jun 09 12:42:20.367335 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.367299 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjlfc\" (UniqueName: \"kubernetes.io/projected/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-kube-api-access-hjlfc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk\" (UID: \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" Jun 09 12:42:20.367475 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.367381 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk\" (UID: \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" Jun 09 12:42:20.367475 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.367435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk\" (UID: \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" Jun 09 12:42:20.367814 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.367792 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk\" (UID: \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" Jun 09 12:42:20.367888 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.367811 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk\" (UID: \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" Jun 09 12:42:20.377046 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.377021 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjlfc\" (UniqueName: \"kubernetes.io/projected/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-kube-api-access-hjlfc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk\" (UID: \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" Jun 09 12:42:20.562350 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.562272 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" Jun 09 12:42:20.700351 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:20.695948 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk"] Jun 09 12:42:21.200786 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:21.200755 2564 generic.go:356] "Generic (PLEG): container finished" podID="2101c40a-06eb-480c-9131-6ee2af793732" containerID="8312c8a765dc0c1be4e2eaf76fb9b7f4c49cf7e662b4299d577b8889106dbebd" exitCode=0 Jun 09 12:42:21.201126 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:21.200830 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" event={"ID":"2101c40a-06eb-480c-9131-6ee2af793732","Type":"ContainerDied","Data":"8312c8a765dc0c1be4e2eaf76fb9b7f4c49cf7e662b4299d577b8889106dbebd"} Jun 09 12:42:21.202821 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:21.202800 2564 generic.go:356] "Generic (PLEG): container finished" podID="17b62f8c-a428-4790-9822-4a158e7199e3" containerID="5fb5983bd47775389a5a10ec702cbc06565bc8d29922f61352220124217ab90f" exitCode=0 Jun 09 12:42:21.202920 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:21.202873 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" event={"ID":"17b62f8c-a428-4790-9822-4a158e7199e3","Type":"ContainerDied","Data":"5fb5983bd47775389a5a10ec702cbc06565bc8d29922f61352220124217ab90f"} Jun 09 12:42:21.204318 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:21.204296 2564 generic.go:356] "Generic (PLEG): container finished" podID="4d38359e-ce8f-4308-9adb-593d823fab31" containerID="ff48186acb5400b67d465d3a912c32c94d0091cd7341421264f1f3d871b83c7a" exitCode=0 Jun 09 12:42:21.204637 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:21.204377 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" event={"ID":"4d38359e-ce8f-4308-9adb-593d823fab31","Type":"ContainerDied","Data":"ff48186acb5400b67d465d3a912c32c94d0091cd7341421264f1f3d871b83c7a"} Jun 09 12:42:21.206081 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:21.206059 2564 generic.go:356] "Generic (PLEG): container finished" podID="32dcf6b6-6d3e-4b7b-ad4a-536abed9c327" containerID="11929b0a82bc5aa413bd32797b7c9b71d5e973f20f613986893b4f6d9b9ba1b0" exitCode=0 Jun 09 12:42:21.206186 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:21.206139 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" event={"ID":"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327","Type":"ContainerDied","Data":"11929b0a82bc5aa413bd32797b7c9b71d5e973f20f613986893b4f6d9b9ba1b0"} Jun 09 12:42:21.206186 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:21.206172 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" event={"ID":"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327","Type":"ContainerStarted","Data":"3fee134bfed3e7236ed3da5a36fea81dfc32422f1f7ced52c691c95d54412d37"} Jun 09 12:42:22.214117 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:22.214086 2564 generic.go:356] "Generic (PLEG): container finished" podID="2101c40a-06eb-480c-9131-6ee2af793732" containerID="ce02c1cbcfe50425e471c8ba9a745600acbd68fd37f9f390d8be9cd6516d9ee2" exitCode=0 Jun 09 12:42:22.214480 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:22.214173 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" event={"ID":"2101c40a-06eb-480c-9131-6ee2af793732","Type":"ContainerDied","Data":"ce02c1cbcfe50425e471c8ba9a745600acbd68fd37f9f390d8be9cd6516d9ee2"} Jun 09 12:42:22.216228 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:22.216196 2564 generic.go:356] "Generic (PLEG): container finished" podID="17b62f8c-a428-4790-9822-4a158e7199e3" containerID="74fec12f456ea6e018aeb2044ee50df59936a9e6c1607fe4232097b92fff3739" exitCode=0 Jun 09 12:42:22.216335 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:22.216278 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" event={"ID":"17b62f8c-a428-4790-9822-4a158e7199e3","Type":"ContainerDied","Data":"74fec12f456ea6e018aeb2044ee50df59936a9e6c1607fe4232097b92fff3739"} Jun 09 12:42:22.218035 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:22.218015 2564 generic.go:356] "Generic (PLEG): container finished" podID="4d38359e-ce8f-4308-9adb-593d823fab31" containerID="16b7eb3979e53d692e636125ae59381ce780f80dbfcfb1b491e9ea46cf4ab2f8" exitCode=0 Jun 09 12:42:22.218109 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:22.218082 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" event={"ID":"4d38359e-ce8f-4308-9adb-593d823fab31","Type":"ContainerDied","Data":"16b7eb3979e53d692e636125ae59381ce780f80dbfcfb1b491e9ea46cf4ab2f8"} Jun 09 12:42:22.219936 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:22.219919 2564 generic.go:356] "Generic (PLEG): container finished" podID="32dcf6b6-6d3e-4b7b-ad4a-536abed9c327" containerID="83da8b8dea2f7e6fb0df96712657453e77521b6c96b3dc6b97a7b1a3ef580904" exitCode=0 Jun 09 12:42:22.220031 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:22.219979 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" event={"ID":"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327","Type":"ContainerDied","Data":"83da8b8dea2f7e6fb0df96712657453e77521b6c96b3dc6b97a7b1a3ef580904"} Jun 09 12:42:23.227421 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.227390 2564 generic.go:356] "Generic (PLEG): container finished" podID="4d38359e-ce8f-4308-9adb-593d823fab31" containerID="dd8a965d11b14e1535be3df6999ece348704a5a60e3d40e23034543c8a34e06b" exitCode=0 Jun 09 12:42:23.227878 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.227466 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" event={"ID":"4d38359e-ce8f-4308-9adb-593d823fab31","Type":"ContainerDied","Data":"dd8a965d11b14e1535be3df6999ece348704a5a60e3d40e23034543c8a34e06b"} Jun 09 12:42:23.229507 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.229484 2564 generic.go:356] "Generic (PLEG): container finished" podID="32dcf6b6-6d3e-4b7b-ad4a-536abed9c327" containerID="880588176c8941f04f22abeba749e4e1f5ed39d8e5d56d228ecbe171dac09d43" exitCode=0 Jun 09 12:42:23.229644 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.229544 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" event={"ID":"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327","Type":"ContainerDied","Data":"880588176c8941f04f22abeba749e4e1f5ed39d8e5d56d228ecbe171dac09d43"} Jun 09 12:42:23.362117 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.362095 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" Jun 09 12:42:23.388882 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.388855 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" Jun 09 12:42:23.394714 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.394691 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk4wb\" (UniqueName: \"kubernetes.io/projected/2101c40a-06eb-480c-9131-6ee2af793732-kube-api-access-hk4wb\") pod \"2101c40a-06eb-480c-9131-6ee2af793732\" (UID: \"2101c40a-06eb-480c-9131-6ee2af793732\") " Jun 09 12:42:23.394801 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.394732 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2101c40a-06eb-480c-9131-6ee2af793732-util\") pod \"2101c40a-06eb-480c-9131-6ee2af793732\" (UID: \"2101c40a-06eb-480c-9131-6ee2af793732\") " Jun 09 12:42:23.394801 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.394764 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2101c40a-06eb-480c-9131-6ee2af793732-bundle\") pod \"2101c40a-06eb-480c-9131-6ee2af793732\" (UID: \"2101c40a-06eb-480c-9131-6ee2af793732\") " Jun 09 12:42:23.395298 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.395277 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2101c40a-06eb-480c-9131-6ee2af793732-bundle" (OuterVolumeSpecName: "bundle") pod "2101c40a-06eb-480c-9131-6ee2af793732" (UID: "2101c40a-06eb-480c-9131-6ee2af793732"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:42:23.396670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.396641 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2101c40a-06eb-480c-9131-6ee2af793732-kube-api-access-hk4wb" (OuterVolumeSpecName: "kube-api-access-hk4wb") pod "2101c40a-06eb-480c-9131-6ee2af793732" (UID: "2101c40a-06eb-480c-9131-6ee2af793732"). InnerVolumeSpecName "kube-api-access-hk4wb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:42:23.400142 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.400107 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2101c40a-06eb-480c-9131-6ee2af793732-util" (OuterVolumeSpecName: "util") pod "2101c40a-06eb-480c-9131-6ee2af793732" (UID: "2101c40a-06eb-480c-9131-6ee2af793732"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:42:23.495357 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.495285 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17b62f8c-a428-4790-9822-4a158e7199e3-bundle\") pod \"17b62f8c-a428-4790-9822-4a158e7199e3\" (UID: \"17b62f8c-a428-4790-9822-4a158e7199e3\") " Jun 09 12:42:23.495357 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.495326 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17b62f8c-a428-4790-9822-4a158e7199e3-util\") pod \"17b62f8c-a428-4790-9822-4a158e7199e3\" (UID: \"17b62f8c-a428-4790-9822-4a158e7199e3\") " Jun 09 12:42:23.495525 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.495369 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xvmk\" (UniqueName: \"kubernetes.io/projected/17b62f8c-a428-4790-9822-4a158e7199e3-kube-api-access-6xvmk\") pod \"17b62f8c-a428-4790-9822-4a158e7199e3\" (UID: \"17b62f8c-a428-4790-9822-4a158e7199e3\") " Jun 09 12:42:23.495587 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.495527 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk4wb\" (UniqueName: \"kubernetes.io/projected/2101c40a-06eb-480c-9131-6ee2af793732-kube-api-access-hk4wb\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:23.495587 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.495541 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2101c40a-06eb-480c-9131-6ee2af793732-util\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:23.495587 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.495549 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2101c40a-06eb-480c-9131-6ee2af793732-bundle\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:23.496022 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.495994 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17b62f8c-a428-4790-9822-4a158e7199e3-bundle" (OuterVolumeSpecName: "bundle") pod "17b62f8c-a428-4790-9822-4a158e7199e3" (UID: "17b62f8c-a428-4790-9822-4a158e7199e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:42:23.497381 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.497358 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17b62f8c-a428-4790-9822-4a158e7199e3-kube-api-access-6xvmk" (OuterVolumeSpecName: "kube-api-access-6xvmk") pod "17b62f8c-a428-4790-9822-4a158e7199e3" (UID: "17b62f8c-a428-4790-9822-4a158e7199e3"). InnerVolumeSpecName "kube-api-access-6xvmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:42:23.501141 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.501123 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17b62f8c-a428-4790-9822-4a158e7199e3-util" (OuterVolumeSpecName: "util") pod "17b62f8c-a428-4790-9822-4a158e7199e3" (UID: "17b62f8c-a428-4790-9822-4a158e7199e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:42:23.596607 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.596555 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17b62f8c-a428-4790-9822-4a158e7199e3-bundle\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:23.596607 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.596605 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17b62f8c-a428-4790-9822-4a158e7199e3-util\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:23.596751 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:23.596617 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xvmk\" (UniqueName: \"kubernetes.io/projected/17b62f8c-a428-4790-9822-4a158e7199e3-kube-api-access-6xvmk\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:24.237224 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.237194 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" Jun 09 12:42:24.237224 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.237210 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk" event={"ID":"2101c40a-06eb-480c-9131-6ee2af793732","Type":"ContainerDied","Data":"c28067a29838b55cca9c91d6588dfd05353dcd45fcfd0df688000324191cd056"} Jun 09 12:42:24.237769 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.237261 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c28067a29838b55cca9c91d6588dfd05353dcd45fcfd0df688000324191cd056" Jun 09 12:42:24.239090 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.239070 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" Jun 09 12:42:24.239208 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.239102 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h" event={"ID":"17b62f8c-a428-4790-9822-4a158e7199e3","Type":"ContainerDied","Data":"ea1455ab547ce8c6eab6d22ce2263752cf6735151038e1cbffd35b0b57c8d85c"} Jun 09 12:42:24.239208 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.239137 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea1455ab547ce8c6eab6d22ce2263752cf6735151038e1cbffd35b0b57c8d85c" Jun 09 12:42:24.368596 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.368573 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" Jun 09 12:42:24.396373 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.396352 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" Jun 09 12:42:24.402462 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.402440 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d38359e-ce8f-4308-9adb-593d823fab31-bundle\") pod \"4d38359e-ce8f-4308-9adb-593d823fab31\" (UID: \"4d38359e-ce8f-4308-9adb-593d823fab31\") " Jun 09 12:42:24.402589 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.402471 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d38359e-ce8f-4308-9adb-593d823fab31-util\") pod \"4d38359e-ce8f-4308-9adb-593d823fab31\" (UID: \"4d38359e-ce8f-4308-9adb-593d823fab31\") " Jun 09 12:42:24.402589 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.402525 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn6pv\" (UniqueName: \"kubernetes.io/projected/4d38359e-ce8f-4308-9adb-593d823fab31-kube-api-access-kn6pv\") pod \"4d38359e-ce8f-4308-9adb-593d823fab31\" (UID: \"4d38359e-ce8f-4308-9adb-593d823fab31\") " Jun 09 12:42:24.402982 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.402961 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d38359e-ce8f-4308-9adb-593d823fab31-bundle" (OuterVolumeSpecName: "bundle") pod "4d38359e-ce8f-4308-9adb-593d823fab31" (UID: "4d38359e-ce8f-4308-9adb-593d823fab31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:42:24.404623 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.404602 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d38359e-ce8f-4308-9adb-593d823fab31-kube-api-access-kn6pv" (OuterVolumeSpecName: "kube-api-access-kn6pv") pod "4d38359e-ce8f-4308-9adb-593d823fab31" (UID: "4d38359e-ce8f-4308-9adb-593d823fab31"). InnerVolumeSpecName "kube-api-access-kn6pv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:42:24.408396 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.408372 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d38359e-ce8f-4308-9adb-593d823fab31-util" (OuterVolumeSpecName: "util") pod "4d38359e-ce8f-4308-9adb-593d823fab31" (UID: "4d38359e-ce8f-4308-9adb-593d823fab31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:42:24.503203 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.503135 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjlfc\" (UniqueName: \"kubernetes.io/projected/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-kube-api-access-hjlfc\") pod \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\" (UID: \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\") " Jun 09 12:42:24.503320 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.503235 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-util\") pod \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\" (UID: \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\") " Jun 09 12:42:24.503320 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.503252 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-bundle\") pod \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\" (UID: \"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327\") " Jun 09 12:42:24.503401 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.503388 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d38359e-ce8f-4308-9adb-593d823fab31-bundle\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:24.503438 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.503407 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d38359e-ce8f-4308-9adb-593d823fab31-util\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:24.503438 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.503421 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn6pv\" (UniqueName: \"kubernetes.io/projected/4d38359e-ce8f-4308-9adb-593d823fab31-kube-api-access-kn6pv\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:24.503772 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.503751 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-bundle" (OuterVolumeSpecName: "bundle") pod "32dcf6b6-6d3e-4b7b-ad4a-536abed9c327" (UID: "32dcf6b6-6d3e-4b7b-ad4a-536abed9c327"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:42:24.505139 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.505123 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-kube-api-access-hjlfc" (OuterVolumeSpecName: "kube-api-access-hjlfc") pod "32dcf6b6-6d3e-4b7b-ad4a-536abed9c327" (UID: "32dcf6b6-6d3e-4b7b-ad4a-536abed9c327"). InnerVolumeSpecName "kube-api-access-hjlfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:42:24.508401 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.508380 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-util" (OuterVolumeSpecName: "util") pod "32dcf6b6-6d3e-4b7b-ad4a-536abed9c327" (UID: "32dcf6b6-6d3e-4b7b-ad4a-536abed9c327"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:42:24.604472 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.604443 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-util\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:24.604472 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.604469 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-bundle\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:24.604472 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:24.604478 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjlfc\" (UniqueName: \"kubernetes.io/projected/32dcf6b6-6d3e-4b7b-ad4a-536abed9c327-kube-api-access-hjlfc\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:25.245924 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:25.245895 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" Jun 09 12:42:25.245924 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:25.245903 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56" event={"ID":"4d38359e-ce8f-4308-9adb-593d823fab31","Type":"ContainerDied","Data":"b36a1d698bc19a4028a6c8d1650154d336df314128135f61c8e5d6e05dac11f2"} Jun 09 12:42:25.246453 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:25.245961 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b36a1d698bc19a4028a6c8d1650154d336df314128135f61c8e5d6e05dac11f2" Jun 09 12:42:25.247788 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:25.247766 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" event={"ID":"32dcf6b6-6d3e-4b7b-ad4a-536abed9c327","Type":"ContainerDied","Data":"3fee134bfed3e7236ed3da5a36fea81dfc32422f1f7ced52c691c95d54412d37"} Jun 09 12:42:25.247954 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:25.247801 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fee134bfed3e7236ed3da5a36fea81dfc32422f1f7ced52c691c95d54412d37" Jun 09 12:42:25.247954 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:25.247767 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk" Jun 09 12:42:27.216784 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:27.216753 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:28.234386 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:28.234348 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:28.234837 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:28.234413 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:28.239034 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:28.239010 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:28.268037 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:28.268015 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-686b498c4f-fgxqp" Jun 09 12:42:28.337175 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:28.337139 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d4497bfd-f2nq4"] Jun 09 12:42:28.478135 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:28.478098 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:28.595225 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:28.595146 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:28.724140 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:28.724111 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:30.133642 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:30.133611 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:32.056179 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:32.056141 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:32.467170 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:32.467128 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:33.160815 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:33.160785 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:33.306893 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:33.306858 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:34.342017 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.341981 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n2g55"] Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342289 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17b62f8c-a428-4790-9822-4a158e7199e3" containerName="pull" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342299 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="17b62f8c-a428-4790-9822-4a158e7199e3" containerName="pull" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342313 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2101c40a-06eb-480c-9131-6ee2af793732" containerName="extract" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342319 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2101c40a-06eb-480c-9131-6ee2af793732" containerName="extract" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342328 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17b62f8c-a428-4790-9822-4a158e7199e3" containerName="util" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342333 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="17b62f8c-a428-4790-9822-4a158e7199e3" containerName="util" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342339 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2101c40a-06eb-480c-9131-6ee2af793732" containerName="util" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342345 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2101c40a-06eb-480c-9131-6ee2af793732" containerName="util" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342351 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17b62f8c-a428-4790-9822-4a158e7199e3" containerName="extract" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342355 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="17b62f8c-a428-4790-9822-4a158e7199e3" containerName="extract" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342362 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d38359e-ce8f-4308-9adb-593d823fab31" containerName="extract" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342367 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d38359e-ce8f-4308-9adb-593d823fab31" containerName="extract" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342374 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d38359e-ce8f-4308-9adb-593d823fab31" containerName="pull" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342379 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d38359e-ce8f-4308-9adb-593d823fab31" containerName="pull" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342385 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32dcf6b6-6d3e-4b7b-ad4a-536abed9c327" containerName="util" Jun 09 12:42:34.342387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342390 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="32dcf6b6-6d3e-4b7b-ad4a-536abed9c327" containerName="util" Jun 09 12:42:34.342945 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342398 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d38359e-ce8f-4308-9adb-593d823fab31" containerName="util" Jun 09 12:42:34.342945 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342402 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d38359e-ce8f-4308-9adb-593d823fab31" containerName="util" Jun 09 12:42:34.342945 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342409 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32dcf6b6-6d3e-4b7b-ad4a-536abed9c327" containerName="extract" Jun 09 12:42:34.342945 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342414 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="32dcf6b6-6d3e-4b7b-ad4a-536abed9c327" containerName="extract" Jun 09 12:42:34.342945 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342422 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2101c40a-06eb-480c-9131-6ee2af793732" containerName="pull" Jun 09 12:42:34.342945 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342427 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2101c40a-06eb-480c-9131-6ee2af793732" containerName="pull" Jun 09 12:42:34.342945 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342436 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32dcf6b6-6d3e-4b7b-ad4a-536abed9c327" containerName="pull" Jun 09 12:42:34.342945 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342441 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="32dcf6b6-6d3e-4b7b-ad4a-536abed9c327" containerName="pull" Jun 09 12:42:34.342945 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342486 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="17b62f8c-a428-4790-9822-4a158e7199e3" containerName="extract" Jun 09 12:42:34.342945 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342495 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="32dcf6b6-6d3e-4b7b-ad4a-536abed9c327" containerName="extract" Jun 09 12:42:34.342945 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342502 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d38359e-ce8f-4308-9adb-593d823fab31" containerName="extract" Jun 09 12:42:34.342945 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.342508 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2101c40a-06eb-480c-9131-6ee2af793732" containerName="extract" Jun 09 12:42:34.346775 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.346756 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n2g55" Jun 09 12:42:34.350740 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.350723 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 12:42:34.351757 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.351739 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 12:42:34.351911 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.351886 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cnb72\"" Jun 09 12:42:34.359961 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.359937 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n2g55"] Jun 09 12:42:34.392151 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.392115 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f896k\" (UniqueName: \"kubernetes.io/projected/cd574963-b29b-49d8-bfc8-1e08e23ac2d1-kube-api-access-f896k\") pod \"authorino-operator-75cc8d5cb7-n2g55\" (UID: \"cd574963-b29b-49d8-bfc8-1e08e23ac2d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n2g55" Jun 09 12:42:34.492908 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.492876 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f896k\" (UniqueName: \"kubernetes.io/projected/cd574963-b29b-49d8-bfc8-1e08e23ac2d1-kube-api-access-f896k\") pod \"authorino-operator-75cc8d5cb7-n2g55\" (UID: \"cd574963-b29b-49d8-bfc8-1e08e23ac2d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n2g55" Jun 09 12:42:34.516959 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.516934 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f896k\" (UniqueName: \"kubernetes.io/projected/cd574963-b29b-49d8-bfc8-1e08e23ac2d1-kube-api-access-f896k\") pod \"authorino-operator-75cc8d5cb7-n2g55\" (UID: \"cd574963-b29b-49d8-bfc8-1e08e23ac2d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n2g55" Jun 09 12:42:34.656706 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.656614 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n2g55" Jun 09 12:42:34.786812 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:34.786789 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n2g55"] Jun 09 12:42:34.788624 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:42:34.788599 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd574963_b29b_49d8_bfc8_1e08e23ac2d1.slice/crio-1e72b641b3362ffc9a552afb7b425be089aa84f3b8dd0d6ce088372043c054f0 WatchSource:0}: Error finding container 1e72b641b3362ffc9a552afb7b425be089aa84f3b8dd0d6ce088372043c054f0: Status 404 returned error can't find the container with id 1e72b641b3362ffc9a552afb7b425be089aa84f3b8dd0d6ce088372043c054f0 Jun 09 12:42:35.084707 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:35.084668 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:35.300770 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:35.300739 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n2g55" event={"ID":"cd574963-b29b-49d8-bfc8-1e08e23ac2d1","Type":"ContainerStarted","Data":"1e72b641b3362ffc9a552afb7b425be089aa84f3b8dd0d6ce088372043c054f0"} Jun 09 12:42:37.103905 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:37.103869 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:37.314210 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:37.314111 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n2g55" event={"ID":"cd574963-b29b-49d8-bfc8-1e08e23ac2d1","Type":"ContainerStarted","Data":"59aed7614bedaeda9db72876164ed8dc2359098085d67c08c2faf5ffc7290595"} Jun 09 12:42:37.314210 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:37.314187 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n2g55" Jun 09 12:42:37.411720 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:37.411659 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n2g55" podStartSLOduration=1.223967225 podStartE2EDuration="3.41164323s" totalImagesPullingTime="2.187676005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:37.400965063 +0000 UTC m=+655.098451992" watchObservedRunningTime="2026-06-09 12:42:37.41164323 +0000 UTC m=+655.109130159" Jun 09 12:42:37.466421 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:37.466389 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:39.828781 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:39.828742 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:41.699448 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:41.699405 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:41.851160 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:41.851127 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:42.240498 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:42.240459 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:42.443199 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:42.443164 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:48.320702 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:48.320675 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n2g55" Jun 09 12:42:50.606606 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:50.606551 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:50.681450 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:50.681417 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:51.004430 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:51.004397 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:51.105368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:51.105336 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:53.238951 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.238918 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:53.347145 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.347116 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:53.357720 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.357691 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75d4497bfd-f2nq4" podUID="e7ec3002-494d-4aee-817a-9727de4ef5c7" containerName="console" containerID="cri-o://d0bdeecb342c761e8b41ee976ca7af26ca005c6e3e9d362af4860e5f06e493c5" gracePeriod=15 Jun 09 12:42:53.600039 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.600013 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:42:53.766195 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.766169 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-serving-cert\") pod \"e7ec3002-494d-4aee-817a-9727de4ef5c7\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " Jun 09 12:42:53.766368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.766205 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-oauth-serving-cert\") pod \"e7ec3002-494d-4aee-817a-9727de4ef5c7\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " Jun 09 12:42:53.766368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.766251 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-service-ca\") pod \"e7ec3002-494d-4aee-817a-9727de4ef5c7\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " Jun 09 12:42:53.766368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.766271 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-oauth-config\") pod \"e7ec3002-494d-4aee-817a-9727de4ef5c7\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " Jun 09 12:42:53.766368 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.766339 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-trusted-ca-bundle\") pod \"e7ec3002-494d-4aee-817a-9727de4ef5c7\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " Jun 09 12:42:53.766609 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.766470 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-config\") pod \"e7ec3002-494d-4aee-817a-9727de4ef5c7\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " Jun 09 12:42:53.766609 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.766519 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5pw7\" (UniqueName: \"kubernetes.io/projected/e7ec3002-494d-4aee-817a-9727de4ef5c7-kube-api-access-v5pw7\") pod \"e7ec3002-494d-4aee-817a-9727de4ef5c7\" (UID: \"e7ec3002-494d-4aee-817a-9727de4ef5c7\") " Jun 09 12:42:53.766785 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.766749 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e7ec3002-494d-4aee-817a-9727de4ef5c7" (UID: "e7ec3002-494d-4aee-817a-9727de4ef5c7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:42:53.766971 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.766832 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-oauth-serving-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:53.767051 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.766993 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-service-ca" (OuterVolumeSpecName: "service-ca") pod "e7ec3002-494d-4aee-817a-9727de4ef5c7" (UID: "e7ec3002-494d-4aee-817a-9727de4ef5c7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:42:53.767170 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.767144 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e7ec3002-494d-4aee-817a-9727de4ef5c7" (UID: "e7ec3002-494d-4aee-817a-9727de4ef5c7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:42:53.767252 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.767156 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-config" (OuterVolumeSpecName: "console-config") pod "e7ec3002-494d-4aee-817a-9727de4ef5c7" (UID: "e7ec3002-494d-4aee-817a-9727de4ef5c7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:42:53.768601 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.768551 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e7ec3002-494d-4aee-817a-9727de4ef5c7" (UID: "e7ec3002-494d-4aee-817a-9727de4ef5c7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:42:53.768724 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.768675 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e7ec3002-494d-4aee-817a-9727de4ef5c7" (UID: "e7ec3002-494d-4aee-817a-9727de4ef5c7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:42:53.768877 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.768850 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7ec3002-494d-4aee-817a-9727de4ef5c7-kube-api-access-v5pw7" (OuterVolumeSpecName: "kube-api-access-v5pw7") pod "e7ec3002-494d-4aee-817a-9727de4ef5c7" (UID: "e7ec3002-494d-4aee-817a-9727de4ef5c7"). InnerVolumeSpecName "kube-api-access-v5pw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:42:53.842084 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.842051 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:53.867235 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.867206 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-service-ca\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:53.867235 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.867233 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-oauth-config\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:53.867396 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.867248 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-trusted-ca-bundle\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:53.867396 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.867260 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-config\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:53.867396 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.867269 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5pw7\" (UniqueName: \"kubernetes.io/projected/e7ec3002-494d-4aee-817a-9727de4ef5c7-kube-api-access-v5pw7\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:53.867396 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.867277 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7ec3002-494d-4aee-817a-9727de4ef5c7-console-serving-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:42:53.941317 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:53.941288 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:54.403107 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:54.403069 2564 generic.go:356] "Generic (PLEG): container finished" podID="e7ec3002-494d-4aee-817a-9727de4ef5c7" containerID="d0bdeecb342c761e8b41ee976ca7af26ca005c6e3e9d362af4860e5f06e493c5" exitCode=0 Jun 09 12:42:54.403501 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:54.403118 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d4497bfd-f2nq4" Jun 09 12:42:54.403501 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:54.403119 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d4497bfd-f2nq4" event={"ID":"e7ec3002-494d-4aee-817a-9727de4ef5c7","Type":"ContainerDied","Data":"d0bdeecb342c761e8b41ee976ca7af26ca005c6e3e9d362af4860e5f06e493c5"} Jun 09 12:42:54.403501 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:54.403249 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d4497bfd-f2nq4" event={"ID":"e7ec3002-494d-4aee-817a-9727de4ef5c7","Type":"ContainerDied","Data":"8b4e386433ebc7636d969d262fe10de1b1953a367e0f262faa9f72c86a9df1b1"} Jun 09 12:42:54.403501 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:54.403278 2564 scope.go:117] "RemoveContainer" containerID="d0bdeecb342c761e8b41ee976ca7af26ca005c6e3e9d362af4860e5f06e493c5" Jun 09 12:42:54.412690 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:54.412675 2564 scope.go:117] "RemoveContainer" containerID="d0bdeecb342c761e8b41ee976ca7af26ca005c6e3e9d362af4860e5f06e493c5" Jun 09 12:42:54.412951 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:42:54.412931 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0bdeecb342c761e8b41ee976ca7af26ca005c6e3e9d362af4860e5f06e493c5\": container with ID starting with d0bdeecb342c761e8b41ee976ca7af26ca005c6e3e9d362af4860e5f06e493c5 not found: ID does not exist" containerID="d0bdeecb342c761e8b41ee976ca7af26ca005c6e3e9d362af4860e5f06e493c5" Jun 09 12:42:54.412993 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:54.412960 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0bdeecb342c761e8b41ee976ca7af26ca005c6e3e9d362af4860e5f06e493c5"} err="failed to get container status \"d0bdeecb342c761e8b41ee976ca7af26ca005c6e3e9d362af4860e5f06e493c5\": rpc error: code = NotFound desc = could not find container \"d0bdeecb342c761e8b41ee976ca7af26ca005c6e3e9d362af4860e5f06e493c5\": container with ID starting with d0bdeecb342c761e8b41ee976ca7af26ca005c6e3e9d362af4860e5f06e493c5 not found: ID does not exist" Jun 09 12:42:54.432691 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:54.432580 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d4497bfd-f2nq4"] Jun 09 12:42:54.438043 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:54.438019 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75d4497bfd-f2nq4"] Jun 09 12:42:54.780216 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:54.780182 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7ec3002-494d-4aee-817a-9727de4ef5c7" path="/var/lib/kubelet/pods/e7ec3002-494d-4aee-817a-9727de4ef5c7/volumes" Jun 09 12:42:57.635941 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:57.635880 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:42:57.896538 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:42:57.896458 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:01.420448 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:01.420416 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:01.530136 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:01.530100 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:10.232658 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:10.232613 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:10.331182 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:10.331144 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:11.582379 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:11.582346 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:12.695020 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:12.694985 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:12.817647 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:12.817615 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:17.442923 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:17.442890 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:17.555257 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:17.555227 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:21.302474 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:21.302437 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:21.410523 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:21.410486 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:21.503730 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:21.503693 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:24.914539 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:24.914511 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:25.478608 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.478574 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:25.568382 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.568349 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:25.637381 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.637347 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:25.795529 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.795453 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9f5wm"] Jun 09 12:43:25.795815 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.795801 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7ec3002-494d-4aee-817a-9727de4ef5c7" containerName="console" Jun 09 12:43:25.795815 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.795816 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7ec3002-494d-4aee-817a-9727de4ef5c7" containerName="console" Jun 09 12:43:25.795933 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.795880 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7ec3002-494d-4aee-817a-9727de4ef5c7" containerName="console" Jun 09 12:43:25.798916 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.798898 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9f5wm" Jun 09 12:43:25.803766 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.803744 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9zch8\"" Jun 09 12:43:25.804008 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.803991 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 12:43:25.814058 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.814034 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9f5wm"] Jun 09 12:43:25.815940 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.815918 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8gql\" (UniqueName: \"kubernetes.io/projected/c06ca832-9f76-4387-ac2d-31641a2b08f1-kube-api-access-l8gql\") pod \"limitador-limitador-54d6d988d5-9f5wm\" (UID: \"c06ca832-9f76-4387-ac2d-31641a2b08f1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9f5wm" Jun 09 12:43:25.816039 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.816023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c06ca832-9f76-4387-ac2d-31641a2b08f1-config-file\") pod \"limitador-limitador-54d6d988d5-9f5wm\" (UID: \"c06ca832-9f76-4387-ac2d-31641a2b08f1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9f5wm" Jun 09 12:43:25.839293 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.839271 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9f5wm"] Jun 09 12:43:25.917111 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.917086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8gql\" (UniqueName: \"kubernetes.io/projected/c06ca832-9f76-4387-ac2d-31641a2b08f1-kube-api-access-l8gql\") pod \"limitador-limitador-54d6d988d5-9f5wm\" (UID: \"c06ca832-9f76-4387-ac2d-31641a2b08f1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9f5wm" Jun 09 12:43:25.917441 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.917138 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c06ca832-9f76-4387-ac2d-31641a2b08f1-config-file\") pod \"limitador-limitador-54d6d988d5-9f5wm\" (UID: \"c06ca832-9f76-4387-ac2d-31641a2b08f1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9f5wm" Jun 09 12:43:25.917799 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.917781 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c06ca832-9f76-4387-ac2d-31641a2b08f1-config-file\") pod \"limitador-limitador-54d6d988d5-9f5wm\" (UID: \"c06ca832-9f76-4387-ac2d-31641a2b08f1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9f5wm" Jun 09 12:43:25.927944 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:25.927918 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8gql\" (UniqueName: \"kubernetes.io/projected/c06ca832-9f76-4387-ac2d-31641a2b08f1-kube-api-access-l8gql\") pod \"limitador-limitador-54d6d988d5-9f5wm\" (UID: \"c06ca832-9f76-4387-ac2d-31641a2b08f1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9f5wm" Jun 09 12:43:26.109074 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:26.108987 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9f5wm" Jun 09 12:43:26.263048 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:26.263026 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9f5wm"] Jun 09 12:43:26.265031 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:43:26.265006 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06ca832_9f76_4387_ac2d_31641a2b08f1.slice/crio-843a69b60fb57b94b80f400cef6b4f70da427763f64a7d5846517ad4c477a706 WatchSource:0}: Error finding container 843a69b60fb57b94b80f400cef6b4f70da427763f64a7d5846517ad4c477a706: Status 404 returned error can't find the container with id 843a69b60fb57b94b80f400cef6b4f70da427763f64a7d5846517ad4c477a706 Jun 09 12:43:26.413546 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:26.413463 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:26.534137 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:26.534085 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:26.576948 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:26.576918 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9f5wm" event={"ID":"c06ca832-9f76-4387-ac2d-31641a2b08f1","Type":"ContainerStarted","Data":"843a69b60fb57b94b80f400cef6b4f70da427763f64a7d5846517ad4c477a706"} Jun 09 12:43:26.606314 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:26.606287 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-klhnp"] Jun 09 12:43:26.610748 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:26.610727 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-klhnp" Jun 09 12:43:26.612961 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:26.612927 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vmrgq\"" Jun 09 12:43:26.621782 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:26.621761 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-klhnp"] Jun 09 12:43:26.623062 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:26.623041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-962cg\" (UniqueName: \"kubernetes.io/projected/bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f-kube-api-access-962cg\") pod \"authorino-75d556bd77-klhnp\" (UID: \"bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f\") " pod="kuadrant-system/authorino-75d556bd77-klhnp" Jun 09 12:43:26.724415 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:26.724383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-962cg\" (UniqueName: \"kubernetes.io/projected/bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f-kube-api-access-962cg\") pod \"authorino-75d556bd77-klhnp\" (UID: \"bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f\") " pod="kuadrant-system/authorino-75d556bd77-klhnp" Jun 09 12:43:26.734177 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:26.734144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-962cg\" (UniqueName: \"kubernetes.io/projected/bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f-kube-api-access-962cg\") pod \"authorino-75d556bd77-klhnp\" (UID: \"bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f\") " pod="kuadrant-system/authorino-75d556bd77-klhnp" Jun 09 12:43:26.920098 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:26.920059 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-klhnp" Jun 09 12:43:27.109387 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:27.109353 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-klhnp"] Jun 09 12:43:27.111211 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:43:27.111180 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbef99ec4_5f7c_4e36_ab17_273fdaeb1a1f.slice/crio-2d81fc7817c0fe8a0c71ed372374b76329c4a5bb97007111f55c559f745d7761 WatchSource:0}: Error finding container 2d81fc7817c0fe8a0c71ed372374b76329c4a5bb97007111f55c559f745d7761: Status 404 returned error can't find the container with id 2d81fc7817c0fe8a0c71ed372374b76329c4a5bb97007111f55c559f745d7761 Jun 09 12:43:27.587454 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:27.587393 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-klhnp" event={"ID":"bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f","Type":"ContainerStarted","Data":"2d81fc7817c0fe8a0c71ed372374b76329c4a5bb97007111f55c559f745d7761"} Jun 09 12:43:30.658684 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:30.658654 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:30.760513 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:30.760483 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:30.866700 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:30.866676 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:31.615688 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:31.615648 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9f5wm" event={"ID":"c06ca832-9f76-4387-ac2d-31641a2b08f1","Type":"ContainerStarted","Data":"b77b3a9ad84ef2f88c3056dbb6659b4658d23cb2636264cddfb6e076213de90e"} Jun 09 12:43:31.615887 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:31.615782 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9f5wm" Jun 09 12:43:31.617052 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:31.617027 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-klhnp" event={"ID":"bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f","Type":"ContainerStarted","Data":"15fdb67c01d58fc32147600a106e27088b78ae2d413ba5c5b6ddba02f20e4c01"} Jun 09 12:43:31.637179 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:31.637137 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-9f5wm" podStartSLOduration=2.080697601 podStartE2EDuration="6.637122898s" totalImagesPullingTime="4.556425297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:43:31.635811303 +0000 UTC m=+709.333298233" watchObservedRunningTime="2026-06-09 12:43:31.637122898 +0000 UTC m=+709.334609826" Jun 09 12:43:31.654954 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:31.654910 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-klhnp" podStartSLOduration=1.944560793 podStartE2EDuration="5.654896265s" totalImagesPullingTime="3.710335472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:43:31.653151632 +0000 UTC m=+709.350638561" watchObservedRunningTime="2026-06-09 12:43:31.654896265 +0000 UTC m=+709.352383194" Jun 09 12:43:33.120676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:33.120639 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:33.220779 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:33.220748 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:37.843287 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:37.843255 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:37.941273 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:37.941241 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:42.623585 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:42.623522 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9f5wm" Jun 09 12:43:46.598998 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:46.598964 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:57.606579 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:57.606532 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:57.699427 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:57.699391 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:57.867946 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:57.867870 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:43:59.212720 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.212690 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4"] Jun 09 12:43:59.215200 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.215184 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" Jun 09 12:43:59.217538 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.217509 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:43:59.217538 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.217538 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xckbn\"" Jun 09 12:43:59.218033 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.218011 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:43:59.226996 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.226977 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4"] Jun 09 12:43:59.303318 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.303287 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98a0db87-3e8e-4e19-b036-51a2de9181c2-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4\" (UID: \"98a0db87-3e8e-4e19-b036-51a2de9181c2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" Jun 09 12:43:59.303468 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.303325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98a0db87-3e8e-4e19-b036-51a2de9181c2-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4\" (UID: \"98a0db87-3e8e-4e19-b036-51a2de9181c2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" Jun 09 12:43:59.303468 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.303424 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnb5j\" (UniqueName: \"kubernetes.io/projected/98a0db87-3e8e-4e19-b036-51a2de9181c2-kube-api-access-bnb5j\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4\" (UID: \"98a0db87-3e8e-4e19-b036-51a2de9181c2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" Jun 09 12:43:59.404514 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.404476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnb5j\" (UniqueName: \"kubernetes.io/projected/98a0db87-3e8e-4e19-b036-51a2de9181c2-kube-api-access-bnb5j\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4\" (UID: \"98a0db87-3e8e-4e19-b036-51a2de9181c2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" Jun 09 12:43:59.404685 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.404581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98a0db87-3e8e-4e19-b036-51a2de9181c2-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4\" (UID: \"98a0db87-3e8e-4e19-b036-51a2de9181c2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" Jun 09 12:43:59.404685 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.404618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98a0db87-3e8e-4e19-b036-51a2de9181c2-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4\" (UID: \"98a0db87-3e8e-4e19-b036-51a2de9181c2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" Jun 09 12:43:59.404932 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.404914 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98a0db87-3e8e-4e19-b036-51a2de9181c2-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4\" (UID: \"98a0db87-3e8e-4e19-b036-51a2de9181c2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" Jun 09 12:43:59.404977 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.404951 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98a0db87-3e8e-4e19-b036-51a2de9181c2-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4\" (UID: \"98a0db87-3e8e-4e19-b036-51a2de9181c2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" Jun 09 12:43:59.415742 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.415720 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnb5j\" (UniqueName: \"kubernetes.io/projected/98a0db87-3e8e-4e19-b036-51a2de9181c2-kube-api-access-bnb5j\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4\" (UID: \"98a0db87-3e8e-4e19-b036-51a2de9181c2\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" Jun 09 12:43:59.524228 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.524175 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" Jun 09 12:43:59.656340 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.656310 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4"] Jun 09 12:43:59.657731 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:43:59.657707 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a0db87_3e8e_4e19_b036_51a2de9181c2.slice/crio-12b13e042d27f7115f49732582eb7f12bd13f0e61ca7e00be8a3452a9294946e WatchSource:0}: Error finding container 12b13e042d27f7115f49732582eb7f12bd13f0e61ca7e00be8a3452a9294946e: Status 404 returned error can't find the container with id 12b13e042d27f7115f49732582eb7f12bd13f0e61ca7e00be8a3452a9294946e Jun 09 12:43:59.762306 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.762277 2564 generic.go:356] "Generic (PLEG): container finished" podID="98a0db87-3e8e-4e19-b036-51a2de9181c2" containerID="a50feaca783d178a334cb441a96e9b64cf0a703ed2fca0fe19f26853d6bcbc4b" exitCode=0 Jun 09 12:43:59.762489 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.762357 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" event={"ID":"98a0db87-3e8e-4e19-b036-51a2de9181c2","Type":"ContainerDied","Data":"a50feaca783d178a334cb441a96e9b64cf0a703ed2fca0fe19f26853d6bcbc4b"} Jun 09 12:43:59.762489 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:43:59.762406 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" event={"ID":"98a0db87-3e8e-4e19-b036-51a2de9181c2","Type":"ContainerStarted","Data":"12b13e042d27f7115f49732582eb7f12bd13f0e61ca7e00be8a3452a9294946e"} Jun 09 12:44:00.769784 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:00.769754 2564 generic.go:356] "Generic (PLEG): container finished" podID="98a0db87-3e8e-4e19-b036-51a2de9181c2" containerID="fc8abc7c4df48230817c8701e6ed0b6007f7e048f30e24bad6ea8b0f772fe602" exitCode=0 Jun 09 12:44:00.770145 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:00.769835 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" event={"ID":"98a0db87-3e8e-4e19-b036-51a2de9181c2","Type":"ContainerDied","Data":"fc8abc7c4df48230817c8701e6ed0b6007f7e048f30e24bad6ea8b0f772fe602"} Jun 09 12:44:01.777405 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:01.777368 2564 generic.go:356] "Generic (PLEG): container finished" podID="98a0db87-3e8e-4e19-b036-51a2de9181c2" containerID="e86f793b2e653e51b55c6addd4cdf9429c20bc5dbf743d09b3db59dacc17c287" exitCode=0 Jun 09 12:44:01.777787 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:01.777454 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" event={"ID":"98a0db87-3e8e-4e19-b036-51a2de9181c2","Type":"ContainerDied","Data":"e86f793b2e653e51b55c6addd4cdf9429c20bc5dbf743d09b3db59dacc17c287"} Jun 09 12:44:02.924896 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:02.924873 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" Jun 09 12:44:03.037473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:03.037382 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98a0db87-3e8e-4e19-b036-51a2de9181c2-bundle\") pod \"98a0db87-3e8e-4e19-b036-51a2de9181c2\" (UID: \"98a0db87-3e8e-4e19-b036-51a2de9181c2\") " Jun 09 12:44:03.037473 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:03.037421 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnb5j\" (UniqueName: \"kubernetes.io/projected/98a0db87-3e8e-4e19-b036-51a2de9181c2-kube-api-access-bnb5j\") pod \"98a0db87-3e8e-4e19-b036-51a2de9181c2\" (UID: \"98a0db87-3e8e-4e19-b036-51a2de9181c2\") " Jun 09 12:44:03.037740 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:03.037496 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98a0db87-3e8e-4e19-b036-51a2de9181c2-util\") pod \"98a0db87-3e8e-4e19-b036-51a2de9181c2\" (UID: \"98a0db87-3e8e-4e19-b036-51a2de9181c2\") " Jun 09 12:44:03.038021 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:03.037982 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98a0db87-3e8e-4e19-b036-51a2de9181c2-bundle" (OuterVolumeSpecName: "bundle") pod "98a0db87-3e8e-4e19-b036-51a2de9181c2" (UID: "98a0db87-3e8e-4e19-b036-51a2de9181c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:44:03.039721 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:03.039692 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98a0db87-3e8e-4e19-b036-51a2de9181c2-kube-api-access-bnb5j" (OuterVolumeSpecName: "kube-api-access-bnb5j") pod "98a0db87-3e8e-4e19-b036-51a2de9181c2" (UID: "98a0db87-3e8e-4e19-b036-51a2de9181c2"). InnerVolumeSpecName "kube-api-access-bnb5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:44:03.043194 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:03.043167 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98a0db87-3e8e-4e19-b036-51a2de9181c2-util" (OuterVolumeSpecName: "util") pod "98a0db87-3e8e-4e19-b036-51a2de9181c2" (UID: "98a0db87-3e8e-4e19-b036-51a2de9181c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:44:03.138401 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:03.138368 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98a0db87-3e8e-4e19-b036-51a2de9181c2-bundle\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:44:03.138401 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:03.138396 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnb5j\" (UniqueName: \"kubernetes.io/projected/98a0db87-3e8e-4e19-b036-51a2de9181c2-kube-api-access-bnb5j\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:44:03.138401 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:03.138407 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98a0db87-3e8e-4e19-b036-51a2de9181c2-util\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:44:03.792029 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:03.791999 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" Jun 09 12:44:03.792029 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:03.792013 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748srlg4" event={"ID":"98a0db87-3e8e-4e19-b036-51a2de9181c2","Type":"ContainerDied","Data":"12b13e042d27f7115f49732582eb7f12bd13f0e61ca7e00be8a3452a9294946e"} Jun 09 12:44:03.792240 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:03.792054 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12b13e042d27f7115f49732582eb7f12bd13f0e61ca7e00be8a3452a9294946e" Jun 09 12:44:22.897728 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:22.897696 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:44:22.996618 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:22.996583 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:44:36.778297 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:36.778264 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:44:52.404138 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:52.404101 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:44:52.699536 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:52.699507 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:44:52.908866 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:52.908801 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bbf4d98c4-wv7t2"] Jun 09 12:44:52.909129 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:52.909117 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98a0db87-3e8e-4e19-b036-51a2de9181c2" containerName="pull" Jun 09 12:44:52.909173 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:52.909131 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="98a0db87-3e8e-4e19-b036-51a2de9181c2" containerName="pull" Jun 09 12:44:52.909173 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:52.909151 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98a0db87-3e8e-4e19-b036-51a2de9181c2" containerName="extract" Jun 09 12:44:52.909173 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:52.909156 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="98a0db87-3e8e-4e19-b036-51a2de9181c2" containerName="extract" Jun 09 12:44:52.909173 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:52.909163 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98a0db87-3e8e-4e19-b036-51a2de9181c2" containerName="util" Jun 09 12:44:52.909173 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:52.909169 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="98a0db87-3e8e-4e19-b036-51a2de9181c2" containerName="util" Jun 09 12:44:52.909326 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:52.909217 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="98a0db87-3e8e-4e19-b036-51a2de9181c2" containerName="extract" Jun 09 12:44:52.912533 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:52.912517 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbf4d98c4-wv7t2" Jun 09 12:44:52.924762 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:52.924738 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bbf4d98c4-wv7t2"] Jun 09 12:44:53.044116 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:53.044037 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dbgj\" (UniqueName: \"kubernetes.io/projected/2cb8fcc4-244e-46d4-b832-0cf527ddebf3-kube-api-access-4dbgj\") pod \"authorino-6bbf4d98c4-wv7t2\" (UID: \"2cb8fcc4-244e-46d4-b832-0cf527ddebf3\") " pod="kuadrant-system/authorino-6bbf4d98c4-wv7t2" Jun 09 12:44:53.061793 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:53.061766 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bbf4d98c4-wv7t2"] Jun 09 12:44:53.061995 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:44:53.061976 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4dbgj], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6bbf4d98c4-wv7t2" podUID="2cb8fcc4-244e-46d4-b832-0cf527ddebf3" Jun 09 12:44:53.144716 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:53.144679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dbgj\" (UniqueName: \"kubernetes.io/projected/2cb8fcc4-244e-46d4-b832-0cf527ddebf3-kube-api-access-4dbgj\") pod \"authorino-6bbf4d98c4-wv7t2\" (UID: \"2cb8fcc4-244e-46d4-b832-0cf527ddebf3\") " pod="kuadrant-system/authorino-6bbf4d98c4-wv7t2" Jun 09 12:44:53.152876 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:53.152850 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dbgj\" (UniqueName: \"kubernetes.io/projected/2cb8fcc4-244e-46d4-b832-0cf527ddebf3-kube-api-access-4dbgj\") pod \"authorino-6bbf4d98c4-wv7t2\" (UID: \"2cb8fcc4-244e-46d4-b832-0cf527ddebf3\") " pod="kuadrant-system/authorino-6bbf4d98c4-wv7t2" Jun 09 12:44:54.045199 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:54.045159 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbf4d98c4-wv7t2" Jun 09 12:44:54.052431 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:54.052408 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbf4d98c4-wv7t2" Jun 09 12:44:54.151894 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:54.151862 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dbgj\" (UniqueName: \"kubernetes.io/projected/2cb8fcc4-244e-46d4-b832-0cf527ddebf3-kube-api-access-4dbgj\") pod \"2cb8fcc4-244e-46d4-b832-0cf527ddebf3\" (UID: \"2cb8fcc4-244e-46d4-b832-0cf527ddebf3\") " Jun 09 12:44:54.153942 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:54.153923 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cb8fcc4-244e-46d4-b832-0cf527ddebf3-kube-api-access-4dbgj" (OuterVolumeSpecName: "kube-api-access-4dbgj") pod "2cb8fcc4-244e-46d4-b832-0cf527ddebf3" (UID: "2cb8fcc4-244e-46d4-b832-0cf527ddebf3"). InnerVolumeSpecName "kube-api-access-4dbgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:44:54.253361 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:54.253330 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dbgj\" (UniqueName: \"kubernetes.io/projected/2cb8fcc4-244e-46d4-b832-0cf527ddebf3-kube-api-access-4dbgj\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:44:54.580273 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:54.580239 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-klhnp"] Jun 09 12:44:54.580470 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:54.580404 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-klhnp" podUID="bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f" containerName="authorino" containerID="cri-o://15fdb67c01d58fc32147600a106e27088b78ae2d413ba5c5b6ddba02f20e4c01" gracePeriod=30 Jun 09 12:44:54.829646 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:54.829622 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-klhnp" Jun 09 12:44:54.960115 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:54.960086 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-962cg\" (UniqueName: \"kubernetes.io/projected/bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f-kube-api-access-962cg\") pod \"bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f\" (UID: \"bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f\") " Jun 09 12:44:54.962276 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:54.962242 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f-kube-api-access-962cg" (OuterVolumeSpecName: "kube-api-access-962cg") pod "bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f" (UID: "bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f"). InnerVolumeSpecName "kube-api-access-962cg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:44:55.051897 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:55.051862 2564 generic.go:356] "Generic (PLEG): container finished" podID="bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f" containerID="15fdb67c01d58fc32147600a106e27088b78ae2d413ba5c5b6ddba02f20e4c01" exitCode=0 Jun 09 12:44:55.052274 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:55.051899 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-klhnp" Jun 09 12:44:55.052274 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:55.051938 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-klhnp" event={"ID":"bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f","Type":"ContainerDied","Data":"15fdb67c01d58fc32147600a106e27088b78ae2d413ba5c5b6ddba02f20e4c01"} Jun 09 12:44:55.052274 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:55.051976 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-klhnp" event={"ID":"bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f","Type":"ContainerDied","Data":"2d81fc7817c0fe8a0c71ed372374b76329c4a5bb97007111f55c559f745d7761"} Jun 09 12:44:55.052274 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:55.051995 2564 scope.go:117] "RemoveContainer" containerID="15fdb67c01d58fc32147600a106e27088b78ae2d413ba5c5b6ddba02f20e4c01" Jun 09 12:44:55.052274 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:55.052023 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbf4d98c4-wv7t2" Jun 09 12:44:55.060943 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:55.060919 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-962cg\" (UniqueName: \"kubernetes.io/projected/bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f-kube-api-access-962cg\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\"" Jun 09 12:44:55.061118 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:55.061092 2564 scope.go:117] "RemoveContainer" containerID="15fdb67c01d58fc32147600a106e27088b78ae2d413ba5c5b6ddba02f20e4c01" Jun 09 12:44:55.061366 ip-10-0-133-167 kubenswrapper[2564]: E0609 12:44:55.061343 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15fdb67c01d58fc32147600a106e27088b78ae2d413ba5c5b6ddba02f20e4c01\": container with ID starting with 15fdb67c01d58fc32147600a106e27088b78ae2d413ba5c5b6ddba02f20e4c01 not found: ID does not exist" containerID="15fdb67c01d58fc32147600a106e27088b78ae2d413ba5c5b6ddba02f20e4c01" Jun 09 12:44:55.061423 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:55.061376 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15fdb67c01d58fc32147600a106e27088b78ae2d413ba5c5b6ddba02f20e4c01"} err="failed to get container status \"15fdb67c01d58fc32147600a106e27088b78ae2d413ba5c5b6ddba02f20e4c01\": rpc error: code = NotFound desc = could not find container \"15fdb67c01d58fc32147600a106e27088b78ae2d413ba5c5b6ddba02f20e4c01\": container with ID starting with 15fdb67c01d58fc32147600a106e27088b78ae2d413ba5c5b6ddba02f20e4c01 not found: ID does not exist" Jun 09 12:44:55.084070 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:55.084049 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bbf4d98c4-wv7t2"] Jun 09 12:44:55.087510 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:55.087489 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6bbf4d98c4-wv7t2"] Jun 09 12:44:55.092818 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:55.092797 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-klhnp"] Jun 09 12:44:55.096519 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:55.096499 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-klhnp"] Jun 09 12:44:56.779792 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:56.779763 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cb8fcc4-244e-46d4-b832-0cf527ddebf3" path="/var/lib/kubelet/pods/2cb8fcc4-244e-46d4-b832-0cf527ddebf3/volumes" Jun 09 12:44:56.780153 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:56.779979 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f" path="/var/lib/kubelet/pods/bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f/volumes" Jun 09 12:44:58.189676 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:58.189643 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:44:58.315574 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:58.315530 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:44:58.427782 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:58.427752 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:44:58.771726 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:44:58.771698 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:45:02.097616 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:02.097547 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:45:02.217604 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:02.217553 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:45:32.579826 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.579793 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:45:32.635792 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.635765 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-76cdcb8cdb-tm7kt"] Jun 09 12:45:32.636095 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.636084 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f" containerName="authorino" Jun 09 12:45:32.636139 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.636098 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f" containerName="authorino" Jun 09 12:45:32.636174 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.636167 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bef99ec4-5f7c-4e36-ab17-273fdaeb1a1f" containerName="authorino" Jun 09 12:45:32.639040 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.639024 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-76cdcb8cdb-tm7kt" Jun 09 12:45:32.640987 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.640963 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 09 12:45:32.641099 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.641002 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-sdf6h\"" Jun 09 12:45:32.650192 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.650171 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-76cdcb8cdb-tm7kt"] Jun 09 12:45:32.775207 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.775171 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9707e4f-3643-493a-ad29-229c9d3fb4de-maas-api-tls\") pod \"maas-api-76cdcb8cdb-tm7kt\" (UID: \"d9707e4f-3643-493a-ad29-229c9d3fb4de\") " pod="opendatahub/maas-api-76cdcb8cdb-tm7kt" Jun 09 12:45:32.775207 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.775207 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdvq5\" (UniqueName: \"kubernetes.io/projected/d9707e4f-3643-493a-ad29-229c9d3fb4de-kube-api-access-jdvq5\") pod \"maas-api-76cdcb8cdb-tm7kt\" (UID: \"d9707e4f-3643-493a-ad29-229c9d3fb4de\") " pod="opendatahub/maas-api-76cdcb8cdb-tm7kt" Jun 09 12:45:32.839095 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.839023 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:45:32.876274 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.876247 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9707e4f-3643-493a-ad29-229c9d3fb4de-maas-api-tls\") pod \"maas-api-76cdcb8cdb-tm7kt\" (UID: \"d9707e4f-3643-493a-ad29-229c9d3fb4de\") " pod="opendatahub/maas-api-76cdcb8cdb-tm7kt" Jun 09 12:45:32.876413 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.876280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdvq5\" (UniqueName: \"kubernetes.io/projected/d9707e4f-3643-493a-ad29-229c9d3fb4de-kube-api-access-jdvq5\") pod \"maas-api-76cdcb8cdb-tm7kt\" (UID: \"d9707e4f-3643-493a-ad29-229c9d3fb4de\") " pod="opendatahub/maas-api-76cdcb8cdb-tm7kt" Jun 09 12:45:32.878843 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.878820 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9707e4f-3643-493a-ad29-229c9d3fb4de-maas-api-tls\") pod \"maas-api-76cdcb8cdb-tm7kt\" (UID: \"d9707e4f-3643-493a-ad29-229c9d3fb4de\") " pod="opendatahub/maas-api-76cdcb8cdb-tm7kt" Jun 09 12:45:32.887407 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.887376 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdvq5\" (UniqueName: \"kubernetes.io/projected/d9707e4f-3643-493a-ad29-229c9d3fb4de-kube-api-access-jdvq5\") pod \"maas-api-76cdcb8cdb-tm7kt\" (UID: \"d9707e4f-3643-493a-ad29-229c9d3fb4de\") " pod="opendatahub/maas-api-76cdcb8cdb-tm7kt" Jun 09 12:45:32.949757 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:32.949727 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-76cdcb8cdb-tm7kt" Jun 09 12:45:33.054347 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:33.054318 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:45:33.098163 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:33.098136 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-76cdcb8cdb-tm7kt"] Jun 09 12:45:33.099634 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:45:33.099607 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9707e4f_3643_493a_ad29_229c9d3fb4de.slice/crio-bcae90759a7f468e8c284c6d14cce7da1e7396a5b7dd4082649721cf6b6c82ec WatchSource:0}: Error finding container bcae90759a7f468e8c284c6d14cce7da1e7396a5b7dd4082649721cf6b6c82ec: Status 404 returned error can't find the container with id bcae90759a7f468e8c284c6d14cce7da1e7396a5b7dd4082649721cf6b6c82ec Jun 09 12:45:33.100918 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:33.100903 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:45:33.168124 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:33.168095 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:45:33.255471 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:33.255431 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-76cdcb8cdb-tm7kt" event={"ID":"d9707e4f-3643-493a-ad29-229c9d3fb4de","Type":"ContainerStarted","Data":"bcae90759a7f468e8c284c6d14cce7da1e7396a5b7dd4082649721cf6b6c82ec"} Jun 09 12:45:33.287097 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:33.287057 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9f5wm"] Jun 09 12:45:36.276192 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:36.276159 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-76cdcb8cdb-tm7kt" event={"ID":"d9707e4f-3643-493a-ad29-229c9d3fb4de","Type":"ContainerStarted","Data":"36d1e433abce799c9012d12fd2c12027db6170671be0e9cb1e7af1c0bffa186e"} Jun 09 12:45:36.276583 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:36.276232 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-76cdcb8cdb-tm7kt" Jun 09 12:45:36.295051 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:36.295001 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-76cdcb8cdb-tm7kt" podStartSLOduration=2.103713639 podStartE2EDuration="4.294986487s" totalImagesPullingTime="2.191272848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:45:36.293277549 +0000 UTC m=+833.990764477" watchObservedRunningTime="2026-06-09 12:45:36.294986487 +0000 UTC m=+833.992473415" Jun 09 12:45:42.286939 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:45:42.286910 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-76cdcb8cdb-tm7kt" Jun 09 12:46:03.673777 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:03.673739 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:46:03.733999 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:03.733968 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:46:27.634287 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:27.634214 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:46:33.941869 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:33.941837 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d677bf464-ms9m7"] Jun 09 12:46:33.945383 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:33.945361 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d677bf464-ms9m7" Jun 09 12:46:33.948917 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:33.948896 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vmrgq\"" Jun 09 12:46:33.948997 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:33.948896 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 12:46:33.948997 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:33.948898 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 12:46:33.974476 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:33.974451 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d677bf464-ms9m7"] Jun 09 12:46:34.089954 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:34.089921 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ed8fbddb-8981-4602-948e-2aeb9a754ac7-oidc-ca\") pod \"authorino-7d677bf464-ms9m7\" (UID: \"ed8fbddb-8981-4602-948e-2aeb9a754ac7\") " pod="kuadrant-system/authorino-7d677bf464-ms9m7" Jun 09 12:46:34.090149 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:34.090050 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ed8fbddb-8981-4602-948e-2aeb9a754ac7-tls-cert\") pod \"authorino-7d677bf464-ms9m7\" (UID: \"ed8fbddb-8981-4602-948e-2aeb9a754ac7\") " pod="kuadrant-system/authorino-7d677bf464-ms9m7" Jun 09 12:46:34.090149 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:34.090084 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69jl9\" (UniqueName: \"kubernetes.io/projected/ed8fbddb-8981-4602-948e-2aeb9a754ac7-kube-api-access-69jl9\") pod \"authorino-7d677bf464-ms9m7\" (UID: \"ed8fbddb-8981-4602-948e-2aeb9a754ac7\") " pod="kuadrant-system/authorino-7d677bf464-ms9m7" Jun 09 12:46:34.191439 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:34.191407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ed8fbddb-8981-4602-948e-2aeb9a754ac7-tls-cert\") pod \"authorino-7d677bf464-ms9m7\" (UID: \"ed8fbddb-8981-4602-948e-2aeb9a754ac7\") " pod="kuadrant-system/authorino-7d677bf464-ms9m7" Jun 09 12:46:34.191439 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:34.191442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69jl9\" (UniqueName: \"kubernetes.io/projected/ed8fbddb-8981-4602-948e-2aeb9a754ac7-kube-api-access-69jl9\") pod \"authorino-7d677bf464-ms9m7\" (UID: \"ed8fbddb-8981-4602-948e-2aeb9a754ac7\") " pod="kuadrant-system/authorino-7d677bf464-ms9m7" Jun 09 12:46:34.191670 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:34.191466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ed8fbddb-8981-4602-948e-2aeb9a754ac7-oidc-ca\") pod \"authorino-7d677bf464-ms9m7\" (UID: \"ed8fbddb-8981-4602-948e-2aeb9a754ac7\") " pod="kuadrant-system/authorino-7d677bf464-ms9m7" Jun 09 12:46:34.192113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:34.192071 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ed8fbddb-8981-4602-948e-2aeb9a754ac7-oidc-ca\") pod \"authorino-7d677bf464-ms9m7\" (UID: \"ed8fbddb-8981-4602-948e-2aeb9a754ac7\") " pod="kuadrant-system/authorino-7d677bf464-ms9m7" Jun 09 12:46:34.193764 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:34.193745 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ed8fbddb-8981-4602-948e-2aeb9a754ac7-tls-cert\") pod \"authorino-7d677bf464-ms9m7\" (UID: \"ed8fbddb-8981-4602-948e-2aeb9a754ac7\") " pod="kuadrant-system/authorino-7d677bf464-ms9m7" Jun 09 12:46:34.201123 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:34.201090 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69jl9\" (UniqueName: \"kubernetes.io/projected/ed8fbddb-8981-4602-948e-2aeb9a754ac7-kube-api-access-69jl9\") pod \"authorino-7d677bf464-ms9m7\" (UID: \"ed8fbddb-8981-4602-948e-2aeb9a754ac7\") " pod="kuadrant-system/authorino-7d677bf464-ms9m7" Jun 09 12:46:34.254054 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:34.254029 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d677bf464-ms9m7" Jun 09 12:46:34.393208 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:34.393168 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d677bf464-ms9m7"] Jun 09 12:46:34.393534 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:46:34.393510 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded8fbddb_8981_4602_948e_2aeb9a754ac7.slice/crio-d6cec5361edec8e3c31c36842dc38538c408775669632b96705e1a5fd34cf2f3 WatchSource:0}: Error finding container d6cec5361edec8e3c31c36842dc38538c408775669632b96705e1a5fd34cf2f3: Status 404 returned error can't find the container with id d6cec5361edec8e3c31c36842dc38538c408775669632b96705e1a5fd34cf2f3 Jun 09 12:46:34.579508 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:34.579469 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d677bf464-ms9m7" event={"ID":"ed8fbddb-8981-4602-948e-2aeb9a754ac7","Type":"ContainerStarted","Data":"d6cec5361edec8e3c31c36842dc38538c408775669632b96705e1a5fd34cf2f3"} Jun 09 12:46:35.586689 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:35.586651 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d677bf464-ms9m7" event={"ID":"ed8fbddb-8981-4602-948e-2aeb9a754ac7","Type":"ContainerStarted","Data":"1d553581319696dbda5190dee692bca3a3d096d1d1f7ea0ceceed5b48e2522bc"} Jun 09 12:46:35.601723 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:35.601656 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d677bf464-ms9m7" podStartSLOduration=2.172680927 podStartE2EDuration="2.60164241s" totalImagesPullingTime="428.961483ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:46:35.601438491 +0000 UTC m=+893.298925419" watchObservedRunningTime="2026-06-09 12:46:35.60164241 +0000 UTC m=+893.299129339" Jun 09 12:46:36.156218 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:36.156185 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:46:36.246062 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:36.246028 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:46:41.320236 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:41.320196 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:46:41.748332 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:41.748298 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9f5wm"] Jun 09 12:46:42.787914 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:42.787885 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/2.log" Jun 09 12:46:42.788548 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:42.788530 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/2.log" Jun 09 12:46:42.791812 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:42.791791 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgb8g_593b1faa-5b02-4e90-b05c-d3b4724e8de9/ovn-acl-logging/0.log" Jun 09 12:46:42.792709 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:42.792688 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgb8g_593b1faa-5b02-4e90-b05c-d3b4724e8de9/ovn-acl-logging/0.log" Jun 09 12:46:47.463918 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:47.463888 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:46:47.925379 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:46:47.925305 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9f5wm"] Jun 09 12:47:02.741940 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:47:02.741906 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:47:11.949248 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:47:11.949212 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:47:12.707222 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:47:12.707182 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9f5wm"] Jun 09 12:47:15.577085 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:47:15.577049 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:47:15.727910 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:47:15.727875 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:47:33.228765 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:47:33.228732 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:47:33.995203 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:47:33.995167 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9f5wm"] Jun 09 12:47:45.035095 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:47:45.035062 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:47:46.085662 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:47:46.085631 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9f5wm"] Jun 09 12:48:03.445244 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:48:03.445149 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:48:04.502283 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:48:04.502239 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9f5wm"] Jun 09 12:48:18.105034 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:48:18.104985 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:50:08.297533 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:50:08.297495 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:51:40.134652 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:40.134620 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d677bf464-ms9m7_ed8fbddb-8981-4602-948e-2aeb9a754ac7/authorino/0.log" Jun 09 12:51:42.824350 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:42.824324 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/2.log" Jun 09 12:51:42.826519 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:42.826497 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/2.log" Jun 09 12:51:42.828708 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:42.828686 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgb8g_593b1faa-5b02-4e90-b05c-d3b4724e8de9/ovn-acl-logging/0.log" Jun 09 12:51:42.831131 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:42.831110 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tgb8g_593b1faa-5b02-4e90-b05c-d3b4724e8de9/ovn-acl-logging/0.log" Jun 09 12:51:44.958574 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:44.958540 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5fd759c44c-szmnv_6d4c6224-ff1a-4b15-813b-40d6cbd4b286/nginx/0.log" Jun 09 12:51:45.077965 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:45.077929 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-gpbcm_20eb0956-1c38-46bf-828d-21689c5f3bf7/manager/0.log" Jun 09 12:51:45.206765 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:45.206727 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-px9pn_dd02057b-df2e-4290-84b0-be1b40aaa115/manager/0.log" Jun 09 12:51:45.327475 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:45.327396 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-76cdcb8cdb-tm7kt_d9707e4f-3643-493a-ad29-229c9d3fb4de/maas-api/0.log" Jun 09 12:51:45.568284 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:45.568259 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-r68d8_721a08c6-6741-49ea-a7c4-ba73532c50e3/server/0.log" Jun 09 12:51:45.689895 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:45.689808 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-bk9pc_d414bef9-4c94-4bf6-baeb-6e606622767e/manager/0.log" Jun 09 12:51:46.098242 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:46.098218 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4c856db4-js8ss_e82d2312-95f2-4bd9-8bc5-140dfe07998a/copy-manifests/0.log" Jun 09 12:51:46.117661 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:46.117636 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4c856db4-js8ss_e82d2312-95f2-4bd9-8bc5-140dfe07998a/manager/0.log" Jun 09 12:51:47.070244 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:47.070212 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk_32dcf6b6-6d3e-4b7b-ad4a-536abed9c327/pull/0.log" Jun 09 12:51:47.086059 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:47.086038 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk_32dcf6b6-6d3e-4b7b-ad4a-536abed9c327/extract/0.log" Jun 09 12:51:47.096231 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:47.096211 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk_32dcf6b6-6d3e-4b7b-ad4a-536abed9c327/util/0.log" Jun 09 12:51:47.225597 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:47.225546 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56_4d38359e-ce8f-4308-9adb-593d823fab31/extract/0.log" Jun 09 12:51:47.232483 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:47.232459 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56_4d38359e-ce8f-4308-9adb-593d823fab31/util/0.log" Jun 09 12:51:47.239716 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:47.239701 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56_4d38359e-ce8f-4308-9adb-593d823fab31/pull/0.log" Jun 09 12:51:47.352636 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:47.352550 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h_17b62f8c-a428-4790-9822-4a158e7199e3/util/0.log" Jun 09 12:51:47.359393 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:47.359366 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h_17b62f8c-a428-4790-9822-4a158e7199e3/pull/0.log" Jun 09 12:51:47.366372 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:47.366357 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h_17b62f8c-a428-4790-9822-4a158e7199e3/extract/0.log" Jun 09 12:51:47.491942 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:47.491912 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk_2101c40a-06eb-480c-9131-6ee2af793732/util/0.log" Jun 09 12:51:47.499108 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:47.499077 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk_2101c40a-06eb-480c-9131-6ee2af793732/pull/0.log" Jun 09 12:51:47.506068 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:47.506047 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk_2101c40a-06eb-480c-9131-6ee2af793732/extract/0.log" Jun 09 12:51:47.675149 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:47.675078 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d677bf464-ms9m7_ed8fbddb-8981-4602-948e-2aeb9a754ac7/authorino/0.log" Jun 09 12:51:47.797080 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:47.797047 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-n2g55_cd574963-b29b-49d8-bfc8-1e08e23ac2d1/manager/0.log" Jun 09 12:51:48.398317 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:48.398283 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9f5wm_c06ca832-9f76-4387-ac2d-31641a2b08f1/limitador/0.log" Jun 09 12:51:49.023652 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:49.023624 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rfc9t_06469d4b-c49c-4ecd-bb8b-d2d49a516bd4/discovery/0.log" Jun 09 12:51:49.138788 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:49.138750 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79dfc5c477-r6w7m_aad4e827-9b32-4c99-b26f-1b90410e2fd6/kube-auth-proxy/0.log" Jun 09 12:51:49.706152 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:49.706128 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-98d765c7f-2fw6t_0bd6da96-28ea-47a0-b935-b389c8d132d8/router/0.log" Jun 09 12:51:55.373929 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.373887 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m2w5j/must-gather-4fb5h"] Jun 09 12:51:55.377569 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.377532 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m2w5j/must-gather-4fb5h" Jun 09 12:51:55.380113 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.380089 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m2w5j\"/\"default-dockercfg-pv9dm\"" Jun 09 12:51:55.380385 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.380369 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m2w5j\"/\"kube-root-ca.crt\"" Jun 09 12:51:55.380472 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.380404 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m2w5j\"/\"openshift-service-ca.crt\"" Jun 09 12:51:55.386842 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.386818 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m2w5j/must-gather-4fb5h"] Jun 09 12:51:55.415743 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.415708 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:51:55.458961 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.458928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ggrq\" (UniqueName: \"kubernetes.io/projected/4e1d6866-62ea-490e-b317-b96fce8ece8c-kube-api-access-4ggrq\") pod \"must-gather-4fb5h\" (UID: \"4e1d6866-62ea-490e-b317-b96fce8ece8c\") " pod="openshift-must-gather-m2w5j/must-gather-4fb5h" Jun 09 12:51:55.459078 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.458996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4e1d6866-62ea-490e-b317-b96fce8ece8c-must-gather-output\") pod \"must-gather-4fb5h\" (UID: \"4e1d6866-62ea-490e-b317-b96fce8ece8c\") " pod="openshift-must-gather-m2w5j/must-gather-4fb5h" Jun 09 12:51:55.560063 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.560021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ggrq\" (UniqueName: \"kubernetes.io/projected/4e1d6866-62ea-490e-b317-b96fce8ece8c-kube-api-access-4ggrq\") pod \"must-gather-4fb5h\" (UID: \"4e1d6866-62ea-490e-b317-b96fce8ece8c\") " pod="openshift-must-gather-m2w5j/must-gather-4fb5h" Jun 09 12:51:55.560239 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.560089 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4e1d6866-62ea-490e-b317-b96fce8ece8c-must-gather-output\") pod \"must-gather-4fb5h\" (UID: \"4e1d6866-62ea-490e-b317-b96fce8ece8c\") " pod="openshift-must-gather-m2w5j/must-gather-4fb5h" Jun 09 12:51:55.560451 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.560427 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4e1d6866-62ea-490e-b317-b96fce8ece8c-must-gather-output\") pod \"must-gather-4fb5h\" (UID: \"4e1d6866-62ea-490e-b317-b96fce8ece8c\") " pod="openshift-must-gather-m2w5j/must-gather-4fb5h" Jun 09 12:51:55.579247 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.579213 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ggrq\" (UniqueName: \"kubernetes.io/projected/4e1d6866-62ea-490e-b317-b96fce8ece8c-kube-api-access-4ggrq\") pod \"must-gather-4fb5h\" (UID: \"4e1d6866-62ea-490e-b317-b96fce8ece8c\") " pod="openshift-must-gather-m2w5j/must-gather-4fb5h" Jun 09 12:51:55.687168 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.687084 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m2w5j/must-gather-4fb5h" Jun 09 12:51:55.825383 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.825353 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m2w5j/must-gather-4fb5h"] Jun 09 12:51:55.826790 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:51:55.826755 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e1d6866_62ea_490e_b317_b96fce8ece8c.slice/crio-3803e98a3955125788aec797e3e53f02c1dd94e14b51ed5b750ca4fbfa788b79 WatchSource:0}: Error finding container 3803e98a3955125788aec797e3e53f02c1dd94e14b51ed5b750ca4fbfa788b79: Status 404 returned error can't find the container with id 3803e98a3955125788aec797e3e53f02c1dd94e14b51ed5b750ca4fbfa788b79 Jun 09 12:51:55.828598 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:55.828581 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:51:56.272215 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:56.272180 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m2w5j/must-gather-4fb5h" event={"ID":"4e1d6866-62ea-490e-b317-b96fce8ece8c","Type":"ContainerStarted","Data":"3803e98a3955125788aec797e3e53f02c1dd94e14b51ed5b750ca4fbfa788b79"} Jun 09 12:51:56.527468 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:56.527383 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" limit=1024 Jun 09 12:51:57.283382 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:57.283346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m2w5j/must-gather-4fb5h" event={"ID":"4e1d6866-62ea-490e-b317-b96fce8ece8c","Type":"ContainerStarted","Data":"83955682c3963ac3c055ec54c3c65f9a8e859f0c3d44c87f26ec68ee7bcf4f8c"} Jun 09 12:51:57.283629 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:57.283401 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m2w5j/must-gather-4fb5h" event={"ID":"4e1d6866-62ea-490e-b317-b96fce8ece8c","Type":"ContainerStarted","Data":"3df66b0c3e21107ea6bb3a715d44e17aeea896f3c88bfc580423884514309f05"} Jun 09 12:51:57.310351 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:57.310297 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m2w5j/must-gather-4fb5h" podStartSLOduration=1.319436986 podStartE2EDuration="2.310282445s" totalImagesPullingTime="990.845459ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:51:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:51:57.307333934 +0000 UTC m=+1215.004820864" watchObservedRunningTime="2026-06-09 12:51:57.310282445 +0000 UTC m=+1215.007769406" Jun 09 12:51:58.574914 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:58.574886 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2jgwm_f203b2b9-f1b1-4e3b-bf90-b4618a470c1a/global-pull-secret-syncer/0.log" Jun 09 12:51:58.730272 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:58.730245 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6jc5n_86e23f6f-b74a-44a7-abac-9b22598d2078/konnectivity-agent/0.log" Jun 09 12:51:58.808006 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:51:58.807982 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-167.ec2.internal_63c7b38b62446b7059ee929b7e5f5e83/haproxy/0.log" Jun 09 12:52:01.780432 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:01.780393 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-x8tc5_1e56c1db-f9ff-471d-9986-75248dcb0460/sail-operator/0.log" Jun 09 12:52:03.042348 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.042321 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk_32dcf6b6-6d3e-4b7b-ad4a-536abed9c327/extract/0.log" Jun 09 12:52:03.080079 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.079996 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk_32dcf6b6-6d3e-4b7b-ad4a-536abed9c327/util/0.log" Jun 09 12:52:03.113112 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.113074 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5zdk_32dcf6b6-6d3e-4b7b-ad4a-536abed9c327/pull/0.log" Jun 09 12:52:03.148680 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.148638 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56_4d38359e-ce8f-4308-9adb-593d823fab31/extract/0.log" Jun 09 12:52:03.174876 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.174852 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56_4d38359e-ce8f-4308-9adb-593d823fab31/util/0.log" Jun 09 12:52:03.200263 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.200239 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g8w56_4d38359e-ce8f-4308-9adb-593d823fab31/pull/0.log" Jun 09 12:52:03.231006 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.230982 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h_17b62f8c-a428-4790-9822-4a158e7199e3/extract/0.log" Jun 09 12:52:03.257488 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.257463 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h_17b62f8c-a428-4790-9822-4a158e7199e3/util/0.log" Jun 09 12:52:03.286048 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.286017 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zl65h_17b62f8c-a428-4790-9822-4a158e7199e3/pull/0.log" Jun 09 12:52:03.327438 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.327414 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk_2101c40a-06eb-480c-9131-6ee2af793732/extract/0.log" Jun 09 12:52:03.355679 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.355597 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk_2101c40a-06eb-480c-9131-6ee2af793732/util/0.log" Jun 09 12:52:03.383241 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.383215 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12srrk_2101c40a-06eb-480c-9131-6ee2af793732/pull/0.log" Jun 09 12:52:03.420857 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.420831 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d677bf464-ms9m7_ed8fbddb-8981-4602-948e-2aeb9a754ac7/authorino/0.log" Jun 09 12:52:03.457916 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.457878 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-n2g55_cd574963-b29b-49d8-bfc8-1e08e23ac2d1/manager/0.log" Jun 09 12:52:03.620744 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:03.620639 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9f5wm_c06ca832-9f76-4387-ac2d-31641a2b08f1/limitador/0.log" Jun 09 12:52:05.972440 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:05.972363 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8msz8_11514555-5302-437a-83e1-ac5d5e126faf/node-exporter/0.log" Jun 09 12:52:06.003464 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:06.003436 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8msz8_11514555-5302-437a-83e1-ac5d5e126faf/kube-rbac-proxy/0.log" Jun 09 12:52:06.032880 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:06.032849 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8msz8_11514555-5302-437a-83e1-ac5d5e126faf/init-textfile/0.log" Jun 09 12:52:08.736652 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:08.736611 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/2.log" Jun 09 12:52:08.742476 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:08.742451 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-gldp6_7a40ef0a-d3fa-46ed-a98f-8b3e8d06af68/console-operator/3.log" Jun 09 12:52:08.823499 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:08.823462 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx"] Jun 09 12:52:08.830040 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:08.830009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:08.837864 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:08.837833 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx"] Jun 09 12:52:08.996475 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:08.996388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnb4d\" (UniqueName: \"kubernetes.io/projected/d7431ca0-8931-4fb4-a794-275b065e3bef-kube-api-access-hnb4d\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:08.996475 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:08.996429 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7431ca0-8931-4fb4-a794-275b065e3bef-proc\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:08.996717 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:08.996490 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7431ca0-8931-4fb4-a794-275b065e3bef-sys\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:08.996717 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:08.996519 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7431ca0-8931-4fb4-a794-275b065e3bef-podres\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:08.996717 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:08.996544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7431ca0-8931-4fb4-a794-275b065e3bef-lib-modules\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:09.098020 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.097988 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnb4d\" (UniqueName: \"kubernetes.io/projected/d7431ca0-8931-4fb4-a794-275b065e3bef-kube-api-access-hnb4d\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:09.098020 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.098030 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7431ca0-8931-4fb4-a794-275b065e3bef-proc\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:09.098269 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.098071 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7431ca0-8931-4fb4-a794-275b065e3bef-sys\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:09.098269 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.098099 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7431ca0-8931-4fb4-a794-275b065e3bef-podres\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:09.098269 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.098117 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7431ca0-8931-4fb4-a794-275b065e3bef-lib-modules\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:09.098269 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.098245 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7431ca0-8931-4fb4-a794-275b065e3bef-lib-modules\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:09.098538 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.098285 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7431ca0-8931-4fb4-a794-275b065e3bef-proc\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:09.098538 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.098316 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7431ca0-8931-4fb4-a794-275b065e3bef-sys\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:09.098538 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.098362 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7431ca0-8931-4fb4-a794-275b065e3bef-podres\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:09.107170 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.107125 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnb4d\" (UniqueName: \"kubernetes.io/projected/d7431ca0-8931-4fb4-a794-275b065e3bef-kube-api-access-hnb4d\") pod \"perf-node-gather-daemonset-4ftgx\" (UID: \"d7431ca0-8931-4fb4-a794-275b065e3bef\") " pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:09.145235 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.145204 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:09.330775 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.330743 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx"] Jun 09 12:52:09.334689 ip-10-0-133-167 kubenswrapper[2564]: W0609 12:52:09.334658 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd7431ca0_8931_4fb4_a794_275b065e3bef.slice/crio-21ad5cbff8cab38f548fbdef9316d5bbaef70eaadfc06364219164ddeec6022f WatchSource:0}: Error finding container 21ad5cbff8cab38f548fbdef9316d5bbaef70eaadfc06364219164ddeec6022f: Status 404 returned error can't find the container with id 21ad5cbff8cab38f548fbdef9316d5bbaef70eaadfc06364219164ddeec6022f Jun 09 12:52:09.356328 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.356149 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-686b498c4f-fgxqp_922082cb-572a-43de-b90e-6fd0f41253fe/console/0.log" Jun 09 12:52:09.386674 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.386651 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-dfqlb_5fec9619-45d9-4202-b140-d4cccf7392d8/download-server/0.log" Jun 09 12:52:09.405589 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:09.399757 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" event={"ID":"d7431ca0-8931-4fb4-a794-275b065e3bef","Type":"ContainerStarted","Data":"21ad5cbff8cab38f548fbdef9316d5bbaef70eaadfc06364219164ddeec6022f"} Jun 09 12:52:10.095410 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:10.095375 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-9g69p_7a055be1-d460-4cd1-a19d-9d6790702b9c/volume-data-source-validator/0.log" Jun 09 12:52:10.407396 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:10.407298 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" event={"ID":"d7431ca0-8931-4fb4-a794-275b065e3bef","Type":"ContainerStarted","Data":"530332ae55ae4ed6aded2576a802ce61f84d91bdc30b1289935547658d7200b5"} Jun 09 12:52:10.407782 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:10.407473 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:10.425828 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:10.425779 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" podStartSLOduration=2.425764059 podStartE2EDuration="2.425764059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:52:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:52:10.424973802 +0000 UTC m=+1228.122460733" watchObservedRunningTime="2026-06-09 12:52:10.425764059 +0000 UTC m=+1228.123250988" Jun 09 12:52:11.344792 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:11.344765 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w7l97_75004378-a4fe-48db-9825-2d3cf54da59a/dns/0.log" Jun 09 12:52:11.370540 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:11.370517 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w7l97_75004378-a4fe-48db-9825-2d3cf54da59a/kube-rbac-proxy/0.log" Jun 09 12:52:11.397145 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:11.397109 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fcwvm_cf20c681-6757-49db-ac7a-3070a1d69d4c/dns-node-resolver/0.log" Jun 09 12:52:12.049215 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:12.047467 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75df887df-n6q27_9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4/registry/0.log" Jun 09 12:52:12.052395 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:12.052345 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75df887df-n6q27_9b470b27-7a1f-4f1f-bbfb-e3e3554ce4a4/registry/1.log" Jun 09 12:52:12.100599 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:12.100526 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qlfnh_fed43365-44f8-4220-87ec-327acf7f874f/node-ca/0.log" Jun 09 12:52:13.230881 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:13.230851 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rfc9t_06469d4b-c49c-4ecd-bb8b-d2d49a516bd4/discovery/0.log" Jun 09 12:52:13.257066 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:13.257041 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79dfc5c477-r6w7m_aad4e827-9b32-4c99-b26f-1b90410e2fd6/kube-auth-proxy/0.log" Jun 09 12:52:13.416830 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:13.416803 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-98d765c7f-2fw6t_0bd6da96-28ea-47a0-b935-b389c8d132d8/router/0.log" Jun 09 12:52:14.053097 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:14.053070 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8q6ht_fc101d88-babb-4b12-a41c-5054275e8682/serve-healthcheck-canary/0.log" Jun 09 12:52:14.801257 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:14.801230 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bz7m6_b80db2bd-1e4e-4ed1-a710-4635c2ffcab3/kube-rbac-proxy/0.log" Jun 09 12:52:14.835250 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:14.835220 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bz7m6_b80db2bd-1e4e-4ed1-a710-4635c2ffcab3/exporter/0.log" Jun 09 12:52:14.867796 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:14.867768 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bz7m6_b80db2bd-1e4e-4ed1-a710-4635c2ffcab3/extractor/0.log" Jun 09 12:52:16.423131 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:16.423104 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m2w5j/perf-node-gather-daemonset-4ftgx" Jun 09 12:52:17.419199 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:17.419171 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5fd759c44c-szmnv_6d4c6224-ff1a-4b15-813b-40d6cbd4b286/nginx/0.log" Jun 09 12:52:17.480163 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:17.480111 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-gpbcm_20eb0956-1c38-46bf-828d-21689c5f3bf7/manager/0.log" Jun 09 12:52:17.539645 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:17.539613 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-px9pn_dd02057b-df2e-4290-84b0-be1b40aaa115/manager/0.log" Jun 09 12:52:17.581764 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:17.581734 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-76cdcb8cdb-tm7kt_d9707e4f-3643-493a-ad29-229c9d3fb4de/maas-api/0.log" Jun 09 12:52:17.672055 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:17.671970 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-r68d8_721a08c6-6741-49ea-a7c4-ba73532c50e3/server/0.log" Jun 09 12:52:17.737800 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:17.737770 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-bk9pc_d414bef9-4c94-4bf6-baeb-6e606622767e/manager/0.log" Jun 09 12:52:17.993161 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:17.993120 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4c856db4-js8ss_e82d2312-95f2-4bd9-8bc5-140dfe07998a/manager/0.log" Jun 09 12:52:18.013959 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:18.013931 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b4c856db4-js8ss_e82d2312-95f2-4bd9-8bc5-140dfe07998a/copy-manifests/0.log" Jun 09 12:52:19.784623 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:19.784588 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-6dlzt_2b67324e-87e3-4cb5-9a2e-2d51dc9022f3/openshift-lws-operator/0.log" Jun 09 12:52:22.716018 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:22.715986 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rfc9t_06469d4b-c49c-4ecd-bb8b-d2d49a516bd4/discovery/0.log" Jun 09 12:52:22.728246 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:22.728215 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79dfc5c477-r6w7m_aad4e827-9b32-4c99-b26f-1b90410e2fd6/kube-auth-proxy/0.log" Jun 09 12:52:22.841542 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:22.841514 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-98d765c7f-2fw6t_0bd6da96-28ea-47a0-b935-b389c8d132d8/router/0.log" Jun 09 12:52:23.962498 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:23.962460 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rfc9t_06469d4b-c49c-4ecd-bb8b-d2d49a516bd4/discovery/0.log" Jun 09 12:52:23.974515 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:23.974490 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79dfc5c477-r6w7m_aad4e827-9b32-4c99-b26f-1b90410e2fd6/kube-auth-proxy/0.log" Jun 09 12:52:24.086141 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:24.086114 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-98d765c7f-2fw6t_0bd6da96-28ea-47a0-b935-b389c8d132d8/router/0.log" Jun 09 12:52:25.830312 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:25.830228 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-rfc9t_06469d4b-c49c-4ecd-bb8b-d2d49a516bd4/discovery/0.log" Jun 09 12:52:25.842606 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:25.842540 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79dfc5c477-r6w7m_aad4e827-9b32-4c99-b26f-1b90410e2fd6/kube-auth-proxy/0.log" Jun 09 12:52:25.942097 ip-10-0-133-167 kubenswrapper[2564]: I0609 12:52:25.942070 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-98d765c7f-2fw6t_0bd6da96-28ea-47a0-b935-b389c8d132d8/router/0.log"