Jun 09 07:55:19.360478 ip-10-0-139-124 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 07:55:19.360495 ip-10-0-139-124 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 07:55:19.360505 ip-10-0-139-124 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 07:55:19.360856 ip-10-0-139-124 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 07:55:29.879962 ip-10-0-139-124 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 07:55:29.879974 ip-10-0-139-124 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2c7e7ed4e192451aba51cbb6ce3f044e -- Jun 09 07:57:52.201288 ip-10-0-139-124 systemd[1]: Starting Kubernetes Kubelet... Jun 09 07:57:52.645633 ip-10-0-139-124 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 07:57:52.645633 ip-10-0-139-124 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 07:57:52.645633 ip-10-0-139-124 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 07:57:52.645633 ip-10-0-139-124 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 07:57:52.645633 ip-10-0-139-124 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 07:57:52.646709 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.646623 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 07:57:52.650991 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.650974 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 07:57:52.650991 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.650991 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.650996 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.650999 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651002 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651005 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651008 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651011 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651013 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651016 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651019 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651021 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651026 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651030 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651032 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651035 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651038 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651040 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651043 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651046 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651048 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 07:57:52.651057 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651051 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651053 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651057 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651060 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651063 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651066 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651069 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651072 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651075 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651077 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651080 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651082 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651085 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651087 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651090 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651093 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651095 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651098 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651100 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651103 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 07:57:52.651615 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651106 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651108 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651111 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651113 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651116 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651118 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651121 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651123 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651126 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651128 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651130 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651133 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651136 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651139 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651142 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651146 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651149 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651151 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651153 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651156 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 07:57:52.652161 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651159 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651161 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651164 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651167 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651169 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651172 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651175 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651177 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651180 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651183 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651186 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651189 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651192 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651194 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651197 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651199 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651202 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651205 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651207 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 07:57:52.652647 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651211 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651213 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651216 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651220 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651224 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651227 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651230 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651233 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651238 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651241 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651244 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651246 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651249 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651252 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651255 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651257 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651260 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651262 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651265 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 07:57:52.653108 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651987 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651994 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.651997 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652000 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652003 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652006 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652010 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652013 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652015 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652018 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652021 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652023 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652026 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652028 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652031 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652033 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652036 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652039 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652042 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652045 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 07:57:52.653563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652048 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652051 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652053 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652056 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652059 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652062 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652064 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652067 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652069 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652072 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652074 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652077 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652079 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652082 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652084 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652087 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652089 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652092 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652095 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652098 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 07:57:52.654069 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652101 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652103 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652106 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652108 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652111 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652114 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652116 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652118 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652121 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652124 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652127 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652131 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652134 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652139 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652143 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652146 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652149 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652152 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652154 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 07:57:52.654563 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652157 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652159 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652162 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652165 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652169 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652172 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652175 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652178 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652181 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652183 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652185 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652188 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652191 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652194 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652196 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652199 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652201 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652204 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652206 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652209 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 07:57:52.655138 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652211 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652214 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652217 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652219 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652222 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652226 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652228 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652230 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652233 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652236 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652238 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652242 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652245 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652248 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652251 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652254 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652257 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652259 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652262 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 07:57:52.655636 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652264 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652756 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652768 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652773 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652776 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652779 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652782 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652785 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652788 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652790 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652793 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652798 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652803 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652806 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652809 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652812 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652815 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652817 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652820 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 07:57:52.656117 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652822 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652825 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652828 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652831 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652833 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652836 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652839 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652842 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652844 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652847 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652849 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652852 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652855 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652857 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652860 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652866 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652870 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652873 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652876 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652878 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 07:57:52.656580 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652881 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652883 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652886 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652888 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652891 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652893 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652896 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652899 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652903 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652906 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652909 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652912 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652915 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652918 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652921 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652924 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652939 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652942 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652945 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652947 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 07:57:52.657077 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652950 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652953 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652955 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652958 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652960 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652963 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652965 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652973 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652978 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652981 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652985 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652987 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652990 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652993 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652995 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.652998 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653001 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653003 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653006 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 07:57:52.657553 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653009 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653011 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653013 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653016 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653018 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653021 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653024 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653026 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653029 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653032 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653034 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653037 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653039 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653042 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653044 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653047 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653049 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653052 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653054 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653057 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 07:57:52.658022 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653062 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653064 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653149 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653160 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653170 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653175 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653231 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653235 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653240 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653245 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653249 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653252 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653256 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653259 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653262 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653265 2577 flags.go:64] FLAG: --cgroup-root="" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653268 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653271 2577 flags.go:64] FLAG: --client-ca-file="" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653274 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653277 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653281 2577 flags.go:64] FLAG: --cluster-domain="" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653284 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653287 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653291 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 07:57:52.658512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653294 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653298 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653301 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653304 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653308 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653310 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653313 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653316 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653322 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653325 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653329 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653336 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653340 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653342 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653346 2577 flags.go:64] FLAG: --enable-server="true" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653349 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653354 2577 flags.go:64] FLAG: --event-burst="100" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653358 2577 flags.go:64] FLAG: --event-qps="50" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653361 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653364 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653367 2577 flags.go:64] FLAG: --eviction-hard="" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653371 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653374 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653377 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653380 2577 flags.go:64] FLAG: --eviction-soft="" Jun 09 07:57:52.659130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653383 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653386 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653388 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653391 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653394 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653397 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653400 2577 flags.go:64] FLAG: --feature-gates="" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653404 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653407 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653410 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653413 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653417 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653419 2577 flags.go:64] FLAG: --help="false" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653422 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-139-124.ec2.internal" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653425 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653430 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653433 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653436 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653440 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653443 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653446 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653449 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653452 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 07:57:52.659756 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653455 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653458 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653461 2577 flags.go:64] FLAG: --kube-reserved="" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653464 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653467 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653470 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653472 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653475 2577 flags.go:64] FLAG: --lock-file="" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653478 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653481 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653484 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653489 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653492 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653495 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653498 2577 flags.go:64] FLAG: --logging-format="text" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653501 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653505 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653507 2577 flags.go:64] FLAG: --manifest-url="" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653510 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653515 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653518 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653522 2577 flags.go:64] FLAG: --max-pods="110" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653525 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653528 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653533 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 07:57:52.660424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653536 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653539 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653542 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653546 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653556 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653560 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653563 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653566 2577 flags.go:64] FLAG: --pod-cidr="" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653569 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653575 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653578 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653581 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653584 2577 flags.go:64] FLAG: --port="10250" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653587 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653590 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07794d92d44b4fdc6" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653593 2577 flags.go:64] FLAG: --qos-reserved="" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653596 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653599 2577 flags.go:64] FLAG: --register-node="true" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653602 2577 flags.go:64] FLAG: --register-with-taints="" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653606 2577 flags.go:64] FLAG: --registry-burst="10" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653609 2577 flags.go:64] FLAG: --registry-qps="5" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653611 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653614 2577 flags.go:64] FLAG: --reserved-memory="" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653618 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653621 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 07:57:52.661077 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653624 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653627 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653630 2577 flags.go:64] FLAG: --runonce="false" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653633 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653636 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653639 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653647 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653651 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653654 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653657 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653660 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653663 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653672 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653674 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653677 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653681 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653683 2577 flags.go:64] FLAG: --system-cgroups="" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653686 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653692 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653695 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653697 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653704 2577 flags.go:64] FLAG: --tls-min-version="" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653706 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653709 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653712 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 07:57:52.661686 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653715 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653718 2577 flags.go:64] FLAG: --v="2" Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653721 2577 flags.go:64] FLAG: --version="false" Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653725 2577 flags.go:64] FLAG: --vmodule="" Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653729 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.653733 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653870 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653874 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653878 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653881 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653884 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653887 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653889 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653893 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653896 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653899 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653901 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653905 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653909 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653912 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653915 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 07:57:52.662316 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653918 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653921 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653924 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653943 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653946 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653949 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653951 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653954 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653957 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653960 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653962 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653965 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653968 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653970 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653973 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653975 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653979 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653982 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653985 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653987 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 07:57:52.662830 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653990 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653992 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653995 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.653998 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654000 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654003 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654005 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654008 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654010 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654013 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654016 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654019 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654022 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654024 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654027 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654029 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654032 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654035 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654037 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654040 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 07:57:52.663416 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654043 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654045 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654047 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654050 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654052 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654055 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654057 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654060 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654064 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654066 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654069 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654071 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654074 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654077 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654080 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654083 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654085 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654090 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654093 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 07:57:52.663900 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654096 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654100 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654102 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654105 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654108 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654110 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654113 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654116 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654119 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654121 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654124 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654126 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654129 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654131 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654134 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654138 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654141 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654145 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654147 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 07:57:52.664376 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654150 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654153 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654157 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654160 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654163 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.654166 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.654174 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.660615 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.660630 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.660649 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.660658 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660717 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660723 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660726 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660729 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 07:57:52.664843 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660732 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660735 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660739 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660742 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660745 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660748 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660750 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660753 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660756 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660760 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660764 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660766 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660769 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660772 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660775 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660778 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660781 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660784 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660786 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660789 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 07:57:52.665236 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660792 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660795 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660798 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660800 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660803 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660806 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660808 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660811 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660814 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660817 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660820 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660822 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660825 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660828 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660830 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660833 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660835 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660838 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660841 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660843 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 07:57:52.665722 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660846 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660848 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660851 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660853 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660856 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660859 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660862 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660864 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660867 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660870 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660872 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660875 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660877 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660880 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660883 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660885 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660888 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660891 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660896 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 07:57:52.666254 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660899 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660902 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660905 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660909 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660912 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660915 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660918 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660920 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660923 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660938 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660941 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660944 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660946 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660949 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660951 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660954 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660957 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660960 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660962 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660965 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 07:57:52.666767 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660968 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660970 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660973 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660975 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660978 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660980 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660983 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660986 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660988 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660991 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660994 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.660998 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661001 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661004 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661007 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 07:57:52.667268 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661010 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.661016 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661130 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661134 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661137 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661140 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661144 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661146 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661149 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661152 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661155 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661158 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661161 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661163 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661166 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 07:57:52.667653 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661169 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661172 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661175 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661177 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661180 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661182 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661184 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661187 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661189 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661192 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661195 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661198 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661200 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661203 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661205 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661208 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661211 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661214 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661216 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 07:57:52.668151 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661219 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661222 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661227 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661230 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661232 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661235 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661237 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661240 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661242 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661245 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661247 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661250 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661252 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661255 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661257 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661261 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661265 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661268 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661270 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 07:57:52.668603 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661273 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661276 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661278 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661281 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661283 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661286 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661289 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661292 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661294 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661297 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661300 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661302 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661305 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661324 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661328 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661331 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661334 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661337 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661340 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661343 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 07:57:52.669084 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661345 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661348 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661351 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661353 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661356 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661358 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661361 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661364 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661366 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661369 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661372 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661374 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661377 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661380 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661382 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661385 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661388 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661392 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661395 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661398 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 07:57:52.669564 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661401 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 07:57:52.670100 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661404 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 07:57:52.670100 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661406 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 07:57:52.670100 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661409 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 07:57:52.670100 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661411 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 07:57:52.670100 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661414 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 07:57:52.670100 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661417 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 07:57:52.670100 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:52.661420 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 07:57:52.670100 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.661424 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 07:57:52.670100 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.661533 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 07:57:52.670100 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.666011 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 07:57:52.670100 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.667345 2577 server.go:1019] "Starting client certificate rotation" Jun 09 07:57:52.670100 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.667445 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 07:57:52.670100 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.667480 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 07:57:52.670435 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.670048 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 07:57:52.671586 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.671551 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 07:57:52.679400 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.679379 2577 log.go:25] "Validated CRI v1 runtime API" Jun 09 07:57:52.681675 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.681653 2577 log.go:25] "Validated CRI v1 image API" Jun 09 07:57:52.683470 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.683445 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 07:57:52.686255 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.686232 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ad6149ea-5373-44ca-a8cd-e69a3438b6aa:/dev/nvme0n1p4 af2c9b02-5350-4d89-af65-cdf883f5c39d:/dev/nvme0n1p3] Jun 09 07:57:52.686347 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.686252 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 07:57:52.691487 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.691365 2577 manager.go:216] Machine: {Timestamp:2026-06-09 07:57:52.690857234 +0000 UTC m=+0.360703239 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098529 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec222402d3b85c717e31342a5743c99d SystemUUID:ec222402-d3b8-5c71-7e31-342a5743c99d BootID:2c7e7ed4-e192-451a-ba51-cbb6ce3f044e Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a1:c4:62:8c:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a1:c4:62:8c:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:a8:4d:5a:f7:8e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 07:57:52.691487 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.691471 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 07:57:52.691654 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.691631 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 07:57:52.695048 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.695012 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 07:57:52.695225 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.695050 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-124.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 07:57:52.695807 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.695795 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 07:57:52.695868 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.695813 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 07:57:52.695868 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.695829 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 07:57:52.695868 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.695851 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 07:57:52.696596 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.696584 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 07:57:52.697577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.697560 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 07:57:52.699111 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.699097 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 09 07:57:52.699245 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.699235 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 07:57:52.699310 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.699272 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 09 07:57:52.699310 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.699286 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 07:57:52.699401 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.699317 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 07:57:52.699401 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.699332 2577 kubelet.go:398] "Adding apiserver pod source" Jun 09 07:57:52.699401 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.699375 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 07:57:52.699798 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.699743 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 07:57:52.699798 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.699765 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 07:57:52.702296 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.702282 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 07:57:52.703586 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.703572 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 07:57:52.703626 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.703603 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 07:57:52.704667 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.704656 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 07:57:52.704713 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.704672 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 07:57:52.704713 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.704679 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 07:57:52.704713 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.704684 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 07:57:52.704713 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.704693 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 07:57:52.704713 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.704699 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 07:57:52.704713 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.704707 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 07:57:52.704713 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.704712 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 07:57:52.704885 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.704719 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 07:57:52.704885 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.704724 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 07:57:52.704885 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.704733 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 07:57:52.704885 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.704739 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 07:57:52.705559 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.705547 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 07:57:52.705591 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.705562 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 07:57:52.709124 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.709109 2577 server.go:1268] "Started kubelet" Jun 09 07:57:52.709434 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.709381 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 07:57:52.709609 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.709583 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 07:57:52.710272 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.709731 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 07:57:52.710272 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.709800 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 07:57:52.710272 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.709802 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-124.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 07:57:52.710272 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.710046 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 07:57:52.710591 ip-10-0-139-124 systemd[1]: Started Kubernetes Kubelet. Jun 09 07:57:52.712044 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.711663 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 09 07:57:52.712422 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.712294 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 07:57:52.715908 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.715889 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 07:57:52.718134 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.718120 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 07:57:52.718134 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.718130 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 07:57:52.718261 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.718188 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jun 09 07:57:52.718815 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.717457 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-124.ec2.internal.18b75aac10ae8ddb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-124.ec2.internal,UID:ip-10-0-139-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-124.ec2.internal,},FirstTimestamp:2026-06-09 07:57:52.709070299 +0000 UTC m=+0.378916309,LastTimestamp:2026-06-09 07:57:52.709070299 +0000 UTC m=+0.378916309,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-124.ec2.internal,}" Jun 09 07:57:52.719004 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.718854 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 07:57:52.719004 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.718905 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 07:57:52.719004 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.718918 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 07:57:52.719156 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.719028 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 09 07:57:52.719156 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.719037 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 09 07:57:52.721117 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.720760 2577 factory.go:153] Registering CRI-O factory Jun 09 07:57:52.721117 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.721012 2577 factory.go:223] Registration of the crio container factory successfully Jun 09 07:57:52.721117 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.721094 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 07:57:52.721117 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.721104 2577 factory.go:55] Registering systemd factory Jun 09 07:57:52.721117 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.721111 2577 factory.go:223] Registration of the systemd container factory successfully Jun 09 07:57:52.721362 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.721144 2577 factory.go:103] Registering Raw factory Jun 09 07:57:52.721362 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.721166 2577 manager.go:1196] Started watching for new ooms in manager Jun 09 07:57:52.721519 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.721504 2577 manager.go:349] Starting recovery of all containers Jun 09 07:57:52.729972 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.729943 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 07:57:52.729972 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.729922 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 07:57:52.732492 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.732477 2577 manager.go:354] Recovery completed Jun 09 07:57:52.736623 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.736611 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 07:57:52.739097 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.739079 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientMemory" Jun 09 07:57:52.739171 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.739114 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 07:57:52.739171 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.739128 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientPID" Jun 09 07:57:52.739737 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.739723 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 07:57:52.739737 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.739736 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 07:57:52.739844 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.739737 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 07:57:52.739844 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.739801 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 09 07:57:52.740412 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.740396 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientMemory" Jun 09 07:57:52.740493 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.740426 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 07:57:52.740493 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.740440 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientPID" Jun 09 07:57:52.740875 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.740864 2577 policy_none.go:49] "None policy: Start" Jun 09 07:57:52.740946 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.740879 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 07:57:52.740946 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.740892 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 07:57:52.741736 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.741725 2577 policy_none.go:47] "Start" Jun 09 07:57:52.746649 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.746631 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7f9rs" Jun 09 07:57:52.747954 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.747864 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-124.ec2.internal.18b75aac1278b7c8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-124.ec2.internal,UID:ip-10-0-139-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-124.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-124.ec2.internal,},FirstTimestamp:2026-06-09 07:57:52.73909652 +0000 UTC m=+0.408942531,LastTimestamp:2026-06-09 07:57:52.73909652 +0000 UTC m=+0.408942531,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-124.ec2.internal,}" Jun 09 07:57:52.750602 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.750544 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-124.ec2.internal.18b75aac12791702 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-124.ec2.internal,UID:ip-10-0-139-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-124.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-124.ec2.internal,},FirstTimestamp:2026-06-09 07:57:52.739120898 +0000 UTC m=+0.408966907,LastTimestamp:2026-06-09 07:57:52.739120898 +0000 UTC m=+0.408966907,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-124.ec2.internal,}" Jun 09 07:57:52.754954 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.754919 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7f9rs" Jun 09 07:57:52.756583 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.756506 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-124.ec2.internal.18b75aac12794c15 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-124.ec2.internal,UID:ip-10-0-139-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-124.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-124.ec2.internal,},FirstTimestamp:2026-06-09 07:57:52.739134485 +0000 UTC m=+0.408980491,LastTimestamp:2026-06-09 07:57:52.739134485 +0000 UTC m=+0.408980491,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-124.ec2.internal,}" Jun 09 07:57:52.782526 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.782508 2577 manager.go:337] "Starting Device Plugin manager" Jun 09 07:57:52.782672 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.782543 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 07:57:52.782672 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.782553 2577 server.go:87] "Starting device plugin registration server" Jun 09 07:57:52.782761 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.782693 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 07:57:52.782853 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.782836 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 07:57:52.782942 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.782855 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 07:57:52.783096 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.783071 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 07:57:52.783189 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.783151 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 07:57:52.783189 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.783160 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 07:57:52.783770 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.783749 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 07:57:52.783874 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.783803 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-124.ec2.internal\" not found" Jun 09 07:57:52.784203 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.784187 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 07:57:52.784261 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.784222 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 07:57:52.784261 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.784241 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 07:57:52.784360 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.784269 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 07:57:52.786146 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.786127 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 07:57:52.883332 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.883302 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 07:57:52.884339 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.884307 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal"] Jun 09 07:57:52.884339 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.884336 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientMemory" Jun 09 07:57:52.884488 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.884367 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 07:57:52.884488 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.884378 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientPID" Jun 09 07:57:52.884488 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.884381 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 07:57:52.884488 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.884400 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-124.ec2.internal" Jun 09 07:57:52.885121 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.885105 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientMemory" Jun 09 07:57:52.885199 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.885134 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 07:57:52.885199 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.885149 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientPID" Jun 09 07:57:52.886243 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.886231 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 07:57:52.886394 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.886377 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jun 09 07:57:52.886467 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.886423 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 07:57:52.886885 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.886868 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientMemory" Jun 09 07:57:52.886985 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.886895 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 07:57:52.886985 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.886905 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientMemory" Jun 09 07:57:52.886985 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.886909 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientPID" Jun 09 07:57:52.886985 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.886924 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 07:57:52.886985 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.886954 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientPID" Jun 09 07:57:52.887975 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.887961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" Jun 09 07:57:52.888029 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.887986 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 07:57:52.888588 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.888573 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientMemory" Jun 09 07:57:52.888678 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.888601 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 07:57:52.888678 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.888645 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeHasSufficientPID" Jun 09 07:57:52.893249 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.893229 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-124.ec2.internal" Jun 09 07:57:52.893359 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.893257 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-124.ec2.internal\": node \"ip-10-0-139-124.ec2.internal\" not found" Jun 09 07:57:52.912710 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.912648 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-124.ec2.internal\" not found" node="ip-10-0-139-124.ec2.internal" Jun 09 07:57:52.916001 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.915985 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-124.ec2.internal\" not found" node="ip-10-0-139-124.ec2.internal" Jun 09 07:57:52.921173 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.921155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/458c15fea976bb530ec709b458d3c76a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal\" (UID: \"458c15fea976bb530ec709b458d3c76a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jun 09 07:57:52.921251 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.921180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be5b5bfec53750cccc5fe667c2f32c1d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-124.ec2.internal\" (UID: \"be5b5bfec53750cccc5fe667c2f32c1d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" Jun 09 07:57:52.921251 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:52.921199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/458c15fea976bb530ec709b458d3c76a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal\" (UID: \"458c15fea976bb530ec709b458d3c76a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jun 09 07:57:52.932210 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:52.932192 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jun 09 07:57:53.021593 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.021562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/458c15fea976bb530ec709b458d3c76a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal\" (UID: \"458c15fea976bb530ec709b458d3c76a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jun 09 07:57:53.021761 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.021601 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/458c15fea976bb530ec709b458d3c76a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal\" (UID: \"458c15fea976bb530ec709b458d3c76a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jun 09 07:57:53.021761 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.021621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be5b5bfec53750cccc5fe667c2f32c1d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-124.ec2.internal\" (UID: \"be5b5bfec53750cccc5fe667c2f32c1d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" Jun 09 07:57:53.021761 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.021666 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/458c15fea976bb530ec709b458d3c76a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal\" (UID: \"458c15fea976bb530ec709b458d3c76a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jun 09 07:57:53.021761 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.021668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/458c15fea976bb530ec709b458d3c76a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal\" (UID: \"458c15fea976bb530ec709b458d3c76a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jun 09 07:57:53.021761 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.021733 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be5b5bfec53750cccc5fe667c2f32c1d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-124.ec2.internal\" (UID: \"be5b5bfec53750cccc5fe667c2f32c1d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" Jun 09 07:57:53.032648 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.032628 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jun 09 07:57:53.133250 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.133204 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jun 09 07:57:53.216733 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.216652 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jun 09 07:57:53.220290 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.220039 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" Jun 09 07:57:53.233307 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.233280 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jun 09 07:57:53.333902 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.333863 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jun 09 07:57:53.434369 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.434332 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jun 09 07:57:53.534983 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.534912 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-124.ec2.internal\" not found" Jun 09 07:57:53.579943 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.579898 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 07:57:53.619316 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.619288 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" Jun 09 07:57:53.632211 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.632193 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 07:57:53.634513 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.634492 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" Jun 09 07:57:53.643714 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.643690 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 07:57:53.650078 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:53.650043 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe5b5bfec53750cccc5fe667c2f32c1d.slice/crio-6b9e78f97a618456b3b0d3b24b9095b46ae90a6df7ce288ddab314a1f457553a WatchSource:0}: Error finding container 6b9e78f97a618456b3b0d3b24b9095b46ae90a6df7ce288ddab314a1f457553a: Status 404 returned error can't find the container with id 6b9e78f97a618456b3b0d3b24b9095b46ae90a6df7ce288ddab314a1f457553a Jun 09 07:57:53.654599 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.654586 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 07:57:53.666506 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.666489 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 07:57:53.666611 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.666591 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 07:57:53.666666 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.666594 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 07:57:53.691480 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:53.691461 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458c15fea976bb530ec709b458d3c76a.slice/crio-20f11a8aa69a79df6496f98ce5a18495965225f1c528008a82e6299a856db486 WatchSource:0}: Error finding container 20f11a8aa69a79df6496f98ce5a18495965225f1c528008a82e6299a856db486: Status 404 returned error can't find the container with id 20f11a8aa69a79df6496f98ce5a18495965225f1c528008a82e6299a856db486 Jun 09 07:57:53.700458 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.700284 2577 apiserver.go:52] "Watching apiserver" Jun 09 07:57:53.708109 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.708087 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 07:57:53.709257 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.709237 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-ptm8p","openshift-multus/multus-hhcmt","openshift-network-operator/iptables-alerter-hd2t4","openshift-ovn-kubernetes/ovnkube-node-z7cxx","kube-system/global-pull-secret-syncer-5smvf","kube-system/konnectivity-agent-ks6l6","kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal","openshift-dns/node-resolver-psxf9","openshift-image-registry/node-ca-w5gcm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal","openshift-multus/network-metrics-daemon-fpbq7","openshift-network-diagnostics/network-check-target-dvrfx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb","openshift-cluster-node-tuning-operator/tuned-qbj6k"] Jun 09 07:57:53.710535 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.710520 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ks6l6" Jun 09 07:57:53.711574 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.711551 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.712516 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.712499 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.713105 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.713088 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zd427\"" Jun 09 07:57:53.713200 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.713094 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 07:57:53.713426 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.713408 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 07:57:53.713537 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.713519 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:53.713621 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.713598 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:57:53.713665 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.713649 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 07:57:53.713985 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.713970 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-clhnt\"" Jun 09 07:57:53.714067 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.714048 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 07:57:53.714541 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.714521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hd2t4" Jun 09 07:57:53.715227 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.715072 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 07:57:53.715227 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.715088 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 07:57:53.715227 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.715111 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-84pnx\"" Jun 09 07:57:53.715227 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.715150 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 07:57:53.715227 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.715176 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 07:57:53.715508 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.715459 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 07:57:53.715688 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.715666 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 07:57:53.715766 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.715745 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.716852 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.716833 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-psxf9" Jun 09 07:57:53.717308 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.717291 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 07:57:53.717357 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.717312 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 07:57:53.717415 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.717300 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 07:57:53.718159 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.718058 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b4756\"" Jun 09 07:57:53.718282 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.718191 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 07:57:53.718282 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.718258 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w5gcm" Jun 09 07:57:53.719349 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.719106 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 07:57:53.719465 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.719383 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 07:57:53.719465 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.719433 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 07:57:53.720527 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.720503 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 07:57:53.721085 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.721065 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 07:57:53.721309 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.721290 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 07:57:53.721388 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.721319 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 07:57:53.721827 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.721592 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 07:57:53.721827 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.721599 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 07:57:53.721827 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.721644 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jvcf2\"" Jun 09 07:57:53.721827 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.721680 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xtmf5\"" Jun 09 07:57:53.722134 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.722058 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:57:53.722134 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.722064 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tzhl9\"" Jun 09 07:57:53.722224 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.722180 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 07:57:53.722275 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.722242 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:57:53.722788 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.722766 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:57:53.722888 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.722864 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:57:53.724215 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.724200 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.724828 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.724806 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-run-netns\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.724897 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.724843 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-cni-bin\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.724955 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.724904 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ad0b6d9-c782-474b-a61f-d5b525e99aae-cnibin\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.724955 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.724944 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4z6b\" (UniqueName: \"kubernetes.io/projected/0ad0b6d9-c782-474b-a61f-d5b525e99aae-kube-api-access-z4z6b\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.725034 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.724971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:57:53.725034 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.724995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-sys\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.725034 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-systemd-units\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.725146 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ce57525-7be1-4244-9584-1b2e5bb5d1a1-agent-certs\") pod \"konnectivity-agent-ks6l6\" (UID: \"7ce57525-7be1-4244-9584-1b2e5bb5d1a1\") " pod="kube-system/konnectivity-agent-ks6l6" Jun 09 07:57:53.725146 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-run-ovn\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.725146 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725084 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-var-lib-openvswitch\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.725146 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0b6d9-c782-474b-a61f-d5b525e99aae-system-cni-dir\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.725146 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hsft\" (UniqueName: \"kubernetes.io/projected/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-kube-api-access-2hsft\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:57:53.725341 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725150 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-var-lib-kubelet\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.725341 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7195ac3-0b33-4ddc-aa73-25d213a05382-ovnkube-script-lib\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.725341 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-sysctl-conf\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.725341 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725263 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7195ac3-0b33-4ddc-aa73-25d213a05382-env-overrides\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.725341 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-modprobe-d\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.725341 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-sysconfig\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.725706 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-kubelet\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.725706 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725372 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.725706 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-log-socket\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.725706 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0ad0b6d9-c782-474b-a61f-d5b525e99aae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.725706 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:53.725706 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5259c534-0a4b-4145-a3c9-18db9b83a062-serviceca\") pod \"node-ca-w5gcm\" (UID: \"5259c534-0a4b-4145-a3c9-18db9b83a062\") " pod="openshift-image-registry/node-ca-w5gcm" Jun 09 07:57:53.725706 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725521 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-lib-modules\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.725706 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725542 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-host\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.725706 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725567 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vkl5\" (UniqueName: \"kubernetes.io/projected/65978fae-2585-4840-8ef5-eb1b586cd52e-kube-api-access-5vkl5\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.725706 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.725706 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725623 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-cni-netd\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.725706 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725644 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ad0b6d9-c782-474b-a61f-d5b525e99aae-os-release\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.725706 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0ad0b6d9-c782-474b-a61f-d5b525e99aae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-systemd\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725729 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-run-systemd\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7195ac3-0b33-4ddc-aa73-25d213a05382-ovn-node-metrics-cert\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725758 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9674b1fa-6e16-4821-b450-05f74c391b47-dbus\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abf2bb36-50c5-4404-92d4-e66b7b526c44-iptables-alerter-script\") pod \"iptables-alerter-hd2t4\" (UID: \"abf2bb36-50c5-4404-92d4-e66b7b526c44\") " pod="openshift-network-operator/iptables-alerter-hd2t4" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-tuned\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725843 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5259c534-0a4b-4145-a3c9-18db9b83a062-host\") pod \"node-ca-w5gcm\" (UID: \"5259c534-0a4b-4145-a3c9-18db9b83a062\") " pod="openshift-image-registry/node-ca-w5gcm" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ce57525-7be1-4244-9584-1b2e5bb5d1a1-konnectivity-ca\") pod \"konnectivity-agent-ks6l6\" (UID: \"7ce57525-7be1-4244-9584-1b2e5bb5d1a1\") " pod="kube-system/konnectivity-agent-ks6l6" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-sysctl-d\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65978fae-2585-4840-8ef5-eb1b586cd52e-tmp\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725964 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.725986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-kubernetes\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726001 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-run\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-etc-openvswitch\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-node-log\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.726267 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0b6d9-c782-474b-a61f-d5b525e99aae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.726708 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fee7c818-f667-4a20-8e2d-8d42ca5fa868-hosts-file\") pod \"node-resolver-psxf9\" (UID: \"fee7c818-f667-4a20-8e2d-8d42ca5fa868\") " pod="openshift-dns/node-resolver-psxf9" Jun 09 07:57:53.726708 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-slash\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.726708 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726108 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-run-openvswitch\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.726708 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726127 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7195ac3-0b33-4ddc-aa73-25d213a05382-ovnkube-config\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.726708 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbqbf\" (UniqueName: \"kubernetes.io/projected/c7195ac3-0b33-4ddc-aa73-25d213a05382-kube-api-access-jbqbf\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.726708 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwzq5\" (UniqueName: \"kubernetes.io/projected/abf2bb36-50c5-4404-92d4-e66b7b526c44-kube-api-access-fwzq5\") pod \"iptables-alerter-hd2t4\" (UID: \"abf2bb36-50c5-4404-92d4-e66b7b526c44\") " pod="openshift-network-operator/iptables-alerter-hd2t4" Jun 09 07:57:53.726708 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726186 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9674b1fa-6e16-4821-b450-05f74c391b47-kubelet-config\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:53.726708 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv525\" (UniqueName: \"kubernetes.io/projected/fee7c818-f667-4a20-8e2d-8d42ca5fa868-kube-api-access-wv525\") pod \"node-resolver-psxf9\" (UID: \"fee7c818-f667-4a20-8e2d-8d42ca5fa868\") " pod="openshift-dns/node-resolver-psxf9" Jun 09 07:57:53.726708 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726213 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlh9n\" (UniqueName: \"kubernetes.io/projected/5259c534-0a4b-4145-a3c9-18db9b83a062-kube-api-access-xlh9n\") pod \"node-ca-w5gcm\" (UID: \"5259c534-0a4b-4145-a3c9-18db9b83a062\") " pod="openshift-image-registry/node-ca-w5gcm" Jun 09 07:57:53.726708 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726231 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abf2bb36-50c5-4404-92d4-e66b7b526c44-host-slash\") pod \"iptables-alerter-hd2t4\" (UID: \"abf2bb36-50c5-4404-92d4-e66b7b526c44\") " pod="openshift-network-operator/iptables-alerter-hd2t4" Jun 09 07:57:53.726708 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ad0b6d9-c782-474b-a61f-d5b525e99aae-cni-binary-copy\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.726708 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.726314 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fee7c818-f667-4a20-8e2d-8d42ca5fa868-tmp-dir\") pod \"node-resolver-psxf9\" (UID: \"fee7c818-f667-4a20-8e2d-8d42ca5fa868\") " pod="openshift-dns/node-resolver-psxf9" Jun 09 07:57:53.727397 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.727374 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 07:57:53.727502 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.727474 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 07:57:53.727591 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.727574 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mst5r\"" Jun 09 07:57:53.727651 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.727601 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 07:57:53.727651 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.727644 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h6xx9\"" Jun 09 07:57:53.727758 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.727664 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 07:57:53.733790 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.733774 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 07:57:53.757511 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.757455 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 07:52:52 +0000 UTC" deadline="2028-01-24 22:16:08.505964039 +0000 UTC" Jun 09 07:57:53.757584 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.757512 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14270h18m14.748455716s" Jun 09 07:57:53.767451 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.767432 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zjqv2" Jun 09 07:57:53.779074 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.779055 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zjqv2" Jun 09 07:57:53.787557 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.787500 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" event={"ID":"458c15fea976bb530ec709b458d3c76a","Type":"ContainerStarted","Data":"20f11a8aa69a79df6496f98ce5a18495965225f1c528008a82e6299a856db486"} Jun 09 07:57:53.788404 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.788387 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" event={"ID":"be5b5bfec53750cccc5fe667c2f32c1d","Type":"ContainerStarted","Data":"6b9e78f97a618456b3b0d3b24b9095b46ae90a6df7ce288ddab314a1f457553a"} Jun 09 07:57:53.819630 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.819613 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 07:57:53.826599 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826578 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7315667c-1546-4683-9858-e6c94fd8ca5d-cni-binary-copy\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.826690 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abf2bb36-50c5-4404-92d4-e66b7b526c44-iptables-alerter-script\") pod \"iptables-alerter-hd2t4\" (UID: \"abf2bb36-50c5-4404-92d4-e66b7b526c44\") " pod="openshift-network-operator/iptables-alerter-hd2t4" Jun 09 07:57:53.826690 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-run-netns\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.826690 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-tuned\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.826690 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5259c534-0a4b-4145-a3c9-18db9b83a062-host\") pod \"node-ca-w5gcm\" (UID: \"5259c534-0a4b-4145-a3c9-18db9b83a062\") " pod="openshift-image-registry/node-ca-w5gcm" Jun 09 07:57:53.827003 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-registration-dir\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.827003 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ce57525-7be1-4244-9584-1b2e5bb5d1a1-konnectivity-ca\") pod \"konnectivity-agent-ks6l6\" (UID: \"7ce57525-7be1-4244-9584-1b2e5bb5d1a1\") " pod="kube-system/konnectivity-agent-ks6l6" Jun 09 07:57:53.827003 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826730 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5259c534-0a4b-4145-a3c9-18db9b83a062-host\") pod \"node-ca-w5gcm\" (UID: \"5259c534-0a4b-4145-a3c9-18db9b83a062\") " pod="openshift-image-registry/node-ca-w5gcm" Jun 09 07:57:53.827003 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-sysctl-d\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.827003 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65978fae-2585-4840-8ef5-eb1b586cd52e-tmp\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.827003 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826881 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-sysctl-d\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.827003 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.827003 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-sys-fs\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.827003 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826996 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.826976 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-run-multus-certs\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td7sc\" (UniqueName: \"kubernetes.io/projected/7315667c-1546-4683-9858-e6c94fd8ca5d-kube-api-access-td7sc\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-kubernetes\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-run\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-etc-openvswitch\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-node-log\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827221 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abf2bb36-50c5-4404-92d4-e66b7b526c44-iptables-alerter-script\") pod \"iptables-alerter-hd2t4\" (UID: \"abf2bb36-50c5-4404-92d4-e66b7b526c44\") " pod="openshift-network-operator/iptables-alerter-hd2t4" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0b6d9-c782-474b-a61f-d5b525e99aae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827281 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fee7c818-f667-4a20-8e2d-8d42ca5fa868-hosts-file\") pod \"node-resolver-psxf9\" (UID: \"fee7c818-f667-4a20-8e2d-8d42ca5fa868\") " pod="openshift-dns/node-resolver-psxf9" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827300 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-kubernetes\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827300 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-etc-openvswitch\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-device-dir\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827342 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ce57525-7be1-4244-9584-1b2e5bb5d1a1-konnectivity-ca\") pod \"konnectivity-agent-ks6l6\" (UID: \"7ce57525-7be1-4244-9584-1b2e5bb5d1a1\") " pod="kube-system/konnectivity-agent-ks6l6" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827359 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-run\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-system-cni-dir\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.827427 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-slash\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-run-openvswitch\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-node-log\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827498 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7195ac3-0b33-4ddc-aa73-25d213a05382-ovnkube-config\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827523 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbqbf\" (UniqueName: \"kubernetes.io/projected/c7195ac3-0b33-4ddc-aa73-25d213a05382-kube-api-access-jbqbf\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827573 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0b6d9-c782-474b-a61f-d5b525e99aae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827584 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-run-openvswitch\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827616 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-slash\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwzq5\" (UniqueName: \"kubernetes.io/projected/abf2bb36-50c5-4404-92d4-e66b7b526c44-kube-api-access-fwzq5\") pod \"iptables-alerter-hd2t4\" (UID: \"abf2bb36-50c5-4404-92d4-e66b7b526c44\") " pod="openshift-network-operator/iptables-alerter-hd2t4" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9674b1fa-6e16-4821-b450-05f74c391b47-kubelet-config\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827778 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9674b1fa-6e16-4821-b450-05f74c391b47-kubelet-config\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv525\" (UniqueName: \"kubernetes.io/projected/fee7c818-f667-4a20-8e2d-8d42ca5fa868-kube-api-access-wv525\") pod \"node-resolver-psxf9\" (UID: \"fee7c818-f667-4a20-8e2d-8d42ca5fa868\") " pod="openshift-dns/node-resolver-psxf9" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827905 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fee7c818-f667-4a20-8e2d-8d42ca5fa868-hosts-file\") pod \"node-resolver-psxf9\" (UID: \"fee7c818-f667-4a20-8e2d-8d42ca5fa868\") " pod="openshift-dns/node-resolver-psxf9" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827955 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlh9n\" (UniqueName: \"kubernetes.io/projected/5259c534-0a4b-4145-a3c9-18db9b83a062-kube-api-access-xlh9n\") pod \"node-ca-w5gcm\" (UID: \"5259c534-0a4b-4145-a3c9-18db9b83a062\") " pod="openshift-image-registry/node-ca-w5gcm" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.827997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abf2bb36-50c5-4404-92d4-e66b7b526c44-host-slash\") pod \"iptables-alerter-hd2t4\" (UID: \"abf2bb36-50c5-4404-92d4-e66b7b526c44\") " pod="openshift-network-operator/iptables-alerter-hd2t4" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ad0b6d9-c782-474b-a61f-d5b525e99aae-cni-binary-copy\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fee7c818-f667-4a20-8e2d-8d42ca5fa868-tmp-dir\") pod \"node-resolver-psxf9\" (UID: \"fee7c818-f667-4a20-8e2d-8d42ca5fa868\") " pod="openshift-dns/node-resolver-psxf9" Jun 09 07:57:53.828253 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828146 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7195ac3-0b33-4ddc-aa73-25d213a05382-ovnkube-config\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-etc-selinux\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-run-netns\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-cni-bin\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ad0b6d9-c782-474b-a61f-d5b525e99aae-cnibin\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828300 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abf2bb36-50c5-4404-92d4-e66b7b526c44-host-slash\") pod \"iptables-alerter-hd2t4\" (UID: \"abf2bb36-50c5-4404-92d4-e66b7b526c44\") " pod="openshift-network-operator/iptables-alerter-hd2t4" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4z6b\" (UniqueName: \"kubernetes.io/projected/0ad0b6d9-c782-474b-a61f-d5b525e99aae-kube-api-access-z4z6b\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828375 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-run-netns\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828377 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-os-release\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-multus-socket-dir-parent\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-sys\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828484 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fee7c818-f667-4a20-8e2d-8d42ca5fa868-tmp-dir\") pod \"node-resolver-psxf9\" (UID: \"fee7c818-f667-4a20-8e2d-8d42ca5fa868\") " pod="openshift-dns/node-resolver-psxf9" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-systemd-units\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828525 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-var-lib-cni-bin\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-multus-conf-dir\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.829106 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7315667c-1546-4683-9858-e6c94fd8ca5d-multus-daemon-config\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828620 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmpq5\" (UniqueName: \"kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5\") pod \"network-check-target-dvrfx\" (UID: \"1133942a-7dac-4e81-a19d-9428ae64bd36\") " pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828628 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ad0b6d9-c782-474b-a61f-d5b525e99aae-cnibin\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828647 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ce57525-7be1-4244-9584-1b2e5bb5d1a1-agent-certs\") pod \"konnectivity-agent-ks6l6\" (UID: \"7ce57525-7be1-4244-9584-1b2e5bb5d1a1\") " pod="kube-system/konnectivity-agent-ks6l6" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.828657 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-run-ovn\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828681 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-cni-bin\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828686 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ad0b6d9-c782-474b-a61f-d5b525e99aae-cni-binary-copy\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-cnibin\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-var-lib-openvswitch\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828765 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-sys\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.828766 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs podName:2cc82d46-ff16-4d56-a54a-4d8283ab6d5a nodeName:}" failed. No retries permitted until 2026-06-09 07:57:54.328746267 +0000 UTC m=+1.998592274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs") pod "network-metrics-daemon-fpbq7" (UID: "2cc82d46-ff16-4d56-a54a-4d8283ab6d5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828779 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-systemd-units\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828783 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-var-lib-openvswitch\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0b6d9-c782-474b-a61f-d5b525e99aae-system-cni-dir\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-multus-cni-dir\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-var-lib-cni-multus\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.829948 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828867 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-run-ovn\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828903 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ad0b6d9-c782-474b-a61f-d5b525e99aae-system-cni-dir\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.828947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-etc-kubernetes\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.829001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hsft\" (UniqueName: \"kubernetes.io/projected/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-kube-api-access-2hsft\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.829028 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-var-lib-kubelet\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.829109 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-var-lib-kubelet\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830383 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7195ac3-0b33-4ddc-aa73-25d213a05382-ovnkube-script-lib\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830441 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-run-k8s-cni-cncf-io\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830486 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-var-lib-kubelet\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830522 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-hostroot\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830559 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-sysctl-conf\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7195ac3-0b33-4ddc-aa73-25d213a05382-env-overrides\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-modprobe-d\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830620 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7195ac3-0b33-4ddc-aa73-25d213a05382-ovnkube-script-lib\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-sysconfig\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830753 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-sysconfig\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-kubelet\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.830842 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-log-socket\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830842 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-tuned\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830861 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0ad0b6d9-c782-474b-a61f-d5b525e99aae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830965 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-log-socket\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.830982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5259c534-0a4b-4145-a3c9-18db9b83a062-serviceca\") pod \"node-ca-w5gcm\" (UID: \"5259c534-0a4b-4145-a3c9-18db9b83a062\") " pod="openshift-image-registry/node-ca-w5gcm" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831057 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-sysctl-conf\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831067 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-lib-modules\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-host\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vkl5\" (UniqueName: \"kubernetes.io/projected/65978fae-2585-4840-8ef5-eb1b586cd52e-kube-api-access-5vkl5\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831185 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-cni-netd\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831217 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ad0b6d9-c782-474b-a61f-d5b525e99aae-os-release\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0ad0b6d9-c782-474b-a61f-d5b525e99aae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-socket-dir\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831310 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-systemd\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-run-systemd\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.831677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7195ac3-0b33-4ddc-aa73-25d213a05382-ovn-node-metrics-cert\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831408 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9674b1fa-6e16-4821-b450-05f74c391b47-dbus\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxc2j\" (UniqueName: \"kubernetes.io/projected/261632bb-40cc-4eb0-88b1-bfc631de4ad0-kube-api-access-zxc2j\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ce57525-7be1-4244-9584-1b2e5bb5d1a1-agent-certs\") pod \"konnectivity-agent-ks6l6\" (UID: \"7ce57525-7be1-4244-9584-1b2e5bb5d1a1\") " pod="kube-system/konnectivity-agent-ks6l6" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831469 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0ad0b6d9-c782-474b-a61f-d5b525e99aae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831579 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-run-ovn-kubernetes\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831646 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9674b1fa-6e16-4821-b450-05f74c391b47-dbus\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831097 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-kubelet\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831705 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-systemd\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831818 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-host\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831835 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7195ac3-0b33-4ddc-aa73-25d213a05382-env-overrides\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831893 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-run-systemd\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831942 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7195ac3-0b33-4ddc-aa73-25d213a05382-host-cni-netd\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.831924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-etc-modprobe-d\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.832035 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.832092 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret podName:9674b1fa-6e16-4821-b450-05f74c391b47 nodeName:}" failed. No retries permitted until 2026-06-09 07:57:54.332075479 +0000 UTC m=+2.001921477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret") pod "global-pull-secret-syncer-5smvf" (UID: "9674b1fa-6e16-4821-b450-05f74c391b47") : object "kube-system"/"original-pull-secret" not registered Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.832137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ad0b6d9-c782-474b-a61f-d5b525e99aae-os-release\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.832499 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.832150 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65978fae-2585-4840-8ef5-eb1b586cd52e-lib-modules\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.833365 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.832184 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65978fae-2585-4840-8ef5-eb1b586cd52e-tmp\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.833365 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.832352 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5259c534-0a4b-4145-a3c9-18db9b83a062-serviceca\") pod \"node-ca-w5gcm\" (UID: \"5259c534-0a4b-4145-a3c9-18db9b83a062\") " pod="openshift-image-registry/node-ca-w5gcm" Jun 09 07:57:53.833472 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.833357 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0ad0b6d9-c782-474b-a61f-d5b525e99aae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.835832 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.835806 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7195ac3-0b33-4ddc-aa73-25d213a05382-ovn-node-metrics-cert\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.841020 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.840894 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbqbf\" (UniqueName: \"kubernetes.io/projected/c7195ac3-0b33-4ddc-aa73-25d213a05382-kube-api-access-jbqbf\") pod \"ovnkube-node-z7cxx\" (UID: \"c7195ac3-0b33-4ddc-aa73-25d213a05382\") " pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:53.841157 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.841133 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlh9n\" (UniqueName: \"kubernetes.io/projected/5259c534-0a4b-4145-a3c9-18db9b83a062-kube-api-access-xlh9n\") pod \"node-ca-w5gcm\" (UID: \"5259c534-0a4b-4145-a3c9-18db9b83a062\") " pod="openshift-image-registry/node-ca-w5gcm" Jun 09 07:57:53.841482 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.841455 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv525\" (UniqueName: \"kubernetes.io/projected/fee7c818-f667-4a20-8e2d-8d42ca5fa868-kube-api-access-wv525\") pod \"node-resolver-psxf9\" (UID: \"fee7c818-f667-4a20-8e2d-8d42ca5fa868\") " pod="openshift-dns/node-resolver-psxf9" Jun 09 07:57:53.842033 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.842012 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hsft\" (UniqueName: \"kubernetes.io/projected/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-kube-api-access-2hsft\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:57:53.842657 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.842639 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwzq5\" (UniqueName: \"kubernetes.io/projected/abf2bb36-50c5-4404-92d4-e66b7b526c44-kube-api-access-fwzq5\") pod \"iptables-alerter-hd2t4\" (UID: \"abf2bb36-50c5-4404-92d4-e66b7b526c44\") " pod="openshift-network-operator/iptables-alerter-hd2t4" Jun 09 07:57:53.843422 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.843404 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vkl5\" (UniqueName: \"kubernetes.io/projected/65978fae-2585-4840-8ef5-eb1b586cd52e-kube-api-access-5vkl5\") pod \"tuned-qbj6k\" (UID: \"65978fae-2585-4840-8ef5-eb1b586cd52e\") " pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:53.843507 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.843407 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4z6b\" (UniqueName: \"kubernetes.io/projected/0ad0b6d9-c782-474b-a61f-d5b525e99aae-kube-api-access-z4z6b\") pod \"multus-additional-cni-plugins-ptm8p\" (UID: \"0ad0b6d9-c782-474b-a61f-d5b525e99aae\") " pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:53.932311 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932275 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-var-lib-cni-bin\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.932311 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932324 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-multus-conf-dir\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.932542 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932341 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7315667c-1546-4683-9858-e6c94fd8ca5d-multus-daemon-config\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.932542 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpq5\" (UniqueName: \"kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5\") pod \"network-check-target-dvrfx\" (UID: \"1133942a-7dac-4e81-a19d-9428ae64bd36\") " pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:57:53.932542 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932374 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-cnibin\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.932542 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932381 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-var-lib-cni-bin\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.932542 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932396 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-multus-conf-dir\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.932542 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932420 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-cnibin\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.932542 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-multus-cni-dir\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.932542 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-var-lib-cni-multus\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.932542 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-etc-kubernetes\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.932542 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932508 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-var-lib-cni-multus\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.932542 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-run-k8s-cni-cncf-io\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.932542 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932544 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-run-k8s-cni-cncf-io\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932546 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-var-lib-kubelet\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932554 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-multus-cni-dir\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932576 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-var-lib-kubelet\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-hostroot\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932591 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-etc-kubernetes\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932613 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-hostroot\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932624 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-socket-dir\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932656 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxc2j\" (UniqueName: \"kubernetes.io/projected/261632bb-40cc-4eb0-88b1-bfc631de4ad0-kube-api-access-zxc2j\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7315667c-1546-4683-9858-e6c94fd8ca5d-cni-binary-copy\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932732 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-socket-dir\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-run-netns\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932773 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-run-netns\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932779 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-registration-dir\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-sys-fs\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-run-multus-certs\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932875 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-registration-dir\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932884 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-sys-fs\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.933053 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td7sc\" (UniqueName: \"kubernetes.io/projected/7315667c-1546-4683-9858-e6c94fd8ca5d-kube-api-access-td7sc\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932876 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-host-run-multus-certs\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-device-dir\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932975 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-device-dir\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.932976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-system-cni-dir\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.933016 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.933031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-etc-selinux\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.933052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-os-release\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.933073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-multus-socket-dir-parent\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.933074 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.933102 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-system-cni-dir\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.933114 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/261632bb-40cc-4eb0-88b1-bfc631de4ad0-etc-selinux\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.933129 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-multus-socket-dir-parent\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.933165 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7315667c-1546-4683-9858-e6c94fd8ca5d-os-release\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.933216 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7315667c-1546-4683-9858-e6c94fd8ca5d-cni-binary-copy\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.933577 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.933320 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7315667c-1546-4683-9858-e6c94fd8ca5d-multus-daemon-config\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.940379 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.940359 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 07:57:53.940379 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.940382 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 07:57:53.940498 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.940393 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mmpq5 for pod openshift-network-diagnostics/network-check-target-dvrfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 07:57:53.940498 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:53.940452 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5 podName:1133942a-7dac-4e81-a19d-9428ae64bd36 nodeName:}" failed. No retries permitted until 2026-06-09 07:57:54.440437407 +0000 UTC m=+2.110283425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mmpq5" (UniqueName: "kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5") pod "network-check-target-dvrfx" (UID: "1133942a-7dac-4e81-a19d-9428ae64bd36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 07:57:53.941734 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.941700 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td7sc\" (UniqueName: \"kubernetes.io/projected/7315667c-1546-4683-9858-e6c94fd8ca5d-kube-api-access-td7sc\") pod \"multus-hhcmt\" (UID: \"7315667c-1546-4683-9858-e6c94fd8ca5d\") " pod="openshift-multus/multus-hhcmt" Jun 09 07:57:53.942405 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.942388 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxc2j\" (UniqueName: \"kubernetes.io/projected/261632bb-40cc-4eb0-88b1-bfc631de4ad0-kube-api-access-zxc2j\") pod \"aws-ebs-csi-driver-node-kr9jb\" (UID: \"261632bb-40cc-4eb0-88b1-bfc631de4ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:53.984721 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:53.984699 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 07:57:54.021856 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.021824 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ks6l6" Jun 09 07:57:54.028419 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.028397 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" Jun 09 07:57:54.030156 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:54.030109 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ce57525_7be1_4244_9584_1b2e5bb5d1a1.slice/crio-4d4079582035d07c1ee9a4f5ce7cf492f2da6d53b8e8aa7753a80a883531bb93 WatchSource:0}: Error finding container 4d4079582035d07c1ee9a4f5ce7cf492f2da6d53b8e8aa7753a80a883531bb93: Status 404 returned error can't find the container with id 4d4079582035d07c1ee9a4f5ce7cf492f2da6d53b8e8aa7753a80a883531bb93 Jun 09 07:57:54.034517 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.034491 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:57:54.037817 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:54.037751 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65978fae_2585_4840_8ef5_eb1b586cd52e.slice/crio-cd00a88c4fa039ef777cf98ff0529685926c77a390ec03307f427d0e8e4aa8c4 WatchSource:0}: Error finding container cd00a88c4fa039ef777cf98ff0529685926c77a390ec03307f427d0e8e4aa8c4: Status 404 returned error can't find the container with id cd00a88c4fa039ef777cf98ff0529685926c77a390ec03307f427d0e8e4aa8c4 Jun 09 07:57:54.039523 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.039501 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hd2t4" Jun 09 07:57:54.043154 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:54.043115 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7195ac3_0b33_4ddc_aa73_25d213a05382.slice/crio-e780f801baad45a717d8fecbe9642b1d4a438a5041502dbb41bf6dc2890eb335 WatchSource:0}: Error finding container e780f801baad45a717d8fecbe9642b1d4a438a5041502dbb41bf6dc2890eb335: Status 404 returned error can't find the container with id e780f801baad45a717d8fecbe9642b1d4a438a5041502dbb41bf6dc2890eb335 Jun 09 07:57:54.045034 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.045013 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ptm8p" Jun 09 07:57:54.047960 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:54.047741 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabf2bb36_50c5_4404_92d4_e66b7b526c44.slice/crio-a5b79aeb845b8c32388d182a841a744edcf88c3bf4d6b060ac3dbeccfb0004f0 WatchSource:0}: Error finding container a5b79aeb845b8c32388d182a841a744edcf88c3bf4d6b060ac3dbeccfb0004f0: Status 404 returned error can't find the container with id a5b79aeb845b8c32388d182a841a744edcf88c3bf4d6b060ac3dbeccfb0004f0 Jun 09 07:57:54.051210 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.051190 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-psxf9" Jun 09 07:57:54.053491 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:54.053465 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad0b6d9_c782_474b_a61f_d5b525e99aae.slice/crio-c7f8e9ce1729c2e6fe4f70b215f7ffda9cc7c6826edb6af004ca6debab4a3de9 WatchSource:0}: Error finding container c7f8e9ce1729c2e6fe4f70b215f7ffda9cc7c6826edb6af004ca6debab4a3de9: Status 404 returned error can't find the container with id c7f8e9ce1729c2e6fe4f70b215f7ffda9cc7c6826edb6af004ca6debab4a3de9 Jun 09 07:57:54.055778 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.055758 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w5gcm" Jun 09 07:57:54.061512 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.061495 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" Jun 09 07:57:54.065325 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.065305 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hhcmt" Jun 09 07:57:54.066203 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:54.066174 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5259c534_0a4b_4145_a3c9_18db9b83a062.slice/crio-16070051883c43aad5aa81b0202aa7ed0e13bb9a1e7473b65a72fac87e44d3ec WatchSource:0}: Error finding container 16070051883c43aad5aa81b0202aa7ed0e13bb9a1e7473b65a72fac87e44d3ec: Status 404 returned error can't find the container with id 16070051883c43aad5aa81b0202aa7ed0e13bb9a1e7473b65a72fac87e44d3ec Jun 09 07:57:54.071211 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:54.071185 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261632bb_40cc_4eb0_88b1_bfc631de4ad0.slice/crio-56f57a0b1d4c17b47c69e11ccda1c5fee8b702a84016b369d8a176c36b4b3249 WatchSource:0}: Error finding container 56f57a0b1d4c17b47c69e11ccda1c5fee8b702a84016b369d8a176c36b4b3249: Status 404 returned error can't find the container with id 56f57a0b1d4c17b47c69e11ccda1c5fee8b702a84016b369d8a176c36b4b3249 Jun 09 07:57:54.073516 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:57:54.073492 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7315667c_1546_4683_9858_e6c94fd8ca5d.slice/crio-697b6eb794fe856a8288d91c625c8e367704c54c3fa15291059e27401536288a WatchSource:0}: Error finding container 697b6eb794fe856a8288d91c625c8e367704c54c3fa15291059e27401536288a: Status 404 returned error can't find the container with id 697b6eb794fe856a8288d91c625c8e367704c54c3fa15291059e27401536288a Jun 09 07:57:54.274985 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.274956 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 07:57:54.335727 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.335644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:57:54.335727 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.335716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:54.335911 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:54.335822 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 07:57:54.335911 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:54.335834 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 07:57:54.335911 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:54.335903 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret podName:9674b1fa-6e16-4821-b450-05f74c391b47 nodeName:}" failed. No retries permitted until 2026-06-09 07:57:55.335882551 +0000 UTC m=+3.005728563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret") pod "global-pull-secret-syncer-5smvf" (UID: "9674b1fa-6e16-4821-b450-05f74c391b47") : object "kube-system"/"original-pull-secret" not registered Jun 09 07:57:54.336116 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:54.335923 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs podName:2cc82d46-ff16-4d56-a54a-4d8283ab6d5a nodeName:}" failed. No retries permitted until 2026-06-09 07:57:55.335913347 +0000 UTC m=+3.005759347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs") pod "network-metrics-daemon-fpbq7" (UID: "2cc82d46-ff16-4d56-a54a-4d8283ab6d5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 07:57:54.538410 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.537628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpq5\" (UniqueName: \"kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5\") pod \"network-check-target-dvrfx\" (UID: \"1133942a-7dac-4e81-a19d-9428ae64bd36\") " pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:57:54.538410 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:54.537947 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 07:57:54.538410 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:54.537974 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 07:57:54.538410 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:54.537987 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mmpq5 for pod openshift-network-diagnostics/network-check-target-dvrfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 07:57:54.538410 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:54.538051 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5 podName:1133942a-7dac-4e81-a19d-9428ae64bd36 nodeName:}" failed. No retries permitted until 2026-06-09 07:57:55.538028376 +0000 UTC m=+3.207874375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmpq5" (UniqueName: "kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5") pod "network-check-target-dvrfx" (UID: "1133942a-7dac-4e81-a19d-9428ae64bd36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 07:57:54.781922 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.781760 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 07:52:53 +0000 UTC" deadline="2028-01-24 23:11:43.153654655 +0000 UTC" Jun 09 07:57:54.781922 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.781872 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14271h13m48.371787914s" Jun 09 07:57:54.787738 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.787711 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:57:54.787891 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:54.787856 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:57:54.808260 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.808176 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hhcmt" event={"ID":"7315667c-1546-4683-9858-e6c94fd8ca5d","Type":"ContainerStarted","Data":"697b6eb794fe856a8288d91c625c8e367704c54c3fa15291059e27401536288a"} Jun 09 07:57:54.814289 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.814252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w5gcm" event={"ID":"5259c534-0a4b-4145-a3c9-18db9b83a062","Type":"ContainerStarted","Data":"16070051883c43aad5aa81b0202aa7ed0e13bb9a1e7473b65a72fac87e44d3ec"} Jun 09 07:57:54.832888 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.832804 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptm8p" event={"ID":"0ad0b6d9-c782-474b-a61f-d5b525e99aae","Type":"ContainerStarted","Data":"c7f8e9ce1729c2e6fe4f70b215f7ffda9cc7c6826edb6af004ca6debab4a3de9"} Jun 09 07:57:54.835121 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.835088 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hd2t4" event={"ID":"abf2bb36-50c5-4404-92d4-e66b7b526c44","Type":"ContainerStarted","Data":"a5b79aeb845b8c32388d182a841a744edcf88c3bf4d6b060ac3dbeccfb0004f0"} Jun 09 07:57:54.851363 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.851318 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ks6l6" event={"ID":"7ce57525-7be1-4244-9584-1b2e5bb5d1a1","Type":"ContainerStarted","Data":"4d4079582035d07c1ee9a4f5ce7cf492f2da6d53b8e8aa7753a80a883531bb93"} Jun 09 07:57:54.873088 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.873052 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" event={"ID":"261632bb-40cc-4eb0-88b1-bfc631de4ad0","Type":"ContainerStarted","Data":"56f57a0b1d4c17b47c69e11ccda1c5fee8b702a84016b369d8a176c36b4b3249"} Jun 09 07:57:54.878451 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.878409 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-psxf9" event={"ID":"fee7c818-f667-4a20-8e2d-8d42ca5fa868","Type":"ContainerStarted","Data":"09878eb36be486f5a3a287f028d5bc716dc8734a6d011ab39bad91a0109e37b4"} Jun 09 07:57:54.884322 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.884293 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" event={"ID":"c7195ac3-0b33-4ddc-aa73-25d213a05382","Type":"ContainerStarted","Data":"e780f801baad45a717d8fecbe9642b1d4a438a5041502dbb41bf6dc2890eb335"} Jun 09 07:57:54.888425 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.888394 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" event={"ID":"65978fae-2585-4840-8ef5-eb1b586cd52e","Type":"ContainerStarted","Data":"cd00a88c4fa039ef777cf98ff0529685926c77a390ec03307f427d0e8e4aa8c4"} Jun 09 07:57:54.966132 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:54.966098 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 07:57:55.343589 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:55.343553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:55.343782 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:55.343630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:57:55.343782 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:55.343756 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 07:57:55.343895 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:55.343819 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs podName:2cc82d46-ff16-4d56-a54a-4d8283ab6d5a nodeName:}" failed. No retries permitted until 2026-06-09 07:57:57.343799524 +0000 UTC m=+5.013645521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs") pod "network-metrics-daemon-fpbq7" (UID: "2cc82d46-ff16-4d56-a54a-4d8283ab6d5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 07:57:55.344233 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:55.344214 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 07:57:55.344320 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:55.344271 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret podName:9674b1fa-6e16-4821-b450-05f74c391b47 nodeName:}" failed. No retries permitted until 2026-06-09 07:57:57.344255617 +0000 UTC m=+5.014101618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret") pod "global-pull-secret-syncer-5smvf" (UID: "9674b1fa-6e16-4821-b450-05f74c391b47") : object "kube-system"/"original-pull-secret" not registered Jun 09 07:57:55.469128 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:55.468903 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 07:57:55.545052 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:55.545009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpq5\" (UniqueName: \"kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5\") pod \"network-check-target-dvrfx\" (UID: \"1133942a-7dac-4e81-a19d-9428ae64bd36\") " pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:57:55.545247 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:55.545223 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 07:57:55.545247 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:55.545244 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 07:57:55.545374 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:55.545257 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mmpq5 for pod openshift-network-diagnostics/network-check-target-dvrfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 07:57:55.545374 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:55.545319 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5 podName:1133942a-7dac-4e81-a19d-9428ae64bd36 nodeName:}" failed. No retries permitted until 2026-06-09 07:57:57.545300279 +0000 UTC m=+5.215146285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmpq5" (UniqueName: "kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5") pod "network-check-target-dvrfx" (UID: "1133942a-7dac-4e81-a19d-9428ae64bd36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 07:57:55.783007 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:55.782868 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 07:52:53 +0000 UTC" deadline="2027-11-20 02:26:53.912507959 +0000 UTC" Jun 09 07:57:55.783007 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:55.782914 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12690h28m58.129598645s" Jun 09 07:57:55.785208 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:55.785163 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:55.785333 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:55.785292 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:57:55.785622 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:55.785167 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:57:55.785622 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:55.785523 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:57:56.787424 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:56.787394 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:57:56.787897 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:56.787531 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:57:57.360805 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:57.360737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:57:57.361015 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:57.360815 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:57.361015 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:57.360957 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 07:57:57.361143 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:57.361017 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret podName:9674b1fa-6e16-4821-b450-05f74c391b47 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:01.360999556 +0000 UTC m=+9.030845583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret") pod "global-pull-secret-syncer-5smvf" (UID: "9674b1fa-6e16-4821-b450-05f74c391b47") : object "kube-system"/"original-pull-secret" not registered Jun 09 07:57:57.361407 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:57.361387 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 07:57:57.361482 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:57.361442 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs podName:2cc82d46-ff16-4d56-a54a-4d8283ab6d5a nodeName:}" failed. No retries permitted until 2026-06-09 07:58:01.361426266 +0000 UTC m=+9.031272262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs") pod "network-metrics-daemon-fpbq7" (UID: "2cc82d46-ff16-4d56-a54a-4d8283ab6d5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 07:57:57.562747 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:57.562695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpq5\" (UniqueName: \"kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5\") pod \"network-check-target-dvrfx\" (UID: \"1133942a-7dac-4e81-a19d-9428ae64bd36\") " pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:57:57.562974 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:57.562950 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 07:57:57.563090 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:57.562983 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 07:57:57.563090 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:57.562997 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mmpq5 for pod openshift-network-diagnostics/network-check-target-dvrfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 07:57:57.563090 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:57.563067 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5 podName:1133942a-7dac-4e81-a19d-9428ae64bd36 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:01.563048068 +0000 UTC m=+9.232894064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmpq5" (UniqueName: "kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5") pod "network-check-target-dvrfx" (UID: "1133942a-7dac-4e81-a19d-9428ae64bd36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 07:57:57.784578 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:57.784548 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:57:57.784768 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:57.784667 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:57:57.784768 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:57.784718 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:57.784870 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:57.784835 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:57:58.789961 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:58.789457 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:57:58.789961 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:58.789589 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:57:59.784605 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:59.784567 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:57:59.784795 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:59.784704 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:57:59.784795 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:57:59.784568 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:57:59.784904 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:57:59.784816 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:58:00.785171 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:00.784906 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:00.785171 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:00.785072 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:58:01.395862 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:01.395791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:01.395862 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:01.395858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:01.396122 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:01.396017 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 07:58:01.396122 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:01.396089 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret podName:9674b1fa-6e16-4821-b450-05f74c391b47 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:09.396068105 +0000 UTC m=+17.065914101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret") pod "global-pull-secret-syncer-5smvf" (UID: "9674b1fa-6e16-4821-b450-05f74c391b47") : object "kube-system"/"original-pull-secret" not registered Jun 09 07:58:01.396122 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:01.396017 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 07:58:01.396278 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:01.396191 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs podName:2cc82d46-ff16-4d56-a54a-4d8283ab6d5a nodeName:}" failed. No retries permitted until 2026-06-09 07:58:09.396127192 +0000 UTC m=+17.065973197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs") pod "network-metrics-daemon-fpbq7" (UID: "2cc82d46-ff16-4d56-a54a-4d8283ab6d5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 07:58:01.596781 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:01.596715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpq5\" (UniqueName: \"kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5\") pod \"network-check-target-dvrfx\" (UID: \"1133942a-7dac-4e81-a19d-9428ae64bd36\") " pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:01.596987 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:01.596920 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 07:58:01.596987 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:01.596958 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 07:58:01.596987 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:01.596971 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mmpq5 for pod openshift-network-diagnostics/network-check-target-dvrfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 07:58:01.597147 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:01.597029 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5 podName:1133942a-7dac-4e81-a19d-9428ae64bd36 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:09.597011992 +0000 UTC m=+17.266858004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmpq5" (UniqueName: "kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5") pod "network-check-target-dvrfx" (UID: "1133942a-7dac-4e81-a19d-9428ae64bd36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 07:58:01.784648 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:01.784609 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:01.784897 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:01.784748 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:58:01.784897 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:01.784787 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:01.784897 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:01.784860 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:58:02.787785 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:02.787753 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:02.788491 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:02.787897 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:58:03.784587 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:03.784554 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:03.784767 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:03.784598 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:03.784767 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:03.784692 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:58:03.784869 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:03.784817 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:58:04.788951 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:04.788911 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:04.789362 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:04.789059 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:58:05.784627 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:05.784593 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:05.784826 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:05.784603 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:05.784826 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:05.784721 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:58:05.784826 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:05.784768 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:58:06.788168 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:06.788137 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:06.788590 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:06.788250 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:58:07.784415 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:07.784383 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:07.784590 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:07.784385 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:07.784590 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:07.784513 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:58:07.784701 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:07.784594 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:58:08.785394 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:08.785356 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:08.785794 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:08.785493 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:58:09.459864 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:09.459828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:09.460076 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:09.459888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:09.460076 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:09.460006 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 07:58:09.460154 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:09.460094 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret podName:9674b1fa-6e16-4821-b450-05f74c391b47 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:25.460076413 +0000 UTC m=+33.129922407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret") pod "global-pull-secret-syncer-5smvf" (UID: "9674b1fa-6e16-4821-b450-05f74c391b47") : object "kube-system"/"original-pull-secret" not registered Jun 09 07:58:09.460154 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:09.460013 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 07:58:09.460250 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:09.460168 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs podName:2cc82d46-ff16-4d56-a54a-4d8283ab6d5a nodeName:}" failed. No retries permitted until 2026-06-09 07:58:25.460148772 +0000 UTC m=+33.129994766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs") pod "network-metrics-daemon-fpbq7" (UID: "2cc82d46-ff16-4d56-a54a-4d8283ab6d5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 07:58:09.661599 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:09.661501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpq5\" (UniqueName: \"kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5\") pod \"network-check-target-dvrfx\" (UID: \"1133942a-7dac-4e81-a19d-9428ae64bd36\") " pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:09.661777 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:09.661664 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 07:58:09.661777 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:09.661685 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 07:58:09.661777 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:09.661697 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mmpq5 for pod openshift-network-diagnostics/network-check-target-dvrfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 07:58:09.661777 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:09.661760 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5 podName:1133942a-7dac-4e81-a19d-9428ae64bd36 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:25.661742039 +0000 UTC m=+33.331588037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmpq5" (UniqueName: "kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5") pod "network-check-target-dvrfx" (UID: "1133942a-7dac-4e81-a19d-9428ae64bd36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 07:58:09.785146 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:09.785107 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:09.785335 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:09.785107 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:09.785335 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:09.785250 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:58:09.785335 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:09.785306 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:58:10.784871 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:10.784831 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:10.785155 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:10.785006 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:58:11.785432 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:11.785395 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:11.785876 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:11.785394 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:11.785876 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:11.785534 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:58:11.785876 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:11.785610 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:58:12.786114 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:12.786077 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:12.786603 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:12.786204 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:58:13.785020 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:13.784996 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:13.785140 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:13.785036 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:13.785140 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:13.785117 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:58:13.785261 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:13.785239 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:58:13.948130 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:13.947875 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hhcmt" event={"ID":"7315667c-1546-4683-9858-e6c94fd8ca5d","Type":"ContainerStarted","Data":"c94c82ae1a21aba407410cd8f31dd8532261a9cc049cad211f18393db1f1577b"} Jun 09 07:58:13.952433 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:13.952405 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" event={"ID":"c7195ac3-0b33-4ddc-aa73-25d213a05382","Type":"ContainerStarted","Data":"9c9dc2adc6a1d2f6b134dd31b7dfd17b13aa477ea1934e3155ebe4a604228e65"} Jun 09 07:58:13.961890 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:13.961862 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" event={"ID":"65978fae-2585-4840-8ef5-eb1b586cd52e","Type":"ContainerStarted","Data":"9c0845653fb7eb36367cb928074045e86621d4666919eb3363e56cab02f19972"} Jun 09 07:58:13.969815 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:13.969551 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hhcmt" podStartSLOduration=1.3852648539999999 podStartE2EDuration="20.969530087s" totalImagesPullingTime="19.584265233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:58:13.968765376 +0000 UTC m=+21.638611391" watchObservedRunningTime="2026-06-09 07:58:13.969530087 +0000 UTC m=+21.639376104" Jun 09 07:58:13.972270 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:13.971361 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" event={"ID":"be5b5bfec53750cccc5fe667c2f32c1d","Type":"ContainerStarted","Data":"3c072d1a3809b7f5eb4d9a7d84a792297c214bdce54df0af1860fc9eaf32874d"} Jun 09 07:58:13.987342 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:13.986942 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qbj6k" podStartSLOduration=2.402072778 podStartE2EDuration="21.986911092s" totalImagesPullingTime="19.584838314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:58:13.986592361 +0000 UTC m=+21.656438373" watchObservedRunningTime="2026-06-09 07:58:13.986911092 +0000 UTC m=+21.656757141" Jun 09 07:58:14.000398 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.000356 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-124.ec2.internal" podStartSLOduration=21.000339767 podStartE2EDuration="21.000339767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:57:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:58:14.000173814 +0000 UTC m=+21.670019852" watchObservedRunningTime="2026-06-09 07:58:14.000339767 +0000 UTC m=+21.670185782" Jun 09 07:58:14.785748 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.785568 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:14.785885 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:14.785855 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:58:14.975298 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.975254 2577 generic.go:356] "Generic (PLEG): container finished" podID="458c15fea976bb530ec709b458d3c76a" containerID="5a60302637a8c03a521f6ed7edf47c8f3e6745db4de9fe5aaf45913138a4ff0d" exitCode=0 Jun 09 07:58:14.976124 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.975339 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" event={"ID":"458c15fea976bb530ec709b458d3c76a","Type":"ContainerDied","Data":"5a60302637a8c03a521f6ed7edf47c8f3e6745db4de9fe5aaf45913138a4ff0d"} Jun 09 07:58:14.977024 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.976994 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w5gcm" event={"ID":"5259c534-0a4b-4145-a3c9-18db9b83a062","Type":"ContainerStarted","Data":"6164a552c412af9615f14b479eb6032d3fef98d69c276384bb23cea0815e99eb"} Jun 09 07:58:14.978664 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.978640 2577 generic.go:356] "Generic (PLEG): container finished" podID="0ad0b6d9-c782-474b-a61f-d5b525e99aae" containerID="07f11c8977d8fa240b9a24c9a6bca45a98701a9dcf40e7b7c66eebcd06c373e6" exitCode=0 Jun 09 07:58:14.978772 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.978724 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptm8p" event={"ID":"0ad0b6d9-c782-474b-a61f-d5b525e99aae","Type":"ContainerDied","Data":"07f11c8977d8fa240b9a24c9a6bca45a98701a9dcf40e7b7c66eebcd06c373e6"} Jun 09 07:58:14.980330 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.980217 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hd2t4" event={"ID":"abf2bb36-50c5-4404-92d4-e66b7b526c44","Type":"ContainerStarted","Data":"b6103d231531c0042364790f9f2a4a166ab72897c983bf369d4a22ac69ce9c05"} Jun 09 07:58:14.981933 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.981910 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ks6l6" event={"ID":"7ce57525-7be1-4244-9584-1b2e5bb5d1a1","Type":"ContainerStarted","Data":"0dd5025444e7ebb139dd755df1d062caf04e46a418e860a91ad4c87169080b95"} Jun 09 07:58:14.983414 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.983393 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" event={"ID":"261632bb-40cc-4eb0-88b1-bfc631de4ad0","Type":"ContainerStarted","Data":"ff75840cab80cece62d2882b79bdd6edef88790239b9d88ac349260160d07fd1"} Jun 09 07:58:14.984982 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.984957 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-psxf9" event={"ID":"fee7c818-f667-4a20-8e2d-8d42ca5fa868","Type":"ContainerStarted","Data":"ea68d340d6299f08f5d5349ae97b4de789c9e851e7cac13c9e49e1e9f0d4310a"} Jun 09 07:58:14.987913 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.987892 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" event={"ID":"c7195ac3-0b33-4ddc-aa73-25d213a05382","Type":"ContainerStarted","Data":"9d8f13113426b586ab549e14c1459de780d4521a9bc61013a995cf320810e22b"} Jun 09 07:58:14.988016 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.987985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" event={"ID":"c7195ac3-0b33-4ddc-aa73-25d213a05382","Type":"ContainerStarted","Data":"905e57a881da1aad6fa83df697b983125583b7c8eaffb265c31832e4e4ea91d6"} Jun 09 07:58:14.988087 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.988037 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" event={"ID":"c7195ac3-0b33-4ddc-aa73-25d213a05382","Type":"ContainerStarted","Data":"03c9dab647b5fda009ce16c8825d997c441c0f3509c702194b7a38cc7be5561e"} Jun 09 07:58:14.988143 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.988088 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" event={"ID":"c7195ac3-0b33-4ddc-aa73-25d213a05382","Type":"ContainerStarted","Data":"44a31a71a51ed8956ccdba2bc03fc365a03362b032953c3ebd5492a5f85b47ad"} Jun 09 07:58:14.988143 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:14.988134 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" event={"ID":"c7195ac3-0b33-4ddc-aa73-25d213a05382","Type":"ContainerStarted","Data":"6763b5e2470c79796cebaccf73208c9425758e124e52b0f3e0b9481b5f166ad7"} Jun 09 07:58:15.013796 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.013756 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hd2t4" podStartSLOduration=2.440786852 podStartE2EDuration="22.013739443s" totalImagesPullingTime="19.572952591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:58:15.013684685 +0000 UTC m=+22.683530701" watchObservedRunningTime="2026-06-09 07:58:15.013739443 +0000 UTC m=+22.683585459" Jun 09 07:58:15.035242 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.035194 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-psxf9" podStartSLOduration=2.474667859 podStartE2EDuration="22.035174733s" totalImagesPullingTime="19.560506874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:58:15.034440243 +0000 UTC m=+22.704286258" watchObservedRunningTime="2026-06-09 07:58:15.035174733 +0000 UTC m=+22.705020749" Jun 09 07:58:15.079773 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.079723 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ks6l6" podStartSLOduration=3.491528428 podStartE2EDuration="23.079705557s" totalImagesPullingTime="19.588177129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:58:15.055168091 +0000 UTC m=+22.725014157" watchObservedRunningTime="2026-06-09 07:58:15.079705557 +0000 UTC m=+22.749551573" Jun 09 07:58:15.095146 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.095112 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w5gcm" podStartSLOduration=2.54108577 podStartE2EDuration="22.095100239s" totalImagesPullingTime="19.554014469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:58:15.094976807 +0000 UTC m=+22.764822823" watchObservedRunningTime="2026-06-09 07:58:15.095100239 +0000 UTC m=+22.764946254" Jun 09 07:58:15.602903 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.602864 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ks6l6" Jun 09 07:58:15.603452 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.603436 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ks6l6" Jun 09 07:58:15.785045 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.785021 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:15.785190 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.785021 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:15.785190 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:15.785157 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:58:15.785308 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:15.785215 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:58:15.789526 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.789473 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 07:58:15.796625 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.796535 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T07:58:15.789489316Z","UUID":"6f6fd9ad-581d-48fa-ae9f-50f59e55baeb","Handler":null,"Name":"","Endpoint":""} Jun 09 07:58:15.798472 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.798456 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 07:58:15.798580 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.798484 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 07:58:15.992812 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.992775 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" event={"ID":"458c15fea976bb530ec709b458d3c76a","Type":"ContainerStarted","Data":"9b84bcdb66ed0bd95a4d3d7c33a4999a75ad88d4012f1d918beb1098443741b5"} Jun 09 07:58:15.994748 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.994721 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" event={"ID":"261632bb-40cc-4eb0-88b1-bfc631de4ad0","Type":"ContainerStarted","Data":"dbc81a368d4c7d020541e429709affdbc141330ed62ab3cfabb4eb6ff356edb8"} Jun 09 07:58:15.995226 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.995206 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ks6l6" Jun 09 07:58:15.995673 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:15.995655 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ks6l6" Jun 09 07:58:16.013316 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:16.013260 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-124.ec2.internal" podStartSLOduration=23.013244567 podStartE2EDuration="23.013244567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:57:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:58:16.013125445 +0000 UTC m=+23.682971460" watchObservedRunningTime="2026-06-09 07:58:16.013244567 +0000 UTC m=+23.683090581" Jun 09 07:58:16.785081 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:16.784841 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:16.785252 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:16.785209 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:58:17.001450 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:17.001408 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" event={"ID":"c7195ac3-0b33-4ddc-aa73-25d213a05382","Type":"ContainerStarted","Data":"ef49e5db5a32fb1cb144d6726abf2907b5a0c5fbabb1b7b7085c97c809f5d097"} Jun 09 07:58:17.784989 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:17.784958 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:17.785223 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:17.784957 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:17.785223 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:17.785064 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:58:17.785223 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:17.785145 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:58:18.006445 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:18.006408 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" event={"ID":"261632bb-40cc-4eb0-88b1-bfc631de4ad0","Type":"ContainerStarted","Data":"4b9770578656bea28409c282c282155f3537b9821484c698a54da5208c28e860"} Jun 09 07:58:18.027125 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:18.027084 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kr9jb" podStartSLOduration=2.963685171 podStartE2EDuration="25.027070723s" totalImagesPullingTime="22.063385552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:57:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:58:18.026628895 +0000 UTC m=+25.696474910" watchObservedRunningTime="2026-06-09 07:58:18.027070723 +0000 UTC m=+25.696916737" Jun 09 07:58:18.785351 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:18.785314 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:18.785523 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:18.785449 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:58:19.784710 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:19.784555 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:19.785348 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:19.784570 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:19.785348 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:19.784824 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:58:19.785348 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:19.784860 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:58:20.015286 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:20.015258 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" event={"ID":"c7195ac3-0b33-4ddc-aa73-25d213a05382","Type":"ContainerStarted","Data":"5b51b3aa6001e92b79fd63480d841d16a65139a18ba1c6da38fea29f26d1586e"} Jun 09 07:58:20.015482 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:20.015459 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:58:20.015583 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:20.015517 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:58:20.015583 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:20.015566 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:58:20.034693 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:20.034670 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:58:20.035170 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:20.035152 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:58:20.043790 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:20.043750 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" podStartSLOduration=7.2514186800000004 podStartE2EDuration="27.043736962s" totalImagesPullingTime="19.792318282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:58:20.043259629 +0000 UTC m=+27.713105644" watchObservedRunningTime="2026-06-09 07:58:20.043736962 +0000 UTC m=+27.713582977" Jun 09 07:58:20.784578 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:20.784539 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:20.784810 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:20.784715 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:58:21.020332 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:21.020226 2577 generic.go:356] "Generic (PLEG): container finished" podID="0ad0b6d9-c782-474b-a61f-d5b525e99aae" containerID="98c10636f32f7da76d9d595f97e76dae8309529899a2f4c3277dc47e1b87ba51" exitCode=0 Jun 09 07:58:21.020332 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:21.020318 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptm8p" event={"ID":"0ad0b6d9-c782-474b-a61f-d5b525e99aae","Type":"ContainerDied","Data":"98c10636f32f7da76d9d595f97e76dae8309529899a2f4c3277dc47e1b87ba51"} Jun 09 07:58:21.701081 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:21.701027 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fpbq7"] Jun 09 07:58:21.701256 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:21.701148 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:21.701322 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:21.701265 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:58:21.704881 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:21.704854 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5smvf"] Jun 09 07:58:21.705038 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:21.704984 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:21.705112 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:21.705089 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:58:21.705638 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:21.705613 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dvrfx"] Jun 09 07:58:21.705730 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:21.705702 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:21.705808 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:21.705780 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:58:22.785747 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:22.785704 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:22.786167 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:22.785803 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:58:23.026125 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:23.026091 2577 generic.go:356] "Generic (PLEG): container finished" podID="0ad0b6d9-c782-474b-a61f-d5b525e99aae" containerID="7c45c7a96489ede9e26543d946977b1313e668284bad0d2b138611adace54682" exitCode=0 Jun 09 07:58:23.026284 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:23.026154 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptm8p" event={"ID":"0ad0b6d9-c782-474b-a61f-d5b525e99aae","Type":"ContainerDied","Data":"7c45c7a96489ede9e26543d946977b1313e668284bad0d2b138611adace54682"} Jun 09 07:58:23.785115 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:23.784910 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:23.785270 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:23.784910 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:23.785270 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:23.785163 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:58:23.785270 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:23.785224 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:58:24.785054 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:24.785023 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:24.785595 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:24.785137 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:58:25.033739 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:25.033705 2577 generic.go:356] "Generic (PLEG): container finished" podID="0ad0b6d9-c782-474b-a61f-d5b525e99aae" containerID="460e67aec9ef14d72eb2f8fa094c55b889d74d70b0097534fb0429266ed2b6d0" exitCode=0 Jun 09 07:58:25.033907 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:25.033748 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptm8p" event={"ID":"0ad0b6d9-c782-474b-a61f-d5b525e99aae","Type":"ContainerDied","Data":"460e67aec9ef14d72eb2f8fa094c55b889d74d70b0097534fb0429266ed2b6d0"} Jun 09 07:58:25.481909 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:25.481876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:25.482061 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:25.481946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:25.482061 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:25.482031 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 07:58:25.482134 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:25.482086 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret podName:9674b1fa-6e16-4821-b450-05f74c391b47 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:57.482071215 +0000 UTC m=+65.151917208 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret") pod "global-pull-secret-syncer-5smvf" (UID: "9674b1fa-6e16-4821-b450-05f74c391b47") : object "kube-system"/"original-pull-secret" not registered Jun 09 07:58:25.482134 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:25.482031 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 07:58:25.482199 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:25.482155 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs podName:2cc82d46-ff16-4d56-a54a-4d8283ab6d5a nodeName:}" failed. No retries permitted until 2026-06-09 07:58:57.482141912 +0000 UTC m=+65.151987918 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs") pod "network-metrics-daemon-fpbq7" (UID: "2cc82d46-ff16-4d56-a54a-4d8283ab6d5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 07:58:25.683084 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:25.683043 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpq5\" (UniqueName: \"kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5\") pod \"network-check-target-dvrfx\" (UID: \"1133942a-7dac-4e81-a19d-9428ae64bd36\") " pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:25.683271 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:25.683168 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 07:58:25.683271 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:25.683182 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 07:58:25.683271 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:25.683193 2577 projected.go:196] Error preparing data for projected volume kube-api-access-mmpq5 for pod openshift-network-diagnostics/network-check-target-dvrfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 07:58:25.683271 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:25.683250 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5 podName:1133942a-7dac-4e81-a19d-9428ae64bd36 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:57.683231621 +0000 UTC m=+65.353077614 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmpq5" (UniqueName: "kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5") pod "network-check-target-dvrfx" (UID: "1133942a-7dac-4e81-a19d-9428ae64bd36") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 07:58:25.784610 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:25.784574 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:25.784787 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:25.784707 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvrfx" podUID="1133942a-7dac-4e81-a19d-9428ae64bd36" Jun 09 07:58:25.784787 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:25.784763 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:25.784883 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:25.784863 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 07:58:26.784922 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:26.784892 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:26.785492 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:26.785011 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5smvf" podUID="9674b1fa-6e16-4821-b450-05f74c391b47" Jun 09 07:58:27.698583 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.698552 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-124.ec2.internal" event="NodeReady" Jun 09 07:58:27.698740 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.698700 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 07:58:27.749120 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.749088 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-755c65d86-vbvsk"] Jun 09 07:58:27.751276 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.751254 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.758072 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.758050 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 07:58:27.758396 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.758377 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 07:58:27.758968 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.758599 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xh9rz\"" Jun 09 07:58:27.758968 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.758842 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 07:58:27.770565 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.770535 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 07:58:27.780187 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.780153 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-755c65d86-vbvsk"] Jun 09 07:58:27.784448 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.784426 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:27.784643 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.784620 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:27.790669 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.790646 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 07:58:27.791107 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.790681 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dscxw\"" Jun 09 07:58:27.791107 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.790718 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 07:58:27.791107 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.790978 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n7k9q\"" Jun 09 07:58:27.791107 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.790981 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 07:58:27.804449 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.804426 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jtkj4"] Jun 09 07:58:27.806187 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.806165 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-llcp2"] Jun 09 07:58:27.806292 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.806274 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:27.807875 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.807856 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-llcp2" Jun 09 07:58:27.809068 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.809047 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9bx48\"" Jun 09 07:58:27.809166 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.809123 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 07:58:27.809491 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.809474 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 07:58:27.810471 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.810452 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 07:58:27.810605 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.810488 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 07:58:27.810674 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.810513 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 07:58:27.811371 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.811343 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bzcsd\"" Jun 09 07:58:27.820983 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.820963 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-llcp2"] Jun 09 07:58:27.822367 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.822345 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jtkj4"] Jun 09 07:58:27.896745 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.896716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.896745 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.896747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-bound-sa-token\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.896959 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.896799 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7668w\" (UniqueName: \"kubernetes.io/projected/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-kube-api-access-7668w\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:27.896959 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.896886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-config-volume\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:27.896959 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.896913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8rlc\" (UniqueName: \"kubernetes.io/projected/3614ebbe-a959-4a99-8803-6da8f1585af5-kube-api-access-x8rlc\") pod \"ingress-canary-llcp2\" (UID: \"3614ebbe-a959-4a99-8803-6da8f1585af5\") " pod="openshift-ingress-canary/ingress-canary-llcp2" Jun 09 07:58:27.896959 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.896950 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25706869-edda-4203-9bde-a4504938b478-ca-trust-extracted\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.897214 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.896969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25706869-edda-4203-9bde-a4504938b478-installation-pull-secrets\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.897214 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.897007 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:27.897214 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.897034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ghn8\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-kube-api-access-4ghn8\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.897214 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.897120 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25706869-edda-4203-9bde-a4504938b478-image-registry-private-configuration\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.897214 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.897139 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25706869-edda-4203-9bde-a4504938b478-registry-certificates\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.897214 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.897181 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25706869-edda-4203-9bde-a4504938b478-trusted-ca\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.897464 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.897225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-tmp-dir\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:27.897464 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.897249 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3614ebbe-a959-4a99-8803-6da8f1585af5-cert\") pod \"ingress-canary-llcp2\" (UID: \"3614ebbe-a959-4a99-8803-6da8f1585af5\") " pod="openshift-ingress-canary/ingress-canary-llcp2" Jun 09 07:58:27.998209 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7668w\" (UniqueName: \"kubernetes.io/projected/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-kube-api-access-7668w\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:27.998209 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998174 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-config-volume\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:27.998209 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8rlc\" (UniqueName: \"kubernetes.io/projected/3614ebbe-a959-4a99-8803-6da8f1585af5-kube-api-access-x8rlc\") pod \"ingress-canary-llcp2\" (UID: \"3614ebbe-a959-4a99-8803-6da8f1585af5\") " pod="openshift-ingress-canary/ingress-canary-llcp2" Jun 09 07:58:27.998468 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998249 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25706869-edda-4203-9bde-a4504938b478-ca-trust-extracted\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.998468 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25706869-edda-4203-9bde-a4504938b478-installation-pull-secrets\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.998468 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:27.998468 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ghn8\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-kube-api-access-4ghn8\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.998468 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998397 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25706869-edda-4203-9bde-a4504938b478-image-registry-private-configuration\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.998468 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25706869-edda-4203-9bde-a4504938b478-registry-certificates\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.998468 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25706869-edda-4203-9bde-a4504938b478-trusted-ca\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.998771 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-tmp-dir\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:27.998771 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998499 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3614ebbe-a959-4a99-8803-6da8f1585af5-cert\") pod \"ingress-canary-llcp2\" (UID: \"3614ebbe-a959-4a99-8803-6da8f1585af5\") " pod="openshift-ingress-canary/ingress-canary-llcp2" Jun 09 07:58:27.998771 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.998771 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-bound-sa-token\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.998924 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.998810 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-config-volume\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:27.999142 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:27.999122 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 07:58:27.999502 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:27.999223 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls podName:5822a48b-2f65-4848-9f7e-fdaaaaf881f7 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:28.49920225 +0000 UTC m=+36.169048262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls") pod "dns-default-jtkj4" (UID: "5822a48b-2f65-4848-9f7e-fdaaaaf881f7") : secret "dns-default-metrics-tls" not found Jun 09 07:58:27.999502 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.999227 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25706869-edda-4203-9bde-a4504938b478-ca-trust-extracted\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.999502 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.999311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-tmp-dir\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:27.999502 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:27.999417 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:58:27.999502 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:27.999433 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755c65d86-vbvsk: secret "image-registry-tls" not found Jun 09 07:58:27.999502 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:27.999451 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25706869-edda-4203-9bde-a4504938b478-registry-certificates\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:27.999502 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:27.999476 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls podName:25706869-edda-4203-9bde-a4504938b478 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:28.499462299 +0000 UTC m=+36.169308307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls") pod "image-registry-755c65d86-vbvsk" (UID: "25706869-edda-4203-9bde-a4504938b478") : secret "image-registry-tls" not found Jun 09 07:58:28.000194 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.000167 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25706869-edda-4203-9bde-a4504938b478-trusted-ca\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:28.003268 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.003243 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25706869-edda-4203-9bde-a4504938b478-image-registry-private-configuration\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:28.003387 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.003298 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25706869-edda-4203-9bde-a4504938b478-installation-pull-secrets\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:28.003387 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.003322 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3614ebbe-a959-4a99-8803-6da8f1585af5-cert\") pod \"ingress-canary-llcp2\" (UID: \"3614ebbe-a959-4a99-8803-6da8f1585af5\") " pod="openshift-ingress-canary/ingress-canary-llcp2" Jun 09 07:58:28.008914 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.008889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-bound-sa-token\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:28.009038 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.008982 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ghn8\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-kube-api-access-4ghn8\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:28.009038 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.009012 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7668w\" (UniqueName: \"kubernetes.io/projected/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-kube-api-access-7668w\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:28.009182 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.009063 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8rlc\" (UniqueName: \"kubernetes.io/projected/3614ebbe-a959-4a99-8803-6da8f1585af5-kube-api-access-x8rlc\") pod \"ingress-canary-llcp2\" (UID: \"3614ebbe-a959-4a99-8803-6da8f1585af5\") " pod="openshift-ingress-canary/ingress-canary-llcp2" Jun 09 07:58:28.124726 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.124689 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-llcp2" Jun 09 07:58:28.362808 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.362648 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ks6l6_7ce57525-7be1-4244-9584-1b2e5bb5d1a1/konnectivity-agent/0.log" limit=1024 Jun 09 07:58:28.478665 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.478625 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ks6l6_7ce57525-7be1-4244-9584-1b2e5bb5d1a1/konnectivity-agent/0.log" limit=1024 Jun 09 07:58:28.502743 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.502704 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:28.502916 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.502797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:28.502916 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:28.502881 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 07:58:28.502916 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:28.502910 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:58:28.503125 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:28.502923 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755c65d86-vbvsk: secret "image-registry-tls" not found Jun 09 07:58:28.503125 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:28.502980 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls podName:5822a48b-2f65-4848-9f7e-fdaaaaf881f7 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:29.502955072 +0000 UTC m=+37.172801090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls") pod "dns-default-jtkj4" (UID: "5822a48b-2f65-4848-9f7e-fdaaaaf881f7") : secret "dns-default-metrics-tls" not found Jun 09 07:58:28.503125 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:28.503000 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls podName:25706869-edda-4203-9bde-a4504938b478 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:29.502990609 +0000 UTC m=+37.172836604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls") pod "image-registry-755c65d86-vbvsk" (UID: "25706869-edda-4203-9bde-a4504938b478") : secret "image-registry-tls" not found Jun 09 07:58:28.537319 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.537271 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ks6l6_7ce57525-7be1-4244-9584-1b2e5bb5d1a1/konnectivity-agent/0.log" limit=1024 Jun 09 07:58:28.785159 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.785126 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:28.788340 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:28.788304 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 07:58:29.307816 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:29.307631 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-llcp2"] Jun 09 07:58:29.311598 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:58:29.311573 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3614ebbe_a959_4a99_8803_6da8f1585af5.slice/crio-dbfc1e2bba6c7eae7b4865706e720168aaad2e96a3c74cb874a16adf49d62cc3 WatchSource:0}: Error finding container dbfc1e2bba6c7eae7b4865706e720168aaad2e96a3c74cb874a16adf49d62cc3: Status 404 returned error can't find the container with id dbfc1e2bba6c7eae7b4865706e720168aaad2e96a3c74cb874a16adf49d62cc3 Jun 09 07:58:29.509923 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:29.509897 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:29.510039 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:29.509980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:29.510075 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:29.510043 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 07:58:29.510104 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:29.510085 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:58:29.510104 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:29.510095 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755c65d86-vbvsk: secret "image-registry-tls" not found Jun 09 07:58:29.510162 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:29.510110 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls podName:5822a48b-2f65-4848-9f7e-fdaaaaf881f7 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:31.510091812 +0000 UTC m=+39.179937810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls") pod "dns-default-jtkj4" (UID: "5822a48b-2f65-4848-9f7e-fdaaaaf881f7") : secret "dns-default-metrics-tls" not found Jun 09 07:58:29.510162 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:29.510130 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls podName:25706869-edda-4203-9bde-a4504938b478 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:31.510119921 +0000 UTC m=+39.179965915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls") pod "image-registry-755c65d86-vbvsk" (UID: "25706869-edda-4203-9bde-a4504938b478") : secret "image-registry-tls" not found Jun 09 07:58:30.049690 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:30.049657 2577 generic.go:356] "Generic (PLEG): container finished" podID="0ad0b6d9-c782-474b-a61f-d5b525e99aae" containerID="6e285b8987c52338b5affbf49bdccbbad82da5fcef68fb775fad47bd6afaad7e" exitCode=0 Jun 09 07:58:30.049830 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:30.049737 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptm8p" event={"ID":"0ad0b6d9-c782-474b-a61f-d5b525e99aae","Type":"ContainerDied","Data":"6e285b8987c52338b5affbf49bdccbbad82da5fcef68fb775fad47bd6afaad7e"} Jun 09 07:58:30.050846 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:30.050813 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-llcp2" event={"ID":"3614ebbe-a959-4a99-8803-6da8f1585af5","Type":"ContainerStarted","Data":"dbfc1e2bba6c7eae7b4865706e720168aaad2e96a3c74cb874a16adf49d62cc3"} Jun 09 07:58:30.850691 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:30.850640 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ks6l6_7ce57525-7be1-4244-9584-1b2e5bb5d1a1/konnectivity-agent/0.log" limit=1024 Jun 09 07:58:30.913779 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:30.913742 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ks6l6_7ce57525-7be1-4244-9584-1b2e5bb5d1a1/konnectivity-agent/0.log" limit=1024 Jun 09 07:58:31.056559 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:31.056524 2577 generic.go:356] "Generic (PLEG): container finished" podID="0ad0b6d9-c782-474b-a61f-d5b525e99aae" containerID="a50fbabc8788440a1b68f7095140861c0417d429737cfe5f201a642669f5028b" exitCode=0 Jun 09 07:58:31.056705 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:31.056570 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptm8p" event={"ID":"0ad0b6d9-c782-474b-a61f-d5b525e99aae","Type":"ContainerDied","Data":"a50fbabc8788440a1b68f7095140861c0417d429737cfe5f201a642669f5028b"} Jun 09 07:58:31.525009 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:31.524981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:31.525108 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:31.525052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:31.525150 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:31.525136 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:58:31.525150 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:31.525138 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 07:58:31.525220 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:31.525200 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls podName:5822a48b-2f65-4848-9f7e-fdaaaaf881f7 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:35.525186315 +0000 UTC m=+43.195032307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls") pod "dns-default-jtkj4" (UID: "5822a48b-2f65-4848-9f7e-fdaaaaf881f7") : secret "dns-default-metrics-tls" not found Jun 09 07:58:31.525264 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:31.525146 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755c65d86-vbvsk: secret "image-registry-tls" not found Jun 09 07:58:31.525295 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:31.525277 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls podName:25706869-edda-4203-9bde-a4504938b478 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:35.52526544 +0000 UTC m=+43.195111443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls") pod "image-registry-755c65d86-vbvsk" (UID: "25706869-edda-4203-9bde-a4504938b478") : secret "image-registry-tls" not found Jun 09 07:58:32.062671 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:32.062585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptm8p" event={"ID":"0ad0b6d9-c782-474b-a61f-d5b525e99aae","Type":"ContainerStarted","Data":"c6a9e9da3905fab144d361db866e600015da73eb64d72b7493433d1a5ee87194"} Jun 09 07:58:32.064044 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:32.064015 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-llcp2" event={"ID":"3614ebbe-a959-4a99-8803-6da8f1585af5","Type":"ContainerStarted","Data":"d91df8dc3c6d2dd94ca14f943f828c1ee9aeca2098ae0ad1ad84306322b100da"} Jun 09 07:58:32.092943 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:32.092871 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ptm8p" podStartSLOduration=8.338758950999999 podStartE2EDuration="39.092854544s" totalImagesPullingTime="30.754095593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:57:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:58:32.091356445 +0000 UTC m=+39.761202460" watchObservedRunningTime="2026-06-09 07:58:32.092854544 +0000 UTC m=+39.762700559" Jun 09 07:58:32.112059 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:32.112008 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-llcp2" podStartSLOduration=2.61310744 podStartE2EDuration="5.111995956s" totalImagesPullingTime="2.498888516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:58:32.111437464 +0000 UTC m=+39.781283495" watchObservedRunningTime="2026-06-09 07:58:32.111995956 +0000 UTC m=+39.781841971" Jun 09 07:58:32.226602 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:32.226566 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ks6l6_7ce57525-7be1-4244-9584-1b2e5bb5d1a1/konnectivity-agent/0.log" limit=1024 Jun 09 07:58:32.291523 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:32.291490 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ks6l6_7ce57525-7be1-4244-9584-1b2e5bb5d1a1/konnectivity-agent/0.log" limit=1024 Jun 09 07:58:35.555491 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:35.555450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:35.555882 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:35.555510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:35.555882 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:35.555607 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:58:35.555882 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:35.555630 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755c65d86-vbvsk: secret "image-registry-tls" not found Jun 09 07:58:35.555882 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:35.555682 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls podName:25706869-edda-4203-9bde-a4504938b478 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:43.555666917 +0000 UTC m=+51.225512915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls") pod "image-registry-755c65d86-vbvsk" (UID: "25706869-edda-4203-9bde-a4504938b478") : secret "image-registry-tls" not found Jun 09 07:58:35.555882 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:35.555614 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 07:58:35.555882 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:35.555737 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls podName:5822a48b-2f65-4848-9f7e-fdaaaaf881f7 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:43.555723453 +0000 UTC m=+51.225569446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls") pod "dns-default-jtkj4" (UID: "5822a48b-2f65-4848-9f7e-fdaaaaf881f7") : secret "dns-default-metrics-tls" not found Jun 09 07:58:41.238168 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:41.238128 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ks6l6_7ce57525-7be1-4244-9584-1b2e5bb5d1a1/konnectivity-agent/0.log" limit=1024 Jun 09 07:58:41.328338 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:41.328301 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ks6l6_7ce57525-7be1-4244-9584-1b2e5bb5d1a1/konnectivity-agent/0.log" limit=1024 Jun 09 07:58:42.230835 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:42.230789 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ks6l6_7ce57525-7be1-4244-9584-1b2e5bb5d1a1/konnectivity-agent/0.log" limit=1024 Jun 09 07:58:42.331018 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:42.330975 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ks6l6_7ce57525-7be1-4244-9584-1b2e5bb5d1a1/konnectivity-agent/0.log" limit=1024 Jun 09 07:58:43.614457 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:43.614418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:43.614844 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:43.614489 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:43.614844 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:43.614580 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:58:43.614844 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:43.614585 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 07:58:43.614844 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:43.614591 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755c65d86-vbvsk: secret "image-registry-tls" not found Jun 09 07:58:43.614844 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:43.614676 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls podName:5822a48b-2f65-4848-9f7e-fdaaaaf881f7 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:59.614656414 +0000 UTC m=+67.284502412 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls") pod "dns-default-jtkj4" (UID: "5822a48b-2f65-4848-9f7e-fdaaaaf881f7") : secret "dns-default-metrics-tls" not found Jun 09 07:58:43.614844 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:43.614697 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls podName:25706869-edda-4203-9bde-a4504938b478 nodeName:}" failed. No retries permitted until 2026-06-09 07:58:59.614688421 +0000 UTC m=+67.284534419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls") pod "image-registry-755c65d86-vbvsk" (UID: "25706869-edda-4203-9bde-a4504938b478") : secret "image-registry-tls" not found Jun 09 07:58:45.161506 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:45.161464 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ks6l6_7ce57525-7be1-4244-9584-1b2e5bb5d1a1/konnectivity-agent/0.log" limit=1024 Jun 09 07:58:52.032166 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:52.032134 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z7cxx" Jun 09 07:58:57.514708 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:57.514666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 07:58:57.515142 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:57.514727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:57.517610 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:57.517584 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 07:58:57.517670 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:57.517584 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 07:58:57.525653 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:57.525632 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 07:58:57.525723 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:57.525693 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs podName:2cc82d46-ff16-4d56-a54a-4d8283ab6d5a nodeName:}" failed. No retries permitted until 2026-06-09 08:00:01.525676554 +0000 UTC m=+129.195522547 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs") pod "network-metrics-daemon-fpbq7" (UID: "2cc82d46-ff16-4d56-a54a-4d8283ab6d5a") : secret "metrics-daemon-secret" not found Jun 09 07:58:57.529232 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:57.529214 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9674b1fa-6e16-4821-b450-05f74c391b47-original-pull-secret\") pod \"global-pull-secret-syncer-5smvf\" (UID: \"9674b1fa-6e16-4821-b450-05f74c391b47\") " pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:57.598309 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:57.598257 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5smvf" Jun 09 07:58:57.715331 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:57.715297 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5smvf"] Jun 09 07:58:57.716748 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:57.716599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpq5\" (UniqueName: \"kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5\") pod \"network-check-target-dvrfx\" (UID: \"1133942a-7dac-4e81-a19d-9428ae64bd36\") " pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:57.718714 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:58:57.718682 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9674b1fa_6e16_4821_b450_05f74c391b47.slice/crio-6aa0df04d775f8073894a673951ac9b96a98139e2ea01520afc808cd6c1b972d WatchSource:0}: Error finding container 6aa0df04d775f8073894a673951ac9b96a98139e2ea01520afc808cd6c1b972d: Status 404 returned error can't find the container with id 6aa0df04d775f8073894a673951ac9b96a98139e2ea01520afc808cd6c1b972d Jun 09 07:58:57.719059 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:57.719042 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 07:58:57.729347 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:57.729330 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 07:58:57.739583 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:57.739553 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmpq5\" (UniqueName: \"kubernetes.io/projected/1133942a-7dac-4e81-a19d-9428ae64bd36-kube-api-access-mmpq5\") pod \"network-check-target-dvrfx\" (UID: \"1133942a-7dac-4e81-a19d-9428ae64bd36\") " pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:57.798296 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:57.798218 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dscxw\"" Jun 09 07:58:57.806507 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:57.806486 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:58:57.922304 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:57.922270 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dvrfx"] Jun 09 07:58:57.925751 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:58:57.925729 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1133942a_7dac_4e81_a19d_9428ae64bd36.slice/crio-8eb0879550e53dbd06ff6ecb95105f0c82a0fc98f5d78b7a9d27902b280fd612 WatchSource:0}: Error finding container 8eb0879550e53dbd06ff6ecb95105f0c82a0fc98f5d78b7a9d27902b280fd612: Status 404 returned error can't find the container with id 8eb0879550e53dbd06ff6ecb95105f0c82a0fc98f5d78b7a9d27902b280fd612 Jun 09 07:58:58.123492 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:58.123404 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dvrfx" event={"ID":"1133942a-7dac-4e81-a19d-9428ae64bd36","Type":"ContainerStarted","Data":"8eb0879550e53dbd06ff6ecb95105f0c82a0fc98f5d78b7a9d27902b280fd612"} Jun 09 07:58:58.124412 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:58.124385 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5smvf" event={"ID":"9674b1fa-6e16-4821-b450-05f74c391b47","Type":"ContainerStarted","Data":"6aa0df04d775f8073894a673951ac9b96a98139e2ea01520afc808cd6c1b972d"} Jun 09 07:58:59.629633 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:59.629596 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:58:59.630132 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:58:59.629673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:58:59.630132 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:59.629786 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 07:58:59.630132 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:59.629854 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls podName:5822a48b-2f65-4848-9f7e-fdaaaaf881f7 nodeName:}" failed. No retries permitted until 2026-06-09 07:59:31.629838451 +0000 UTC m=+99.299684443 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls") pod "dns-default-jtkj4" (UID: "5822a48b-2f65-4848-9f7e-fdaaaaf881f7") : secret "dns-default-metrics-tls" not found Jun 09 07:58:59.630132 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:59.629789 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:58:59.630132 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:59.629879 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755c65d86-vbvsk: secret "image-registry-tls" not found Jun 09 07:58:59.630132 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:58:59.629908 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls podName:25706869-edda-4203-9bde-a4504938b478 nodeName:}" failed. No retries permitted until 2026-06-09 07:59:31.629901178 +0000 UTC m=+99.299747170 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls") pod "image-registry-755c65d86-vbvsk" (UID: "25706869-edda-4203-9bde-a4504938b478") : secret "image-registry-tls" not found Jun 09 07:59:03.139567 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:03.139531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dvrfx" event={"ID":"1133942a-7dac-4e81-a19d-9428ae64bd36","Type":"ContainerStarted","Data":"7847f0da7e45f69480b6bdc7633ecd71e3b53f6c6af6b18ef0986ba601548a9c"} Jun 09 07:59:03.140059 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:03.139663 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 07:59:03.141083 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:03.141061 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5smvf" event={"ID":"9674b1fa-6e16-4821-b450-05f74c391b47","Type":"ContainerStarted","Data":"4ba943ed2e1be115d30fe7004a659ed5958a49364d423f26a6868c658a2c77b2"} Jun 09 07:59:03.160789 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:03.160747 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dvrfx" podStartSLOduration=65.748797558 podStartE2EDuration="1m10.160734605s" totalImagesPullingTime="4.411937047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:59:03.159291434 +0000 UTC m=+70.829137475" watchObservedRunningTime="2026-06-09 07:59:03.160734605 +0000 UTC m=+70.830580616" Jun 09 07:59:03.178134 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:03.178094 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5smvf" podStartSLOduration=65.555162584 podStartE2EDuration="1m10.178080654s" totalImagesPullingTime="4.62291807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 07:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:59:03.177154057 +0000 UTC m=+70.847000069" watchObservedRunningTime="2026-06-09 07:59:03.178080654 +0000 UTC m=+70.847926669" Jun 09 07:59:04.397009 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.396969 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7"] Jun 09 07:59:04.398713 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.398697 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7" Jun 09 07:59:04.401347 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.401318 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 07:59:04.401475 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.401320 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 07:59:04.401475 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.401330 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 07:59:04.402379 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.402361 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-d7knw\"" Jun 09 07:59:04.402484 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.402389 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 07:59:04.407444 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.407425 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7"] Jun 09 07:59:04.465677 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.465641 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-266vx\" (UniqueName: \"kubernetes.io/projected/82b8a0c6-ac2e-4243-b765-4d3f7bf79aac-kube-api-access-266vx\") pod \"managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7\" (UID: \"82b8a0c6-ac2e-4243-b765-4d3f7bf79aac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7" Jun 09 07:59:04.465846 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.465726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/82b8a0c6-ac2e-4243-b765-4d3f7bf79aac-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7\" (UID: \"82b8a0c6-ac2e-4243-b765-4d3f7bf79aac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7" Jun 09 07:59:04.566901 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.566873 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-266vx\" (UniqueName: \"kubernetes.io/projected/82b8a0c6-ac2e-4243-b765-4d3f7bf79aac-kube-api-access-266vx\") pod \"managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7\" (UID: \"82b8a0c6-ac2e-4243-b765-4d3f7bf79aac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7" Jun 09 07:59:04.567011 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.566966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/82b8a0c6-ac2e-4243-b765-4d3f7bf79aac-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7\" (UID: \"82b8a0c6-ac2e-4243-b765-4d3f7bf79aac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7" Jun 09 07:59:04.569397 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.569366 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/82b8a0c6-ac2e-4243-b765-4d3f7bf79aac-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7\" (UID: \"82b8a0c6-ac2e-4243-b765-4d3f7bf79aac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7" Jun 09 07:59:04.575079 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.575052 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-266vx\" (UniqueName: \"kubernetes.io/projected/82b8a0c6-ac2e-4243-b765-4d3f7bf79aac-kube-api-access-266vx\") pod \"managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7\" (UID: \"82b8a0c6-ac2e-4243-b765-4d3f7bf79aac\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7" Jun 09 07:59:04.722475 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.722444 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7" Jun 09 07:59:04.841887 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:04.841861 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7"] Jun 09 07:59:04.847472 ip-10-0-139-124 kubenswrapper[2577]: W0609 07:59:04.847443 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82b8a0c6_ac2e_4243_b765_4d3f7bf79aac.slice/crio-816c57e590e21f6bea8a961a6f9f7329224e0247f8b9326d2ca504dfb8f8c30d WatchSource:0}: Error finding container 816c57e590e21f6bea8a961a6f9f7329224e0247f8b9326d2ca504dfb8f8c30d: Status 404 returned error can't find the container with id 816c57e590e21f6bea8a961a6f9f7329224e0247f8b9326d2ca504dfb8f8c30d Jun 09 07:59:05.146629 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:05.146548 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7" event={"ID":"82b8a0c6-ac2e-4243-b765-4d3f7bf79aac","Type":"ContainerStarted","Data":"816c57e590e21f6bea8a961a6f9f7329224e0247f8b9326d2ca504dfb8f8c30d"} Jun 09 07:59:08.156187 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:08.156152 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7" event={"ID":"82b8a0c6-ac2e-4243-b765-4d3f7bf79aac","Type":"ContainerStarted","Data":"f99fc4c84ba4b9e73bd62e38bf1ad90cba187958cf46c7380b1205096071cf10"} Jun 09 07:59:08.178496 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:08.178447 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7" podStartSLOduration=1.410097618 podStartE2EDuration="4.178432879s" totalImagesPullingTime="2.768335261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 07:59:08.177402401 +0000 UTC m=+75.847248416" watchObservedRunningTime="2026-06-09 07:59:08.178432879 +0000 UTC m=+75.848278951" Jun 09 07:59:31.654679 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:31.654584 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 07:59:31.654679 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:31.654655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 07:59:31.655177 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:59:31.654734 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 07:59:31.655177 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:59:31.654774 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 07:59:31.655177 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:59:31.654789 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755c65d86-vbvsk: secret "image-registry-tls" not found Jun 09 07:59:31.655177 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:59:31.654809 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls podName:5822a48b-2f65-4848-9f7e-fdaaaaf881f7 nodeName:}" failed. No retries permitted until 2026-06-09 08:00:35.654792142 +0000 UTC m=+163.324638135 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls") pod "dns-default-jtkj4" (UID: "5822a48b-2f65-4848-9f7e-fdaaaaf881f7") : secret "dns-default-metrics-tls" not found Jun 09 07:59:31.655177 ip-10-0-139-124 kubenswrapper[2577]: E0609 07:59:31.654842 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls podName:25706869-edda-4203-9bde-a4504938b478 nodeName:}" failed. No retries permitted until 2026-06-09 08:00:35.654827228 +0000 UTC m=+163.324673234 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls") pod "image-registry-755c65d86-vbvsk" (UID: "25706869-edda-4203-9bde-a4504938b478") : secret "image-registry-tls" not found Jun 09 07:59:34.146260 ip-10-0-139-124 kubenswrapper[2577]: I0609 07:59:34.146229 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dvrfx" Jun 09 08:00:01.561290 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:00:01.561240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 08:00:01.561800 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:00:01.561396 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 08:00:01.561800 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:00:01.561473 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs podName:2cc82d46-ff16-4d56-a54a-4d8283ab6d5a nodeName:}" failed. No retries permitted until 2026-06-09 08:02:03.561457359 +0000 UTC m=+251.231303352 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs") pod "network-metrics-daemon-fpbq7" (UID: "2cc82d46-ff16-4d56-a54a-4d8283ab6d5a") : secret "metrics-daemon-secret" not found Jun 09 08:00:30.762351 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:00:30.762295 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" podUID="25706869-edda-4203-9bde-a4504938b478" Jun 09 08:00:30.800713 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:00:30.800677 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 08:00:30.817861 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:00:30.817829 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jtkj4" podUID="5822a48b-2f65-4848-9f7e-fdaaaaf881f7" Jun 09 08:00:31.350804 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:00:31.350778 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtkj4" Jun 09 08:00:31.350954 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:00:31.350778 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 08:00:35.700407 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:00:35.700364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 08:00:35.700967 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:00:35.700451 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 08:00:35.700967 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:00:35.700507 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 08:00:35.700967 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:00:35.700570 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 08:00:35.700967 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:00:35.700588 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755c65d86-vbvsk: secret "image-registry-tls" not found Jun 09 08:00:35.700967 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:00:35.700593 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls podName:5822a48b-2f65-4848-9f7e-fdaaaaf881f7 nodeName:}" failed. No retries permitted until 2026-06-09 08:02:37.700576519 +0000 UTC m=+285.370422516 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls") pod "dns-default-jtkj4" (UID: "5822a48b-2f65-4848-9f7e-fdaaaaf881f7") : secret "dns-default-metrics-tls" not found Jun 09 08:00:35.700967 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:00:35.700639 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls podName:25706869-edda-4203-9bde-a4504938b478 nodeName:}" failed. No retries permitted until 2026-06-09 08:02:37.700625964 +0000 UTC m=+285.370471969 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls") pod "image-registry-755c65d86-vbvsk" (UID: "25706869-edda-4203-9bde-a4504938b478") : secret "image-registry-tls" not found Jun 09 08:00:44.785384 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:00:44.785292 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 08:01:08.437397 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:08.437363 2577 generic.go:356] "Generic (PLEG): container finished" podID="82b8a0c6-ac2e-4243-b765-4d3f7bf79aac" containerID="f99fc4c84ba4b9e73bd62e38bf1ad90cba187958cf46c7380b1205096071cf10" exitCode=255 Jun 09 08:01:08.437771 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:08.437404 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7" event={"ID":"82b8a0c6-ac2e-4243-b765-4d3f7bf79aac","Type":"ContainerDied","Data":"f99fc4c84ba4b9e73bd62e38bf1ad90cba187958cf46c7380b1205096071cf10"} Jun 09 08:01:08.442710 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:08.442689 2577 scope.go:117] "RemoveContainer" containerID="f99fc4c84ba4b9e73bd62e38bf1ad90cba187958cf46c7380b1205096071cf10" Jun 09 08:01:09.441283 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:09.441249 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84b4fd8bcd-kdmx7" event={"ID":"82b8a0c6-ac2e-4243-b765-4d3f7bf79aac","Type":"ContainerStarted","Data":"d203ed92bac63d04acb847006777e6f809e148a08d7fb1a9d06cd759be84e18e"} Jun 09 08:01:54.211909 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.211875 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-x84lc"] Jun 09 08:01:54.214840 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.214821 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.217505 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.217484 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 08:01:54.217676 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.217658 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 08:01:54.217988 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.217973 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 08:01:54.218783 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.218764 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 08:01:54.218867 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.218783 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8vvhs\"" Jun 09 08:01:54.223876 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.223853 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 08:01:54.232800 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.232777 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-x84lc"] Jun 09 08:01:54.300995 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.300962 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8"] Jun 09 08:01:54.303917 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.303901 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-bp56k"] Jun 09 08:01:54.304042 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.304027 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" Jun 09 08:01:54.306483 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.306461 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 08:01:54.306663 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.306645 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 08:01:54.306731 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.306713 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rbcph\"" Jun 09 08:01:54.306977 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.306956 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 08:01:54.307048 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.307033 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:01:54.307092 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.307061 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 08:01:54.309443 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.309425 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 08:01:54.309608 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.309590 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 08:01:54.309701 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.309630 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 08:01:54.309701 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.309682 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 08:01:54.309820 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.309735 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pp5d7\"" Jun 09 08:01:54.314589 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.314574 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 08:01:54.319562 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.319544 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8"] Jun 09 08:01:54.322360 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.322338 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-bp56k"] Jun 09 08:01:54.331781 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.331763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f660d9-a165-4477-9110-10608939625b-trusted-ca-bundle\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.331871 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.331805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/13f660d9-a165-4477-9110-10608939625b-snapshots\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.331871 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.331830 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13f660d9-a165-4477-9110-10608939625b-tmp\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.331871 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.331863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdtmb\" (UniqueName: \"kubernetes.io/projected/13f660d9-a165-4477-9110-10608939625b-kube-api-access-cdtmb\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.332006 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.331966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13f660d9-a165-4477-9110-10608939625b-serving-cert\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.332006 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.331989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f660d9-a165-4477-9110-10608939625b-service-ca-bundle\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.432785 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.432743 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be1b591a-a82d-44a8-a26d-a01e439851c2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xmzf8\" (UID: \"be1b591a-a82d-44a8-a26d-a01e439851c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" Jun 09 08:01:54.432962 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.432810 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c531d4b-fba1-4fb5-8be5-26442f258c5e-trusted-ca\") pod \"console-operator-668fdbf85c-bp56k\" (UID: \"7c531d4b-fba1-4fb5-8be5-26442f258c5e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:01:54.432962 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.432848 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be1b591a-a82d-44a8-a26d-a01e439851c2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xmzf8\" (UID: \"be1b591a-a82d-44a8-a26d-a01e439851c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" Jun 09 08:01:54.432962 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.432916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c531d4b-fba1-4fb5-8be5-26442f258c5e-config\") pod \"console-operator-668fdbf85c-bp56k\" (UID: \"7c531d4b-fba1-4fb5-8be5-26442f258c5e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:01:54.433086 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.432965 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f660d9-a165-4477-9110-10608939625b-service-ca-bundle\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.433086 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.433016 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhhs4\" (UniqueName: \"kubernetes.io/projected/7c531d4b-fba1-4fb5-8be5-26442f258c5e-kube-api-access-jhhs4\") pod \"console-operator-668fdbf85c-bp56k\" (UID: \"7c531d4b-fba1-4fb5-8be5-26442f258c5e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:01:54.433086 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.433068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f660d9-a165-4477-9110-10608939625b-trusted-ca-bundle\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.433178 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.433102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c531d4b-fba1-4fb5-8be5-26442f258c5e-serving-cert\") pod \"console-operator-668fdbf85c-bp56k\" (UID: \"7c531d4b-fba1-4fb5-8be5-26442f258c5e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:01:54.433178 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.433159 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/13f660d9-a165-4477-9110-10608939625b-snapshots\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.433253 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.433194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf62l\" (UniqueName: \"kubernetes.io/projected/be1b591a-a82d-44a8-a26d-a01e439851c2-kube-api-access-qf62l\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xmzf8\" (UID: \"be1b591a-a82d-44a8-a26d-a01e439851c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" Jun 09 08:01:54.433253 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.433223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13f660d9-a165-4477-9110-10608939625b-tmp\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.433326 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.433267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdtmb\" (UniqueName: \"kubernetes.io/projected/13f660d9-a165-4477-9110-10608939625b-kube-api-access-cdtmb\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.433326 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.433311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13f660d9-a165-4477-9110-10608939625b-serving-cert\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.436313 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.433894 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f660d9-a165-4477-9110-10608939625b-service-ca-bundle\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.436313 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.434069 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/13f660d9-a165-4477-9110-10608939625b-snapshots\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.436313 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.434127 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13f660d9-a165-4477-9110-10608939625b-tmp\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.436313 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.434329 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f660d9-a165-4477-9110-10608939625b-trusted-ca-bundle\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.436637 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.436608 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13f660d9-a165-4477-9110-10608939625b-serving-cert\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.442096 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.442065 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdtmb\" (UniqueName: \"kubernetes.io/projected/13f660d9-a165-4477-9110-10608939625b-kube-api-access-cdtmb\") pod \"insights-operator-896549976-x84lc\" (UID: \"13f660d9-a165-4477-9110-10608939625b\") " pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.524172 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.524100 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-x84lc" Jun 09 08:01:54.534053 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.534029 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be1b591a-a82d-44a8-a26d-a01e439851c2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xmzf8\" (UID: \"be1b591a-a82d-44a8-a26d-a01e439851c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" Jun 09 08:01:54.534168 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.534118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c531d4b-fba1-4fb5-8be5-26442f258c5e-trusted-ca\") pod \"console-operator-668fdbf85c-bp56k\" (UID: \"7c531d4b-fba1-4fb5-8be5-26442f258c5e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:01:54.534168 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.534145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be1b591a-a82d-44a8-a26d-a01e439851c2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xmzf8\" (UID: \"be1b591a-a82d-44a8-a26d-a01e439851c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" Jun 09 08:01:54.534288 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.534176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c531d4b-fba1-4fb5-8be5-26442f258c5e-config\") pod \"console-operator-668fdbf85c-bp56k\" (UID: \"7c531d4b-fba1-4fb5-8be5-26442f258c5e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:01:54.534288 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.534199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhhs4\" (UniqueName: \"kubernetes.io/projected/7c531d4b-fba1-4fb5-8be5-26442f258c5e-kube-api-access-jhhs4\") pod \"console-operator-668fdbf85c-bp56k\" (UID: \"7c531d4b-fba1-4fb5-8be5-26442f258c5e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:01:54.534396 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.534326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c531d4b-fba1-4fb5-8be5-26442f258c5e-serving-cert\") pod \"console-operator-668fdbf85c-bp56k\" (UID: \"7c531d4b-fba1-4fb5-8be5-26442f258c5e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:01:54.534396 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.534362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf62l\" (UniqueName: \"kubernetes.io/projected/be1b591a-a82d-44a8-a26d-a01e439851c2-kube-api-access-qf62l\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xmzf8\" (UID: \"be1b591a-a82d-44a8-a26d-a01e439851c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" Jun 09 08:01:54.535021 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.534995 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c531d4b-fba1-4fb5-8be5-26442f258c5e-config\") pod \"console-operator-668fdbf85c-bp56k\" (UID: \"7c531d4b-fba1-4fb5-8be5-26442f258c5e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:01:54.535206 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.535184 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7c531d4b-fba1-4fb5-8be5-26442f258c5e-trusted-ca\") pod \"console-operator-668fdbf85c-bp56k\" (UID: \"7c531d4b-fba1-4fb5-8be5-26442f258c5e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:01:54.535358 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.535333 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/be1b591a-a82d-44a8-a26d-a01e439851c2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xmzf8\" (UID: \"be1b591a-a82d-44a8-a26d-a01e439851c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" Jun 09 08:01:54.536531 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.536509 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be1b591a-a82d-44a8-a26d-a01e439851c2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xmzf8\" (UID: \"be1b591a-a82d-44a8-a26d-a01e439851c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" Jun 09 08:01:54.536734 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.536718 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c531d4b-fba1-4fb5-8be5-26442f258c5e-serving-cert\") pod \"console-operator-668fdbf85c-bp56k\" (UID: \"7c531d4b-fba1-4fb5-8be5-26442f258c5e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:01:54.544595 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.544574 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf62l\" (UniqueName: \"kubernetes.io/projected/be1b591a-a82d-44a8-a26d-a01e439851c2-kube-api-access-qf62l\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-xmzf8\" (UID: \"be1b591a-a82d-44a8-a26d-a01e439851c2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" Jun 09 08:01:54.544715 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.544674 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhhs4\" (UniqueName: \"kubernetes.io/projected/7c531d4b-fba1-4fb5-8be5-26442f258c5e-kube-api-access-jhhs4\") pod \"console-operator-668fdbf85c-bp56k\" (UID: \"7c531d4b-fba1-4fb5-8be5-26442f258c5e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:01:54.613185 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.613155 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" Jun 09 08:01:54.619225 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.619200 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:01:54.651510 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.651411 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-x84lc"] Jun 09 08:01:54.655013 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:01:54.654986 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f660d9_a165_4477_9110_10608939625b.slice/crio-cc6dc26aee019f93b7f1d9c7cbed4061fe9c055eca2c7fbd7a0e9c9f65122131 WatchSource:0}: Error finding container cc6dc26aee019f93b7f1d9c7cbed4061fe9c055eca2c7fbd7a0e9c9f65122131: Status 404 returned error can't find the container with id cc6dc26aee019f93b7f1d9c7cbed4061fe9c055eca2c7fbd7a0e9c9f65122131 Jun 09 08:01:54.740694 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.740666 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8"] Jun 09 08:01:54.743487 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:01:54.743465 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe1b591a_a82d_44a8_a26d_a01e439851c2.slice/crio-88b96d5e9a6b7f4dcac52dd11edc0162a8cdc6e5f43b4e0ce9e526c0e48e331d WatchSource:0}: Error finding container 88b96d5e9a6b7f4dcac52dd11edc0162a8cdc6e5f43b4e0ce9e526c0e48e331d: Status 404 returned error can't find the container with id 88b96d5e9a6b7f4dcac52dd11edc0162a8cdc6e5f43b4e0ce9e526c0e48e331d Jun 09 08:01:54.758258 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:54.758229 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-bp56k"] Jun 09 08:01:54.761614 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:01:54.761589 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c531d4b_fba1_4fb5_8be5_26442f258c5e.slice/crio-ab9ca2c5cf6aee4f1b3ae8b043b7322462bc21df70c2a1e7130c4c5537fa22bf WatchSource:0}: Error finding container ab9ca2c5cf6aee4f1b3ae8b043b7322462bc21df70c2a1e7130c4c5537fa22bf: Status 404 returned error can't find the container with id ab9ca2c5cf6aee4f1b3ae8b043b7322462bc21df70c2a1e7130c4c5537fa22bf Jun 09 08:01:55.552455 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:55.552371 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-x84lc" event={"ID":"13f660d9-a165-4477-9110-10608939625b","Type":"ContainerStarted","Data":"cc6dc26aee019f93b7f1d9c7cbed4061fe9c055eca2c7fbd7a0e9c9f65122131"} Jun 09 08:01:55.554093 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:55.554064 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" event={"ID":"7c531d4b-fba1-4fb5-8be5-26442f258c5e","Type":"ContainerStarted","Data":"ab9ca2c5cf6aee4f1b3ae8b043b7322462bc21df70c2a1e7130c4c5537fa22bf"} Jun 09 08:01:55.555541 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:55.555482 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" event={"ID":"be1b591a-a82d-44a8-a26d-a01e439851c2","Type":"ContainerStarted","Data":"88b96d5e9a6b7f4dcac52dd11edc0162a8cdc6e5f43b4e0ce9e526c0e48e331d"} Jun 09 08:01:58.566550 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:58.566450 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" event={"ID":"be1b591a-a82d-44a8-a26d-a01e439851c2","Type":"ContainerStarted","Data":"13203ff3f98a2da2ad90ed426cac42dd8a8799bfe15c2d67c30c9679b1bee9b5"} Jun 09 08:01:58.568402 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:58.568368 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-x84lc" event={"ID":"13f660d9-a165-4477-9110-10608939625b","Type":"ContainerStarted","Data":"57699a84127850760dc7cf31a656d75e34895882b26c3c20ce78b5864b9c372e"} Jun 09 08:01:58.569845 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:58.569828 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/0.log" Jun 09 08:01:58.569974 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:58.569863 2577 generic.go:356] "Generic (PLEG): container finished" podID="7c531d4b-fba1-4fb5-8be5-26442f258c5e" containerID="8198e6474e256c8d5a2ed5f1f29d9ccb01cb7126b843e66d7df9c019862bfd02" exitCode=255 Jun 09 08:01:58.569974 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:58.569891 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" event={"ID":"7c531d4b-fba1-4fb5-8be5-26442f258c5e","Type":"ContainerDied","Data":"8198e6474e256c8d5a2ed5f1f29d9ccb01cb7126b843e66d7df9c019862bfd02"} Jun 09 08:01:58.570170 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:58.570153 2577 scope.go:117] "RemoveContainer" containerID="8198e6474e256c8d5a2ed5f1f29d9ccb01cb7126b843e66d7df9c019862bfd02" Jun 09 08:01:58.584290 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:58.584245 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" podStartSLOduration=1.069058462 podStartE2EDuration="4.584227583s" totalImagesPullingTime="3.515169121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:01:58.582170667 +0000 UTC m=+246.252016683" watchObservedRunningTime="2026-06-09 08:01:58.584227583 +0000 UTC m=+246.254073584" Jun 09 08:01:58.598200 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:58.598147 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-x84lc" podStartSLOduration=0.998466999 podStartE2EDuration="4.598127107s" totalImagesPullingTime="3.599660108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:01:58.597114456 +0000 UTC m=+246.266960484" watchObservedRunningTime="2026-06-09 08:01:58.598127107 +0000 UTC m=+246.267973127" Jun 09 08:01:59.574735 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:59.574661 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/1.log" Jun 09 08:01:59.575142 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:59.575064 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/0.log" Jun 09 08:01:59.575142 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:59.575097 2577 generic.go:356] "Generic (PLEG): container finished" podID="7c531d4b-fba1-4fb5-8be5-26442f258c5e" containerID="6fbb709af4fd9cc8529f85b7d0c38ae40de9aaf857857913f4e74fe7b282bffd" exitCode=255 Jun 09 08:01:59.575237 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:59.575167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" event={"ID":"7c531d4b-fba1-4fb5-8be5-26442f258c5e","Type":"ContainerDied","Data":"6fbb709af4fd9cc8529f85b7d0c38ae40de9aaf857857913f4e74fe7b282bffd"} Jun 09 08:01:59.575237 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:59.575225 2577 scope.go:117] "RemoveContainer" containerID="8198e6474e256c8d5a2ed5f1f29d9ccb01cb7126b843e66d7df9c019862bfd02" Jun 09 08:01:59.575390 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:01:59.575369 2577 scope.go:117] "RemoveContainer" containerID="6fbb709af4fd9cc8529f85b7d0c38ae40de9aaf857857913f4e74fe7b282bffd" Jun 09 08:01:59.575580 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:01:59.575553 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-bp56k_openshift-console-operator(7c531d4b-fba1-4fb5-8be5-26442f258c5e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" podUID="7c531d4b-fba1-4fb5-8be5-26442f258c5e" Jun 09 08:02:00.579776 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:00.579750 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/1.log" Jun 09 08:02:00.580231 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:00.580132 2577 scope.go:117] "RemoveContainer" containerID="6fbb709af4fd9cc8529f85b7d0c38ae40de9aaf857857913f4e74fe7b282bffd" Jun 09 08:02:00.580325 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:00.580304 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-bp56k_openshift-console-operator(7c531d4b-fba1-4fb5-8be5-26442f258c5e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" podUID="7c531d4b-fba1-4fb5-8be5-26442f258c5e" Jun 09 08:02:02.171298 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:02.171271 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-psxf9_fee7c818-f667-4a20-8e2d-8d42ca5fa868/dns-node-resolver/0.log" Jun 09 08:02:03.371658 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:03.371634 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5gcm_5259c534-0a4b-4145-a3c9-18db9b83a062/node-ca/0.log" Jun 09 08:02:03.607260 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:03.607216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 08:02:03.607429 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:03.607362 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 08:02:03.607475 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:03.607441 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs podName:2cc82d46-ff16-4d56-a54a-4d8283ab6d5a nodeName:}" failed. No retries permitted until 2026-06-09 08:04:05.607417521 +0000 UTC m=+373.277263518 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs") pod "network-metrics-daemon-fpbq7" (UID: "2cc82d46-ff16-4d56-a54a-4d8283ab6d5a") : secret "metrics-daemon-secret" not found Jun 09 08:02:04.171197 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:04.171166 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-llcp2_3614ebbe-a959-4a99-8803-6da8f1585af5/serve-healthcheck-canary/0.log" Jun 09 08:02:04.619608 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:04.619522 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:02:04.619608 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:04.619579 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:02:04.620126 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:04.619992 2577 scope.go:117] "RemoveContainer" containerID="6fbb709af4fd9cc8529f85b7d0c38ae40de9aaf857857913f4e74fe7b282bffd" Jun 09 08:02:04.620213 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:04.620186 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-bp56k_openshift-console-operator(7c531d4b-fba1-4fb5-8be5-26442f258c5e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" podUID="7c531d4b-fba1-4fb5-8be5-26442f258c5e" Jun 09 08:02:04.772010 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:04.771966 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-xmzf8_be1b591a-a82d-44a8-a26d-a01e439851c2/kube-storage-version-migrator-operator/0.log" Jun 09 08:02:15.785329 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:15.785250 2577 scope.go:117] "RemoveContainer" containerID="6fbb709af4fd9cc8529f85b7d0c38ae40de9aaf857857913f4e74fe7b282bffd" Jun 09 08:02:16.625463 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:16.625435 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/2.log" Jun 09 08:02:16.625853 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:16.625837 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/1.log" Jun 09 08:02:16.625898 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:16.625873 2577 generic.go:356] "Generic (PLEG): container finished" podID="7c531d4b-fba1-4fb5-8be5-26442f258c5e" containerID="cc0f6a8a4a5d04b087de2e39bbdc2341425fa37eafc6737adb9416bb44ec138e" exitCode=255 Jun 09 08:02:16.625948 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:16.625906 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" event={"ID":"7c531d4b-fba1-4fb5-8be5-26442f258c5e","Type":"ContainerDied","Data":"cc0f6a8a4a5d04b087de2e39bbdc2341425fa37eafc6737adb9416bb44ec138e"} Jun 09 08:02:16.625986 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:16.625968 2577 scope.go:117] "RemoveContainer" containerID="6fbb709af4fd9cc8529f85b7d0c38ae40de9aaf857857913f4e74fe7b282bffd" Jun 09 08:02:16.626259 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:16.626240 2577 scope.go:117] "RemoveContainer" containerID="cc0f6a8a4a5d04b087de2e39bbdc2341425fa37eafc6737adb9416bb44ec138e" Jun 09 08:02:16.626412 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:16.626395 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-bp56k_openshift-console-operator(7c531d4b-fba1-4fb5-8be5-26442f258c5e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" podUID="7c531d4b-fba1-4fb5-8be5-26442f258c5e" Jun 09 08:02:17.630168 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:17.630138 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/2.log" Jun 09 08:02:24.619608 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:24.619572 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:02:24.620147 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:24.619636 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:02:24.620147 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:24.620028 2577 scope.go:117] "RemoveContainer" containerID="cc0f6a8a4a5d04b087de2e39bbdc2341425fa37eafc6737adb9416bb44ec138e" Jun 09 08:02:24.620260 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:24.620233 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-bp56k_openshift-console-operator(7c531d4b-fba1-4fb5-8be5-26442f258c5e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" podUID="7c531d4b-fba1-4fb5-8be5-26442f258c5e" Jun 09 08:02:25.653784 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.653752 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tts9n"] Jun 09 08:02:25.658224 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.658205 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.660759 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.660740 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8gl6z\"" Jun 09 08:02:25.662021 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.661998 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 08:02:25.662112 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.662005 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 08:02:25.669226 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.669207 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tts9n"] Jun 09 08:02:25.672661 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.672638 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jdc7\" (UniqueName: \"kubernetes.io/projected/50f566f7-c877-4f61-b441-792e7b335676-kube-api-access-5jdc7\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.672763 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.672688 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50f566f7-c877-4f61-b441-792e7b335676-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.672763 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.672717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/50f566f7-c877-4f61-b441-792e7b335676-crio-socket\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.672763 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.672745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/50f566f7-c877-4f61-b441-792e7b335676-data-volume\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.672878 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.672767 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50f566f7-c877-4f61-b441-792e7b335676-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.773251 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.773216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jdc7\" (UniqueName: \"kubernetes.io/projected/50f566f7-c877-4f61-b441-792e7b335676-kube-api-access-5jdc7\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.773251 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.773256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50f566f7-c877-4f61-b441-792e7b335676-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.773468 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.773272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/50f566f7-c877-4f61-b441-792e7b335676-crio-socket\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.773468 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.773292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/50f566f7-c877-4f61-b441-792e7b335676-data-volume\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.773468 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.773311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50f566f7-c877-4f61-b441-792e7b335676-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.773468 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.773368 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/50f566f7-c877-4f61-b441-792e7b335676-crio-socket\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.773766 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.773737 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/50f566f7-c877-4f61-b441-792e7b335676-data-volume\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.774016 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.773999 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50f566f7-c877-4f61-b441-792e7b335676-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.775528 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.775502 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50f566f7-c877-4f61-b441-792e7b335676-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.793327 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.793309 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jdc7\" (UniqueName: \"kubernetes.io/projected/50f566f7-c877-4f61-b441-792e7b335676-kube-api-access-5jdc7\") pod \"insights-runtime-extractor-tts9n\" (UID: \"50f566f7-c877-4f61-b441-792e7b335676\") " pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:25.967077 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:25.967038 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tts9n" Jun 09 08:02:26.088006 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:26.087982 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tts9n"] Jun 09 08:02:26.091306 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:02:26.091232 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f566f7_c877_4f61_b441_792e7b335676.slice/crio-140be3c56776f0bfa72770265ba31f85fbc80dd52cabb6d2f7fa104a19691481 WatchSource:0}: Error finding container 140be3c56776f0bfa72770265ba31f85fbc80dd52cabb6d2f7fa104a19691481: Status 404 returned error can't find the container with id 140be3c56776f0bfa72770265ba31f85fbc80dd52cabb6d2f7fa104a19691481 Jun 09 08:02:26.658397 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:26.658360 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tts9n" event={"ID":"50f566f7-c877-4f61-b441-792e7b335676","Type":"ContainerStarted","Data":"b226ef84845fdd55c88f70a7bb0ba300d0a85084140405544ec2568032a369b3"} Jun 09 08:02:26.658748 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:26.658420 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tts9n" event={"ID":"50f566f7-c877-4f61-b441-792e7b335676","Type":"ContainerStarted","Data":"140be3c56776f0bfa72770265ba31f85fbc80dd52cabb6d2f7fa104a19691481"} Jun 09 08:02:27.664292 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:27.664256 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tts9n" event={"ID":"50f566f7-c877-4f61-b441-792e7b335676","Type":"ContainerStarted","Data":"938414e67ebfe3691a2af5f8829336f53db6bafd1ee8d4ed9ff9d9449780aabc"} Jun 09 08:02:28.669332 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:28.669286 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tts9n" event={"ID":"50f566f7-c877-4f61-b441-792e7b335676","Type":"ContainerStarted","Data":"d890bf9d4b9f5ad62bb79bd46f7a9739356abd36726ad7158bdee66402d93887"} Jun 09 08:02:28.689917 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:28.689871 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tts9n" podStartSLOduration=1.406336703 podStartE2EDuration="3.6898582s" totalImagesPullingTime="2.283521497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:02:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:02:28.688798209 +0000 UTC m=+276.358644225" watchObservedRunningTime="2026-06-09 08:02:28.6898582 +0000 UTC m=+276.359704216" Jun 09 08:02:29.581380 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:29.581329 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gq49l"] Jun 09 08:02:29.584530 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:29.584514 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gq49l" Jun 09 08:02:29.588603 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:29.588576 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tjcxt\"" Jun 09 08:02:29.588744 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:29.588694 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 08:02:29.594248 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:29.594227 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gq49l"] Jun 09 08:02:29.604505 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:29.604477 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/996df65c-a59f-49b8-ad35-ae9876339bcf-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gq49l\" (UID: \"996df65c-a59f-49b8-ad35-ae9876339bcf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gq49l" Jun 09 08:02:29.705291 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:29.705251 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/996df65c-a59f-49b8-ad35-ae9876339bcf-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gq49l\" (UID: \"996df65c-a59f-49b8-ad35-ae9876339bcf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gq49l" Jun 09 08:02:29.705687 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:29.705349 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 09 08:02:29.705687 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:29.705405 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/996df65c-a59f-49b8-ad35-ae9876339bcf-tls-certificates podName:996df65c-a59f-49b8-ad35-ae9876339bcf nodeName:}" failed. No retries permitted until 2026-06-09 08:02:30.205386614 +0000 UTC m=+277.875232608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/996df65c-a59f-49b8-ad35-ae9876339bcf-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-gq49l" (UID: "996df65c-a59f-49b8-ad35-ae9876339bcf") : secret "prometheus-operator-admission-webhook-tls" not found Jun 09 08:02:30.210515 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:30.210485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/996df65c-a59f-49b8-ad35-ae9876339bcf-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gq49l\" (UID: \"996df65c-a59f-49b8-ad35-ae9876339bcf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gq49l" Jun 09 08:02:30.212774 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:30.212747 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/996df65c-a59f-49b8-ad35-ae9876339bcf-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gq49l\" (UID: \"996df65c-a59f-49b8-ad35-ae9876339bcf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gq49l" Jun 09 08:02:30.492768 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:30.492686 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gq49l" Jun 09 08:02:30.616814 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:30.616779 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gq49l"] Jun 09 08:02:30.620440 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:02:30.620415 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod996df65c_a59f_49b8_ad35_ae9876339bcf.slice/crio-684d1990965f4aa69c72ce2dd936d30c0e8ec817a99ee84d12b04993515f05d0 WatchSource:0}: Error finding container 684d1990965f4aa69c72ce2dd936d30c0e8ec817a99ee84d12b04993515f05d0: Status 404 returned error can't find the container with id 684d1990965f4aa69c72ce2dd936d30c0e8ec817a99ee84d12b04993515f05d0 Jun 09 08:02:30.675726 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:30.675695 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gq49l" event={"ID":"996df65c-a59f-49b8-ad35-ae9876339bcf","Type":"ContainerStarted","Data":"684d1990965f4aa69c72ce2dd936d30c0e8ec817a99ee84d12b04993515f05d0"} Jun 09 08:02:32.683833 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:32.683797 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gq49l" event={"ID":"996df65c-a59f-49b8-ad35-ae9876339bcf","Type":"ContainerStarted","Data":"141e7881729aeeb5041257850c787dd7dabe249c7dc10861f7e3d2bdd3d3cd53"} Jun 09 08:02:32.684294 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:32.684016 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gq49l" Jun 09 08:02:32.688484 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:32.688459 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gq49l" Jun 09 08:02:32.703656 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:32.703619 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gq49l" podStartSLOduration=2.086698772 podStartE2EDuration="3.703607068s" totalImagesPullingTime="1.616908296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:02:32.703080143 +0000 UTC m=+280.372926159" watchObservedRunningTime="2026-06-09 08:02:32.703607068 +0000 UTC m=+280.373453117" Jun 09 08:02:33.644569 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.644527 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn"] Jun 09 08:02:33.646621 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.646600 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:33.649357 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.649329 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 08:02:33.649489 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.649369 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 08:02:33.649489 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.649384 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wm8r5\"" Jun 09 08:02:33.649489 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.649390 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 08:02:33.650523 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.650505 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 08:02:33.650839 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.650824 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 08:02:33.655041 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.655021 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn"] Jun 09 08:02:33.738440 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.738398 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/526e27b4-30dc-47f9-bfb2-0139f4974555-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-5zpqn\" (UID: \"526e27b4-30dc-47f9-bfb2-0139f4974555\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:33.738440 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.738439 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/526e27b4-30dc-47f9-bfb2-0139f4974555-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-5zpqn\" (UID: \"526e27b4-30dc-47f9-bfb2-0139f4974555\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:33.738866 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.738488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/526e27b4-30dc-47f9-bfb2-0139f4974555-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-5zpqn\" (UID: \"526e27b4-30dc-47f9-bfb2-0139f4974555\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:33.738866 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.738620 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m8gg\" (UniqueName: \"kubernetes.io/projected/526e27b4-30dc-47f9-bfb2-0139f4974555-kube-api-access-9m8gg\") pod \"prometheus-operator-7f7d445d84-5zpqn\" (UID: \"526e27b4-30dc-47f9-bfb2-0139f4974555\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:33.839536 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.839482 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8gg\" (UniqueName: \"kubernetes.io/projected/526e27b4-30dc-47f9-bfb2-0139f4974555-kube-api-access-9m8gg\") pod \"prometheus-operator-7f7d445d84-5zpqn\" (UID: \"526e27b4-30dc-47f9-bfb2-0139f4974555\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:33.839536 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.839540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/526e27b4-30dc-47f9-bfb2-0139f4974555-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-5zpqn\" (UID: \"526e27b4-30dc-47f9-bfb2-0139f4974555\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:33.839743 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.839567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/526e27b4-30dc-47f9-bfb2-0139f4974555-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-5zpqn\" (UID: \"526e27b4-30dc-47f9-bfb2-0139f4974555\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:33.839743 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:33.839637 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 09 08:02:33.839743 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:33.839695 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/526e27b4-30dc-47f9-bfb2-0139f4974555-prometheus-operator-tls podName:526e27b4-30dc-47f9-bfb2-0139f4974555 nodeName:}" failed. No retries permitted until 2026-06-09 08:02:34.339679531 +0000 UTC m=+282.009525524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/526e27b4-30dc-47f9-bfb2-0139f4974555-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-5zpqn" (UID: "526e27b4-30dc-47f9-bfb2-0139f4974555") : secret "prometheus-operator-tls" not found Jun 09 08:02:33.839743 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.839688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/526e27b4-30dc-47f9-bfb2-0139f4974555-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-5zpqn\" (UID: \"526e27b4-30dc-47f9-bfb2-0139f4974555\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:33.840337 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.840314 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/526e27b4-30dc-47f9-bfb2-0139f4974555-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-5zpqn\" (UID: \"526e27b4-30dc-47f9-bfb2-0139f4974555\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:33.841875 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.841856 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/526e27b4-30dc-47f9-bfb2-0139f4974555-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-5zpqn\" (UID: \"526e27b4-30dc-47f9-bfb2-0139f4974555\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:33.848800 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:33.848780 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m8gg\" (UniqueName: \"kubernetes.io/projected/526e27b4-30dc-47f9-bfb2-0139f4974555-kube-api-access-9m8gg\") pod \"prometheus-operator-7f7d445d84-5zpqn\" (UID: \"526e27b4-30dc-47f9-bfb2-0139f4974555\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:34.344888 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:34.344835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/526e27b4-30dc-47f9-bfb2-0139f4974555-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-5zpqn\" (UID: \"526e27b4-30dc-47f9-bfb2-0139f4974555\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:34.345087 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:34.345005 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 09 08:02:34.345087 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:34.345086 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/526e27b4-30dc-47f9-bfb2-0139f4974555-prometheus-operator-tls podName:526e27b4-30dc-47f9-bfb2-0139f4974555 nodeName:}" failed. No retries permitted until 2026-06-09 08:02:35.345070248 +0000 UTC m=+283.014916245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/526e27b4-30dc-47f9-bfb2-0139f4974555-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-5zpqn" (UID: "526e27b4-30dc-47f9-bfb2-0139f4974555") : secret "prometheus-operator-tls" not found Jun 09 08:02:34.351902 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:34.351866 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" podUID="25706869-edda-4203-9bde-a4504938b478" Jun 09 08:02:34.352018 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:34.351866 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jtkj4" podUID="5822a48b-2f65-4848-9f7e-fdaaaaf881f7" Jun 09 08:02:34.689600 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:34.689566 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 08:02:34.689600 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:34.689566 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtkj4" Jun 09 08:02:35.354754 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:35.354705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/526e27b4-30dc-47f9-bfb2-0139f4974555-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-5zpqn\" (UID: \"526e27b4-30dc-47f9-bfb2-0139f4974555\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:35.357125 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:35.357106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/526e27b4-30dc-47f9-bfb2-0139f4974555-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-5zpqn\" (UID: \"526e27b4-30dc-47f9-bfb2-0139f4974555\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:35.456025 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:35.455981 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" Jun 09 08:02:35.580060 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:35.580029 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn"] Jun 09 08:02:35.583718 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:02:35.583680 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526e27b4_30dc_47f9_bfb2_0139f4974555.slice/crio-3c11b806b5322cb9e47630a3460c25c8e61bf05f3673af9015240f5b3e978467 WatchSource:0}: Error finding container 3c11b806b5322cb9e47630a3460c25c8e61bf05f3673af9015240f5b3e978467: Status 404 returned error can't find the container with id 3c11b806b5322cb9e47630a3460c25c8e61bf05f3673af9015240f5b3e978467 Jun 09 08:02:35.693621 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:35.693594 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" event={"ID":"526e27b4-30dc-47f9-bfb2-0139f4974555","Type":"ContainerStarted","Data":"3c11b806b5322cb9e47630a3460c25c8e61bf05f3673af9015240f5b3e978467"} Jun 09 08:02:37.701871 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:37.701836 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" event={"ID":"526e27b4-30dc-47f9-bfb2-0139f4974555","Type":"ContainerStarted","Data":"efe50f041290b02440292babcd59688c2bda0afffcb09eb417bc8007b2408537"} Jun 09 08:02:37.702280 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:37.701892 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" event={"ID":"526e27b4-30dc-47f9-bfb2-0139f4974555","Type":"ContainerStarted","Data":"9e846922f68577aecd32dce7cf9e3a9de89f094aeb800863a36fe624de3d6f56"} Jun 09 08:02:37.719545 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:37.719497 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-5zpqn" podStartSLOduration=3.492635081 podStartE2EDuration="4.719481481s" totalImagesPullingTime="1.2268464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:02:37.719156136 +0000 UTC m=+285.389002168" watchObservedRunningTime="2026-06-09 08:02:37.719481481 +0000 UTC m=+285.389327495" Jun 09 08:02:37.774612 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:37.774580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 08:02:37.774736 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:37.774629 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 08:02:37.777139 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:37.777109 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5822a48b-2f65-4848-9f7e-fdaaaaf881f7-metrics-tls\") pod \"dns-default-jtkj4\" (UID: \"5822a48b-2f65-4848-9f7e-fdaaaaf881f7\") " pod="openshift-dns/dns-default-jtkj4" Jun 09 08:02:37.777261 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:37.777193 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls\") pod \"image-registry-755c65d86-vbvsk\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 08:02:37.785022 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:37.784999 2577 scope.go:117] "RemoveContainer" containerID="cc0f6a8a4a5d04b087de2e39bbdc2341425fa37eafc6737adb9416bb44ec138e" Jun 09 08:02:37.993807 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:37.993723 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xh9rz\"" Jun 09 08:02:37.993979 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:37.993812 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9bx48\"" Jun 09 08:02:38.002011 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:38.001989 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jtkj4" Jun 09 08:02:38.002102 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:38.002077 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 08:02:38.163034 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:38.163000 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-755c65d86-vbvsk"] Jun 09 08:02:38.166017 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:02:38.165986 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25706869_edda_4203_9bde_a4504938b478.slice/crio-0ef2420d838302500f108b6d113c3af037e97ee9bec9ebfbefc58eaa0332efd4 WatchSource:0}: Error finding container 0ef2420d838302500f108b6d113c3af037e97ee9bec9ebfbefc58eaa0332efd4: Status 404 returned error can't find the container with id 0ef2420d838302500f108b6d113c3af037e97ee9bec9ebfbefc58eaa0332efd4 Jun 09 08:02:38.180362 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:38.180338 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jtkj4"] Jun 09 08:02:38.182725 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:02:38.182677 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5822a48b_2f65_4848_9f7e_fdaaaaf881f7.slice/crio-1e5ebcc191df73b281073fb58af2c87133c54935f66d233f7aec0ea734cf6167 WatchSource:0}: Error finding container 1e5ebcc191df73b281073fb58af2c87133c54935f66d233f7aec0ea734cf6167: Status 404 returned error can't find the container with id 1e5ebcc191df73b281073fb58af2c87133c54935f66d233f7aec0ea734cf6167 Jun 09 08:02:38.707056 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:38.707030 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/2.log" Jun 09 08:02:38.707494 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:38.707125 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" event={"ID":"7c531d4b-fba1-4fb5-8be5-26442f258c5e","Type":"ContainerStarted","Data":"2fde0992efe81bbfc9095f50f755f7622167b30320fa29b6dde500fd21a7c977"} Jun 09 08:02:38.707494 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:38.707431 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:02:38.708426 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:38.708397 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtkj4" event={"ID":"5822a48b-2f65-4848-9f7e-fdaaaaf881f7","Type":"ContainerStarted","Data":"1e5ebcc191df73b281073fb58af2c87133c54935f66d233f7aec0ea734cf6167"} Jun 09 08:02:38.709892 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:38.709867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" event={"ID":"25706869-edda-4203-9bde-a4504938b478","Type":"ContainerStarted","Data":"f1fa88886b564cd656392e583cc9bba66045cd4a5b34cc2720ab928938c6b12d"} Jun 09 08:02:38.709994 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:38.709903 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" event={"ID":"25706869-edda-4203-9bde-a4504938b478","Type":"ContainerStarted","Data":"0ef2420d838302500f108b6d113c3af037e97ee9bec9ebfbefc58eaa0332efd4"} Jun 09 08:02:38.724906 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:38.724858 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" podStartSLOduration=41.232242282 podStartE2EDuration="44.724842598s" totalImagesPullingTime="3.492600316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:02:38.724145945 +0000 UTC m=+286.393991961" watchObservedRunningTime="2026-06-09 08:02:38.724842598 +0000 UTC m=+286.394688614" Jun 09 08:02:38.743922 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:38.743881 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" podStartSLOduration=285.74386709 podStartE2EDuration="4m45.74386709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:57:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:02:38.742807256 +0000 UTC m=+286.412653273" watchObservedRunningTime="2026-06-09 08:02:38.74386709 +0000 UTC m=+286.413713106" Jun 09 08:02:38.847485 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:38.847456 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-bp56k" Jun 09 08:02:39.023208 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:39.023125 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-st79n"] Jun 09 08:02:39.025189 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:39.025169 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-st79n" Jun 09 08:02:39.027854 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:39.027827 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-r8b6w\"" Jun 09 08:02:39.027984 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:39.027851 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 08:02:39.028126 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:39.028110 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 08:02:39.037695 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:39.037672 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-st79n"] Jun 09 08:02:39.085910 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:39.085869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kg78\" (UniqueName: \"kubernetes.io/projected/6a7a59eb-54f5-4652-9500-18250ac5fe62-kube-api-access-2kg78\") pod \"downloads-6657875f97-st79n\" (UID: \"6a7a59eb-54f5-4652-9500-18250ac5fe62\") " pod="openshift-console/downloads-6657875f97-st79n" Jun 09 08:02:39.186259 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:39.186227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kg78\" (UniqueName: \"kubernetes.io/projected/6a7a59eb-54f5-4652-9500-18250ac5fe62-kube-api-access-2kg78\") pod \"downloads-6657875f97-st79n\" (UID: \"6a7a59eb-54f5-4652-9500-18250ac5fe62\") " pod="openshift-console/downloads-6657875f97-st79n" Jun 09 08:02:39.198222 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:39.198203 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kg78\" (UniqueName: \"kubernetes.io/projected/6a7a59eb-54f5-4652-9500-18250ac5fe62-kube-api-access-2kg78\") pod \"downloads-6657875f97-st79n\" (UID: \"6a7a59eb-54f5-4652-9500-18250ac5fe62\") " pod="openshift-console/downloads-6657875f97-st79n" Jun 09 08:02:39.334562 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:39.334477 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-st79n" Jun 09 08:02:39.459346 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:39.459269 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-st79n"] Jun 09 08:02:39.461879 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:02:39.461854 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7a59eb_54f5_4652_9500_18250ac5fe62.slice/crio-9d199d1449932495d80e614ef1a5e209ea40980551d4d7a7332ec635d646497f WatchSource:0}: Error finding container 9d199d1449932495d80e614ef1a5e209ea40980551d4d7a7332ec635d646497f: Status 404 returned error can't find the container with id 9d199d1449932495d80e614ef1a5e209ea40980551d4d7a7332ec635d646497f Jun 09 08:02:39.714777 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:39.714736 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-st79n" event={"ID":"6a7a59eb-54f5-4652-9500-18250ac5fe62","Type":"ContainerStarted","Data":"9d199d1449932495d80e614ef1a5e209ea40980551d4d7a7332ec635d646497f"} Jun 09 08:02:39.715313 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:39.714881 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 08:02:40.015402 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.015320 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx"] Jun 09 08:02:40.018684 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.018650 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" Jun 09 08:02:40.022227 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.022201 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 08:02:40.022343 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.022250 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 08:02:40.022343 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.022293 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xcp6x\"" Jun 09 08:02:40.033594 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.033573 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx"] Jun 09 08:02:40.093691 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.093655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12fde6ca-bc61-49e7-8f2b-3243e5b72a3a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hk9lx\" (UID: \"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" Jun 09 08:02:40.093847 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.093704 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbzxm\" (UniqueName: \"kubernetes.io/projected/12fde6ca-bc61-49e7-8f2b-3243e5b72a3a-kube-api-access-vbzxm\") pod \"openshift-state-metrics-65f78d5c66-hk9lx\" (UID: \"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" Jun 09 08:02:40.093890 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.093870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/12fde6ca-bc61-49e7-8f2b-3243e5b72a3a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hk9lx\" (UID: \"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" Jun 09 08:02:40.093958 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.093915 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12fde6ca-bc61-49e7-8f2b-3243e5b72a3a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hk9lx\" (UID: \"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" Jun 09 08:02:40.094922 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.094903 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5v9k8"] Jun 09 08:02:40.096862 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.096846 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.099995 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.099902 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 08:02:40.100566 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.100294 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 08:02:40.100566 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.100336 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qzrdc\"" Jun 09 08:02:40.100566 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.100399 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 08:02:40.194390 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.194354 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.194558 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.194405 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12fde6ca-bc61-49e7-8f2b-3243e5b72a3a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hk9lx\" (UID: \"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" Jun 09 08:02:40.194558 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.194427 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-wtmp\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.194558 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.194443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpxfb\" (UniqueName: \"kubernetes.io/projected/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-kube-api-access-gpxfb\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.194558 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.194465 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12fde6ca-bc61-49e7-8f2b-3243e5b72a3a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hk9lx\" (UID: \"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" Jun 09 08:02:40.194707 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.194608 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbzxm\" (UniqueName: \"kubernetes.io/projected/12fde6ca-bc61-49e7-8f2b-3243e5b72a3a-kube-api-access-vbzxm\") pod \"openshift-state-metrics-65f78d5c66-hk9lx\" (UID: \"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" Jun 09 08:02:40.194707 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.194685 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-metrics-client-ca\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.194805 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.194739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.194805 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.194787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-textfile\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.194981 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.194812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-root\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.194981 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.194855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/12fde6ca-bc61-49e7-8f2b-3243e5b72a3a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hk9lx\" (UID: \"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" Jun 09 08:02:40.194981 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.194879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-sys\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.194981 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.194901 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-tls\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.195234 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.195205 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12fde6ca-bc61-49e7-8f2b-3243e5b72a3a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-hk9lx\" (UID: \"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" Jun 09 08:02:40.196769 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.196745 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12fde6ca-bc61-49e7-8f2b-3243e5b72a3a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-hk9lx\" (UID: \"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" Jun 09 08:02:40.197073 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.197053 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/12fde6ca-bc61-49e7-8f2b-3243e5b72a3a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-hk9lx\" (UID: \"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" Jun 09 08:02:40.210097 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.210079 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbzxm\" (UniqueName: \"kubernetes.io/projected/12fde6ca-bc61-49e7-8f2b-3243e5b72a3a-kube-api-access-vbzxm\") pod \"openshift-state-metrics-65f78d5c66-hk9lx\" (UID: \"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" Jun 09 08:02:40.296144 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-metrics-client-ca\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.296144 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.296353 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-textfile\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.296353 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-root\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.296353 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296238 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-root\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.296353 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-sys\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.296550 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296372 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-tls\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.296550 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.296550 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296434 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-sys\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.296550 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-wtmp\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.296550 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpxfb\" (UniqueName: \"kubernetes.io/projected/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-kube-api-access-gpxfb\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.296782 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296593 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-textfile\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.296782 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296772 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.296883 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296818 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-metrics-client-ca\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.297061 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.296909 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-wtmp\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.298835 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.298813 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.299035 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.299016 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-node-exporter-tls\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.305653 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.305633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpxfb\" (UniqueName: \"kubernetes.io/projected/4bc3d505-dd6f-4f36-9325-81449ad3a0f7-kube-api-access-gpxfb\") pod \"node-exporter-5v9k8\" (UID: \"4bc3d505-dd6f-4f36-9325-81449ad3a0f7\") " pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.328608 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.328498 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" Jun 09 08:02:40.407731 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.407697 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5v9k8" Jun 09 08:02:40.817363 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:02:40.817330 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc3d505_dd6f_4f36_9325_81449ad3a0f7.slice/crio-f598a1e79a4380f170061bfdc63097729fb2ffbddaae104fea7f8e768e137653 WatchSource:0}: Error finding container f598a1e79a4380f170061bfdc63097729fb2ffbddaae104fea7f8e768e137653: Status 404 returned error can't find the container with id f598a1e79a4380f170061bfdc63097729fb2ffbddaae104fea7f8e768e137653 Jun 09 08:02:40.958325 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:40.958297 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx"] Jun 09 08:02:40.961081 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:02:40.961049 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fde6ca_bc61_49e7_8f2b_3243e5b72a3a.slice/crio-005db7370cab6bc934009da532fd06fc4dad8f264e9039c4f8893cd4ebe10f5e WatchSource:0}: Error finding container 005db7370cab6bc934009da532fd06fc4dad8f264e9039c4f8893cd4ebe10f5e: Status 404 returned error can't find the container with id 005db7370cab6bc934009da532fd06fc4dad8f264e9039c4f8893cd4ebe10f5e Jun 09 08:02:41.725411 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:41.725378 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtkj4" event={"ID":"5822a48b-2f65-4848-9f7e-fdaaaaf881f7","Type":"ContainerStarted","Data":"b01abc7ec04a06146d534364cd2d8635c9f8da03d6530b72899beee779aa55c4"} Jun 09 08:02:41.725538 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:41.725478 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jtkj4" event={"ID":"5822a48b-2f65-4848-9f7e-fdaaaaf881f7","Type":"ContainerStarted","Data":"311451de13ae6c080260f6b1cfefc2430b164e1cc2ecb061833d0210bb0bd052"} Jun 09 08:02:41.725538 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:41.725517 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jtkj4" Jun 09 08:02:41.727290 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:41.727264 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5v9k8" event={"ID":"4bc3d505-dd6f-4f36-9325-81449ad3a0f7","Type":"ContainerStarted","Data":"5f2d0fd4d2d30a89923ad5a9a0d960ca0fb4d813f8749f4bf7efdf0588ba993c"} Jun 09 08:02:41.727393 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:41.727317 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5v9k8" event={"ID":"4bc3d505-dd6f-4f36-9325-81449ad3a0f7","Type":"ContainerStarted","Data":"f598a1e79a4380f170061bfdc63097729fb2ffbddaae104fea7f8e768e137653"} Jun 09 08:02:41.730159 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:41.730130 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" event={"ID":"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a","Type":"ContainerStarted","Data":"1b97377da137e61869ee259b676c019315a671e3159fb0e2586d1647584defe8"} Jun 09 08:02:41.730279 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:41.730180 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" event={"ID":"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a","Type":"ContainerStarted","Data":"e4ebfc04cf873407dec51bd380dd91a519c4110e900319d2bd7737a3671dc69d"} Jun 09 08:02:41.730279 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:41.730199 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" event={"ID":"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a","Type":"ContainerStarted","Data":"005db7370cab6bc934009da532fd06fc4dad8f264e9039c4f8893cd4ebe10f5e"} Jun 09 08:02:41.744889 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:41.744767 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jtkj4" podStartSLOduration=252.103416422 podStartE2EDuration="4m14.744749595s" totalImagesPullingTime="2.641333173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:02:41.743751143 +0000 UTC m=+289.413597163" watchObservedRunningTime="2026-06-09 08:02:41.744749595 +0000 UTC m=+289.414595612" Jun 09 08:02:42.735724 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:42.735686 2577 generic.go:356] "Generic (PLEG): container finished" podID="4bc3d505-dd6f-4f36-9325-81449ad3a0f7" containerID="5f2d0fd4d2d30a89923ad5a9a0d960ca0fb4d813f8749f4bf7efdf0588ba993c" exitCode=0 Jun 09 08:02:42.736227 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:42.735767 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5v9k8" event={"ID":"4bc3d505-dd6f-4f36-9325-81449ad3a0f7","Type":"ContainerDied","Data":"5f2d0fd4d2d30a89923ad5a9a0d960ca0fb4d813f8749f4bf7efdf0588ba993c"} Jun 09 08:02:42.738316 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:42.738290 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" event={"ID":"12fde6ca-bc61-49e7-8f2b-3243e5b72a3a","Type":"ContainerStarted","Data":"bff6593ac593e504437c7b372bee2c018a6b502535888dc662a65b841fbdedc1"} Jun 09 08:02:42.773892 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:42.773835 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-hk9lx" podStartSLOduration=2.522106355 podStartE2EDuration="3.773817897s" totalImagesPullingTime="1.251711542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:02:42.77340639 +0000 UTC m=+290.443252405" watchObservedRunningTime="2026-06-09 08:02:42.773817897 +0000 UTC m=+290.443663960" Jun 09 08:02:43.159106 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.158998 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx"] Jun 09 08:02:43.163499 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.163476 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.166671 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.166646 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 08:02:43.166671 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.166667 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 08:02:43.166861 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.166685 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7nkwq\"" Jun 09 08:02:43.167204 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.167184 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 08:02:43.167272 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.167190 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8gddg91jdsfhm\"" Jun 09 08:02:43.167587 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.167567 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 08:02:43.167664 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.167591 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 08:02:43.175804 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.175782 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx"] Jun 09 08:02:43.226288 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.226263 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.226403 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.226293 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b727d01f-18d9-4aff-852f-19038efab900-metrics-client-ca\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.226403 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.226316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.226403 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.226389 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.226534 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.226445 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.226534 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.226465 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-grpc-tls\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.226534 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.226489 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw4pl\" (UniqueName: \"kubernetes.io/projected/b727d01f-18d9-4aff-852f-19038efab900-kube-api-access-lw4pl\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.226637 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.226546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-tls\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.327293 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.327256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.327293 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.327299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.327474 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.327316 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-grpc-tls\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.327474 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.327341 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw4pl\" (UniqueName: \"kubernetes.io/projected/b727d01f-18d9-4aff-852f-19038efab900-kube-api-access-lw4pl\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.327474 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.327372 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-tls\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.327474 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.327407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.327474 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.327424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b727d01f-18d9-4aff-852f-19038efab900-metrics-client-ca\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.327474 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.327447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.328489 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.328457 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b727d01f-18d9-4aff-852f-19038efab900-metrics-client-ca\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.330254 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.330226 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.330360 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.330315 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-grpc-tls\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.330544 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.330526 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-tls\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.330586 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.330555 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.330586 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.330559 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.330649 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.330559 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b727d01f-18d9-4aff-852f-19038efab900-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.335286 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.335265 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw4pl\" (UniqueName: \"kubernetes.io/projected/b727d01f-18d9-4aff-852f-19038efab900-kube-api-access-lw4pl\") pod \"thanos-querier-5bcd7cbb6d-t2pmx\" (UID: \"b727d01f-18d9-4aff-852f-19038efab900\") " pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.474657 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.474621 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:43.613305 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.613173 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx"] Jun 09 08:02:43.615697 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:02:43.615664 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb727d01f_18d9_4aff_852f_19038efab900.slice/crio-b1bc431a795cb1816d4bcb09766f5cb354ba73cea0475f734777701a17f69f2c WatchSource:0}: Error finding container b1bc431a795cb1816d4bcb09766f5cb354ba73cea0475f734777701a17f69f2c: Status 404 returned error can't find the container with id b1bc431a795cb1816d4bcb09766f5cb354ba73cea0475f734777701a17f69f2c Jun 09 08:02:43.743576 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.743497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" event={"ID":"b727d01f-18d9-4aff-852f-19038efab900","Type":"ContainerStarted","Data":"b1bc431a795cb1816d4bcb09766f5cb354ba73cea0475f734777701a17f69f2c"} Jun 09 08:02:43.745980 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.745952 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5v9k8" event={"ID":"4bc3d505-dd6f-4f36-9325-81449ad3a0f7","Type":"ContainerStarted","Data":"499b78e99d3093b58b454049a7e7466f2b41e18754249485ac7d218a7edd416d"} Jun 09 08:02:43.746109 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.746005 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5v9k8" event={"ID":"4bc3d505-dd6f-4f36-9325-81449ad3a0f7","Type":"ContainerStarted","Data":"9ebe34be8ac30be298f9715a68671e7b9bf24d38a61cd606d72a51b82eb836b7"} Jun 09 08:02:43.769449 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:43.769400 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5v9k8" podStartSLOduration=2.876779582 podStartE2EDuration="3.769386048s" totalImagesPullingTime="809.442546ms" totalInitContainerRuntime="83.16392ms" isStatefulPod=true podCreationTimestamp="2026-06-09 08:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:02:43.767651111 +0000 UTC m=+291.437497126" watchObservedRunningTime="2026-06-09 08:02:43.769386048 +0000 UTC m=+291.439232062" Jun 09 08:02:44.748332 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.747992 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-665789796d-fks74"] Jun 09 08:02:44.752094 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.752012 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.755482 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.755454 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 08:02:44.755597 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.755461 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 08:02:44.756005 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.755788 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 08:02:44.756005 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.755798 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 08:02:44.757045 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.756810 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 08:02:44.757045 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.756888 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-426tm\"" Jun 09 08:02:44.765449 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.765422 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665789796d-fks74"] Jun 09 08:02:44.837849 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.837808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-config\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.838013 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.837855 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-oauth-config\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.838013 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.837923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-oauth-serving-cert\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.838196 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.838061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fldjw\" (UniqueName: \"kubernetes.io/projected/cbba3789-2a1d-44a9-bc19-27cf87d9012e-kube-api-access-fldjw\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.838196 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.838084 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-serving-cert\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.838196 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.838107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-service-ca\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.939319 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.939281 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-service-ca\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.939490 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.939432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-config\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.939490 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.939466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-oauth-config\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.939568 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.939500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-oauth-serving-cert\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.939621 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.939595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fldjw\" (UniqueName: \"kubernetes.io/projected/cbba3789-2a1d-44a9-bc19-27cf87d9012e-kube-api-access-fldjw\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.939675 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.939627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-serving-cert\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.940124 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.940029 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-service-ca\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.940620 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.940592 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-oauth-serving-cert\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.940732 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.940617 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-config\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.942408 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.942359 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-serving-cert\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.942527 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.942457 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-oauth-config\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:44.949183 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:44.949164 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fldjw\" (UniqueName: \"kubernetes.io/projected/cbba3789-2a1d-44a9-bc19-27cf87d9012e-kube-api-access-fldjw\") pod \"console-665789796d-fks74\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:45.066348 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:45.066264 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:45.221320 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:45.221227 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665789796d-fks74"] Jun 09 08:02:45.224331 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:02:45.224304 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbba3789_2a1d_44a9_bc19_27cf87d9012e.slice/crio-5c46c971db7198105b6c59d9ab9f2561eaec884cebabd371bf8ac5aad9898a92 WatchSource:0}: Error finding container 5c46c971db7198105b6c59d9ab9f2561eaec884cebabd371bf8ac5aad9898a92: Status 404 returned error can't find the container with id 5c46c971db7198105b6c59d9ab9f2561eaec884cebabd371bf8ac5aad9898a92 Jun 09 08:02:45.755892 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:45.755850 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665789796d-fks74" event={"ID":"cbba3789-2a1d-44a9-bc19-27cf87d9012e","Type":"ContainerStarted","Data":"5c46c971db7198105b6c59d9ab9f2561eaec884cebabd371bf8ac5aad9898a92"} Jun 09 08:02:46.765577 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:46.765540 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" event={"ID":"b727d01f-18d9-4aff-852f-19038efab900","Type":"ContainerStarted","Data":"0d0a62e2f01177f8c39e7c0ad13900f868cd21a0c10677f53ebb774312cea704"} Jun 09 08:02:46.766049 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:46.765621 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" event={"ID":"b727d01f-18d9-4aff-852f-19038efab900","Type":"ContainerStarted","Data":"4e4223cb39740181e1dfdd1ad15074367f880e52467c46ee04522e2850702509"} Jun 09 08:02:46.766049 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:46.765660 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" event={"ID":"b727d01f-18d9-4aff-852f-19038efab900","Type":"ContainerStarted","Data":"f1fffe93b3571705d9f9c6219cdfa71fd8432fc4fc810f68ce63f0d1040bfd7e"} Jun 09 08:02:47.774832 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:47.774797 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" event={"ID":"b727d01f-18d9-4aff-852f-19038efab900","Type":"ContainerStarted","Data":"963b5ef6d679feb817ccad6aa2b9c29310b3ac3825987c86300371271e9e1f0a"} Jun 09 08:02:47.775314 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:47.774919 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" event={"ID":"b727d01f-18d9-4aff-852f-19038efab900","Type":"ContainerStarted","Data":"05439cd352c523dbda7f03e68eb409ced0ed99870e31e25b4aaf78534af6e604"} Jun 09 08:02:47.775314 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:47.774979 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" event={"ID":"b727d01f-18d9-4aff-852f-19038efab900","Type":"ContainerStarted","Data":"1cba9b73be68b6eebacb928e001ea40fccc1f6f4e7d2d13af096c3bf3f219450"} Jun 09 08:02:47.775443 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:47.775319 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:47.786187 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:02:47.786158 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fpbq7" podUID="2cc82d46-ff16-4d56-a54a-4d8283ab6d5a" Jun 09 08:02:47.804252 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:47.804019 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" podStartSLOduration=1.7145295310000002 podStartE2EDuration="4.803999805s" totalImagesPullingTime="3.089470274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:02:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:02:47.801562309 +0000 UTC m=+295.471408325" watchObservedRunningTime="2026-06-09 08:02:47.803999805 +0000 UTC m=+295.473845821" Jun 09 08:02:49.785459 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:49.785368 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665789796d-fks74" event={"ID":"cbba3789-2a1d-44a9-bc19-27cf87d9012e","Type":"ContainerStarted","Data":"05764b5be5450fa13bfe768d9495391fcabe2b9a318ddeb827b9425705e12a2c"} Jun 09 08:02:49.804432 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:49.804373 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-665789796d-fks74" podStartSLOduration=1.521319152 podStartE2EDuration="5.804352484s" totalImagesPullingTime="4.283033332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:02:49.802427738 +0000 UTC m=+297.472273754" watchObservedRunningTime="2026-06-09 08:02:49.804352484 +0000 UTC m=+297.474198502" Jun 09 08:02:51.740981 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:51.740951 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jtkj4" Jun 09 08:02:52.740457 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:52.740431 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/2.log" Jun 09 08:02:52.740617 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:52.740492 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/2.log" Jun 09 08:02:52.752194 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:52.752172 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 08:02:53.787467 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:53.787437 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5bcd7cbb6d-t2pmx" Jun 09 08:02:54.947418 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:54.947382 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64c897fcfb-qgqf4"] Jun 09 08:02:54.950607 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:54.950583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:54.959848 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:54.959824 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 08:02:54.964617 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:54.964588 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c897fcfb-qgqf4"] Jun 09 08:02:55.067029 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.066994 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:55.067210 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.067058 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:55.072429 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.072389 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:55.142709 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.142670 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-config\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.142709 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.142713 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-trusted-ca-bundle\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.142993 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.142733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-oauth-serving-cert\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.142993 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.142860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-service-ca\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.142993 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.142900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrxrm\" (UniqueName: \"kubernetes.io/projected/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-kube-api-access-zrxrm\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.142993 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.142978 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-oauth-config\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.143162 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.143040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-serving-cert\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.244419 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.244311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-config\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.244419 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.244362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-trusted-ca-bundle\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.244419 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.244386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-oauth-serving-cert\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.244695 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.244674 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-service-ca\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.244752 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.244711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrxrm\" (UniqueName: \"kubernetes.io/projected/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-kube-api-access-zrxrm\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.244812 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.244754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-oauth-config\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.244863 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.244828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-serving-cert\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.245243 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.245220 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-config\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.245243 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.245231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-oauth-serving-cert\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.245441 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.245363 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-trusted-ca-bundle\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.245441 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.245390 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-service-ca\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.247584 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.247560 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-serving-cert\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.247697 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.247615 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-oauth-config\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.254072 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.254048 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrxrm\" (UniqueName: \"kubernetes.io/projected/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-kube-api-access-zrxrm\") pod \"console-64c897fcfb-qgqf4\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.262715 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.262696 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:02:55.816489 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:55.816459 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-665789796d-fks74" Jun 09 08:02:57.771380 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:57.771345 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-755c65d86-vbvsk"] Jun 09 08:02:57.776461 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:57.776427 2577 patch_prober.go:28] interesting pod/image-registry-755c65d86-vbvsk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 08:02:57.776585 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:02:57.776486 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" podUID="25706869-edda-4203-9bde-a4504938b478" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 08:03:00.579057 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:00.579031 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c897fcfb-qgqf4"] Jun 09 08:03:00.581533 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:03:00.581508 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda40ea3bf_a778_4c70_b82b_fa4bc4a16b31.slice/crio-79b20f0fffd5696babaf6ad7a6790535f9719ed7e924d6376b0cc5f709b2ce62 WatchSource:0}: Error finding container 79b20f0fffd5696babaf6ad7a6790535f9719ed7e924d6376b0cc5f709b2ce62: Status 404 returned error can't find the container with id 79b20f0fffd5696babaf6ad7a6790535f9719ed7e924d6376b0cc5f709b2ce62 Jun 09 08:03:00.835135 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:00.835054 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-st79n" event={"ID":"6a7a59eb-54f5-4652-9500-18250ac5fe62","Type":"ContainerStarted","Data":"3c3f7e10251235c1d2539265692cf9a1c705c18f7cdcb5b551afeedd91f9d455"} Jun 09 08:03:00.835306 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:00.835238 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-st79n" Jun 09 08:03:00.837443 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:00.837185 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c897fcfb-qgqf4" event={"ID":"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31","Type":"ContainerStarted","Data":"5f43aa95794f56f51a485c97062d50d0ebd0dbf87fea02724656a86fcff5f250"} Jun 09 08:03:00.837443 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:00.837222 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c897fcfb-qgqf4" event={"ID":"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31","Type":"ContainerStarted","Data":"79b20f0fffd5696babaf6ad7a6790535f9719ed7e924d6376b0cc5f709b2ce62"} Jun 09 08:03:00.841050 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:00.841014 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-st79n" Jun 09 08:03:00.857994 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:00.857951 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-st79n" podStartSLOduration=0.79668114 podStartE2EDuration="21.857919902s" totalImagesPullingTime="21.061238762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:03:00.857908697 +0000 UTC m=+308.527754711" watchObservedRunningTime="2026-06-09 08:03:00.857919902 +0000 UTC m=+308.527765917" Jun 09 08:03:00.884327 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:00.884274 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64c897fcfb-qgqf4" podStartSLOduration=6.8842568360000005 podStartE2EDuration="6.884256836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:03:00.882821837 +0000 UTC m=+308.552667878" watchObservedRunningTime="2026-06-09 08:03:00.884256836 +0000 UTC m=+308.554102851" Jun 09 08:03:02.787204 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:02.787167 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 08:03:05.263497 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:05.263458 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:03:05.264042 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:05.263624 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:03:05.269050 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:05.269026 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:03:05.865270 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:05.865239 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:03:05.920545 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:05.920513 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665789796d-fks74"] Jun 09 08:03:07.776630 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:07.776597 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 08:03:22.792734 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:22.792677 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" podUID="25706869-edda-4203-9bde-a4504938b478" containerName="registry" containerID="cri-o://f1fa88886b564cd656392e583cc9bba66045cd4a5b34cc2720ab928938c6b12d" gracePeriod=30 Jun 09 08:03:22.931826 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:22.931796 2577 generic.go:356] "Generic (PLEG): container finished" podID="25706869-edda-4203-9bde-a4504938b478" containerID="f1fa88886b564cd656392e583cc9bba66045cd4a5b34cc2720ab928938c6b12d" exitCode=0 Jun 09 08:03:22.931826 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:22.931836 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" event={"ID":"25706869-edda-4203-9bde-a4504938b478","Type":"ContainerDied","Data":"f1fa88886b564cd656392e583cc9bba66045cd4a5b34cc2720ab928938c6b12d"} Jun 09 08:03:23.058420 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.058388 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 08:03:23.205331 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.205278 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25706869-edda-4203-9bde-a4504938b478-registry-certificates\") pod \"25706869-edda-4203-9bde-a4504938b478\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " Jun 09 08:03:23.205331 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.205343 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-bound-sa-token\") pod \"25706869-edda-4203-9bde-a4504938b478\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " Jun 09 08:03:23.205573 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.205367 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25706869-edda-4203-9bde-a4504938b478-ca-trust-extracted\") pod \"25706869-edda-4203-9bde-a4504938b478\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " Jun 09 08:03:23.205573 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.205400 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls\") pod \"25706869-edda-4203-9bde-a4504938b478\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " Jun 09 08:03:23.205573 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.205418 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25706869-edda-4203-9bde-a4504938b478-image-registry-private-configuration\") pod \"25706869-edda-4203-9bde-a4504938b478\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " Jun 09 08:03:23.205573 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.205435 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25706869-edda-4203-9bde-a4504938b478-trusted-ca\") pod \"25706869-edda-4203-9bde-a4504938b478\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " Jun 09 08:03:23.205573 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.205462 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ghn8\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-kube-api-access-4ghn8\") pod \"25706869-edda-4203-9bde-a4504938b478\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " Jun 09 08:03:23.205573 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.205495 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25706869-edda-4203-9bde-a4504938b478-installation-pull-secrets\") pod \"25706869-edda-4203-9bde-a4504938b478\" (UID: \"25706869-edda-4203-9bde-a4504938b478\") " Jun 09 08:03:23.205850 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.205730 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25706869-edda-4203-9bde-a4504938b478-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "25706869-edda-4203-9bde-a4504938b478" (UID: "25706869-edda-4203-9bde-a4504938b478"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:03:23.206020 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.205987 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25706869-edda-4203-9bde-a4504938b478-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "25706869-edda-4203-9bde-a4504938b478" (UID: "25706869-edda-4203-9bde-a4504938b478"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:03:23.207947 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.207905 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25706869-edda-4203-9bde-a4504938b478-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "25706869-edda-4203-9bde-a4504938b478" (UID: "25706869-edda-4203-9bde-a4504938b478"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:03:23.208064 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.207965 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "25706869-edda-4203-9bde-a4504938b478" (UID: "25706869-edda-4203-9bde-a4504938b478"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:03:23.208307 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.208282 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "25706869-edda-4203-9bde-a4504938b478" (UID: "25706869-edda-4203-9bde-a4504938b478"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:03:23.208387 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.208278 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-kube-api-access-4ghn8" (OuterVolumeSpecName: "kube-api-access-4ghn8") pod "25706869-edda-4203-9bde-a4504938b478" (UID: "25706869-edda-4203-9bde-a4504938b478"). InnerVolumeSpecName "kube-api-access-4ghn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:03:23.208387 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.208357 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25706869-edda-4203-9bde-a4504938b478-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "25706869-edda-4203-9bde-a4504938b478" (UID: "25706869-edda-4203-9bde-a4504938b478"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:03:23.214359 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.214338 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25706869-edda-4203-9bde-a4504938b478-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "25706869-edda-4203-9bde-a4504938b478" (UID: "25706869-edda-4203-9bde-a4504938b478"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:03:23.306916 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.306824 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/25706869-edda-4203-9bde-a4504938b478-registry-certificates\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:03:23.306916 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.306866 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-bound-sa-token\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:03:23.306916 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.306877 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/25706869-edda-4203-9bde-a4504938b478-ca-trust-extracted\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:03:23.306916 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.306888 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-registry-tls\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:03:23.306916 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.306896 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/25706869-edda-4203-9bde-a4504938b478-image-registry-private-configuration\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:03:23.306916 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.306905 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/25706869-edda-4203-9bde-a4504938b478-trusted-ca\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:03:23.306916 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.306913 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ghn8\" (UniqueName: \"kubernetes.io/projected/25706869-edda-4203-9bde-a4504938b478-kube-api-access-4ghn8\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:03:23.306916 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.306921 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/25706869-edda-4203-9bde-a4504938b478-installation-pull-secrets\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:03:23.941365 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.936922 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" event={"ID":"25706869-edda-4203-9bde-a4504938b478","Type":"ContainerDied","Data":"0ef2420d838302500f108b6d113c3af037e97ee9bec9ebfbefc58eaa0332efd4"} Jun 09 08:03:23.941365 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.937070 2577 scope.go:117] "RemoveContainer" containerID="f1fa88886b564cd656392e583cc9bba66045cd4a5b34cc2720ab928938c6b12d" Jun 09 08:03:23.941365 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.937291 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755c65d86-vbvsk" Jun 09 08:03:23.960572 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.960544 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-755c65d86-vbvsk"] Jun 09 08:03:23.965742 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:23.965720 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-755c65d86-vbvsk"] Jun 09 08:03:24.789264 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:24.789235 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25706869-edda-4203-9bde-a4504938b478" path="/var/lib/kubelet/pods/25706869-edda-4203-9bde-a4504938b478/volumes" Jun 09 08:03:24.942571 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:24.942539 2577 generic.go:356] "Generic (PLEG): container finished" podID="13f660d9-a165-4477-9110-10608939625b" containerID="57699a84127850760dc7cf31a656d75e34895882b26c3c20ce78b5864b9c372e" exitCode=0 Jun 09 08:03:24.942915 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:24.942579 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-x84lc" event={"ID":"13f660d9-a165-4477-9110-10608939625b","Type":"ContainerDied","Data":"57699a84127850760dc7cf31a656d75e34895882b26c3c20ce78b5864b9c372e"} Jun 09 08:03:24.942915 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:24.942905 2577 scope.go:117] "RemoveContainer" containerID="57699a84127850760dc7cf31a656d75e34895882b26c3c20ce78b5864b9c372e" Jun 09 08:03:25.756363 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:25.756331 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jtkj4_5822a48b-2f65-4848-9f7e-fdaaaaf881f7/dns/0.log" Jun 09 08:03:25.762538 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:25.762517 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jtkj4_5822a48b-2f65-4848-9f7e-fdaaaaf881f7/kube-rbac-proxy/0.log" Jun 09 08:03:25.948544 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:25.948511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-x84lc" event={"ID":"13f660d9-a165-4477-9110-10608939625b","Type":"ContainerStarted","Data":"4d571aee1e24794f9807d260da3fca2dfdf3fa605fd4683afcc842f6685c9930"} Jun 09 08:03:26.102200 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:26.102123 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-psxf9_fee7c818-f667-4a20-8e2d-8d42ca5fa868/dns-node-resolver/0.log" Jun 09 08:03:30.946263 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:30.946200 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-665789796d-fks74" podUID="cbba3789-2a1d-44a9-bc19-27cf87d9012e" containerName="console" containerID="cri-o://05764b5be5450fa13bfe768d9495391fcabe2b9a318ddeb827b9425705e12a2c" gracePeriod=15 Jun 09 08:03:31.232481 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.232422 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665789796d-fks74" Jun 09 08:03:31.380966 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.380913 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fldjw\" (UniqueName: \"kubernetes.io/projected/cbba3789-2a1d-44a9-bc19-27cf87d9012e-kube-api-access-fldjw\") pod \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " Jun 09 08:03:31.381149 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.380980 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-serving-cert\") pod \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " Jun 09 08:03:31.381149 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.381005 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-service-ca\") pod \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " Jun 09 08:03:31.381149 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.381033 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-oauth-config\") pod \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " Jun 09 08:03:31.381149 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.381073 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-oauth-serving-cert\") pod \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " Jun 09 08:03:31.381149 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.381113 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-config\") pod \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\" (UID: \"cbba3789-2a1d-44a9-bc19-27cf87d9012e\") " Jun 09 08:03:31.381428 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.381362 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-service-ca" (OuterVolumeSpecName: "service-ca") pod "cbba3789-2a1d-44a9-bc19-27cf87d9012e" (UID: "cbba3789-2a1d-44a9-bc19-27cf87d9012e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:03:31.381509 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.381472 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cbba3789-2a1d-44a9-bc19-27cf87d9012e" (UID: "cbba3789-2a1d-44a9-bc19-27cf87d9012e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:03:31.381575 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.381546 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-config" (OuterVolumeSpecName: "console-config") pod "cbba3789-2a1d-44a9-bc19-27cf87d9012e" (UID: "cbba3789-2a1d-44a9-bc19-27cf87d9012e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:03:31.383209 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.383178 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cbba3789-2a1d-44a9-bc19-27cf87d9012e" (UID: "cbba3789-2a1d-44a9-bc19-27cf87d9012e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:03:31.383305 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.383235 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbba3789-2a1d-44a9-bc19-27cf87d9012e-kube-api-access-fldjw" (OuterVolumeSpecName: "kube-api-access-fldjw") pod "cbba3789-2a1d-44a9-bc19-27cf87d9012e" (UID: "cbba3789-2a1d-44a9-bc19-27cf87d9012e"). InnerVolumeSpecName "kube-api-access-fldjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:03:31.383305 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.383274 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cbba3789-2a1d-44a9-bc19-27cf87d9012e" (UID: "cbba3789-2a1d-44a9-bc19-27cf87d9012e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:03:31.482432 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.482398 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fldjw\" (UniqueName: \"kubernetes.io/projected/cbba3789-2a1d-44a9-bc19-27cf87d9012e-kube-api-access-fldjw\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:03:31.482432 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.482427 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-serving-cert\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:03:31.482432 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.482437 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-service-ca\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:03:31.482653 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.482446 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-oauth-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:03:31.482653 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.482456 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-oauth-serving-cert\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:03:31.482653 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.482464 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbba3789-2a1d-44a9-bc19-27cf87d9012e-console-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:03:31.972756 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.972718 2577 generic.go:356] "Generic (PLEG): container finished" podID="cbba3789-2a1d-44a9-bc19-27cf87d9012e" containerID="05764b5be5450fa13bfe768d9495391fcabe2b9a318ddeb827b9425705e12a2c" exitCode=0 Jun 09 08:03:31.972756 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.972756 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665789796d-fks74" Jun 09 08:03:31.973277 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.972807 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665789796d-fks74" event={"ID":"cbba3789-2a1d-44a9-bc19-27cf87d9012e","Type":"ContainerDied","Data":"05764b5be5450fa13bfe768d9495391fcabe2b9a318ddeb827b9425705e12a2c"} Jun 09 08:03:31.973277 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.972847 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665789796d-fks74" event={"ID":"cbba3789-2a1d-44a9-bc19-27cf87d9012e","Type":"ContainerDied","Data":"5c46c971db7198105b6c59d9ab9f2561eaec884cebabd371bf8ac5aad9898a92"} Jun 09 08:03:31.973277 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.972867 2577 scope.go:117] "RemoveContainer" containerID="05764b5be5450fa13bfe768d9495391fcabe2b9a318ddeb827b9425705e12a2c" Jun 09 08:03:31.981061 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.981041 2577 scope.go:117] "RemoveContainer" containerID="05764b5be5450fa13bfe768d9495391fcabe2b9a318ddeb827b9425705e12a2c" Jun 09 08:03:31.981330 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:03:31.981309 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05764b5be5450fa13bfe768d9495391fcabe2b9a318ddeb827b9425705e12a2c\": container with ID starting with 05764b5be5450fa13bfe768d9495391fcabe2b9a318ddeb827b9425705e12a2c not found: ID does not exist" containerID="05764b5be5450fa13bfe768d9495391fcabe2b9a318ddeb827b9425705e12a2c" Jun 09 08:03:31.981375 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.981338 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05764b5be5450fa13bfe768d9495391fcabe2b9a318ddeb827b9425705e12a2c"} err="failed to get container status \"05764b5be5450fa13bfe768d9495391fcabe2b9a318ddeb827b9425705e12a2c\": rpc error: code = NotFound desc = could not find container \"05764b5be5450fa13bfe768d9495391fcabe2b9a318ddeb827b9425705e12a2c\": container with ID starting with 05764b5be5450fa13bfe768d9495391fcabe2b9a318ddeb827b9425705e12a2c not found: ID does not exist" Jun 09 08:03:31.993481 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.993456 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665789796d-fks74"] Jun 09 08:03:31.998007 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:31.997984 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-665789796d-fks74"] Jun 09 08:03:32.789352 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:32.789323 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbba3789-2a1d-44a9-bc19-27cf87d9012e" path="/var/lib/kubelet/pods/cbba3789-2a1d-44a9-bc19-27cf87d9012e/volumes" Jun 09 08:03:33.982197 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:33.982163 2577 generic.go:356] "Generic (PLEG): container finished" podID="be1b591a-a82d-44a8-a26d-a01e439851c2" containerID="13203ff3f98a2da2ad90ed426cac42dd8a8799bfe15c2d67c30c9679b1bee9b5" exitCode=0 Jun 09 08:03:33.982571 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:33.982238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" event={"ID":"be1b591a-a82d-44a8-a26d-a01e439851c2","Type":"ContainerDied","Data":"13203ff3f98a2da2ad90ed426cac42dd8a8799bfe15c2d67c30c9679b1bee9b5"} Jun 09 08:03:33.982663 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:33.982645 2577 scope.go:117] "RemoveContainer" containerID="13203ff3f98a2da2ad90ed426cac42dd8a8799bfe15c2d67c30c9679b1bee9b5" Jun 09 08:03:34.987902 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:03:34.987869 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-xmzf8" event={"ID":"be1b591a-a82d-44a8-a26d-a01e439851c2","Type":"ContainerStarted","Data":"6c02a0a44a1d625e96d0852234d68e1e0b4e902b526f3897812a19e8fa8e46e5"} Jun 09 08:04:02.381909 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.381867 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 08:04:02.382399 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.382179 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbba3789-2a1d-44a9-bc19-27cf87d9012e" containerName="console" Jun 09 08:04:02.382399 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.382191 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbba3789-2a1d-44a9-bc19-27cf87d9012e" containerName="console" Jun 09 08:04:02.382399 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.382203 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25706869-edda-4203-9bde-a4504938b478" containerName="registry" Jun 09 08:04:02.382399 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.382208 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="25706869-edda-4203-9bde-a4504938b478" containerName="registry" Jun 09 08:04:02.382399 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.382262 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="25706869-edda-4203-9bde-a4504938b478" containerName="registry" Jun 09 08:04:02.382399 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.382272 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbba3789-2a1d-44a9-bc19-27cf87d9012e" containerName="console" Jun 09 08:04:02.385532 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.385509 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.388232 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.388210 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 08:04:02.388371 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.388240 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 08:04:02.388371 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.388261 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 08:04:02.388371 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.388317 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 08:04:02.388371 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.388221 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jffzh\"" Jun 09 08:04:02.388672 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.388654 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 08:04:02.388733 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.388684 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 08:04:02.388733 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.388712 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 08:04:02.388810 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.388684 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 08:04:02.393852 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.393833 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 08:04:02.399388 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.399367 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 08:04:02.413696 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.413675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.413810 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.413702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.413810 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.413727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbljs\" (UniqueName: \"kubernetes.io/projected/bbff46be-bf42-4cb0-83a8-e34171a6c72c-kube-api-access-kbljs\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.413810 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.413756 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbff46be-bf42-4cb0-83a8-e34171a6c72c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.413999 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.413843 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-web-config\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.413999 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.413883 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.413999 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.413920 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-config-volume\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.413999 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.413992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbff46be-bf42-4cb0-83a8-e34171a6c72c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.414193 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.414025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbff46be-bf42-4cb0-83a8-e34171a6c72c-config-out\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.414193 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.414047 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbff46be-bf42-4cb0-83a8-e34171a6c72c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.414193 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.414088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.414193 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.414120 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.414193 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.414153 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbff46be-bf42-4cb0-83a8-e34171a6c72c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.514717 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.514695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbljs\" (UniqueName: \"kubernetes.io/projected/bbff46be-bf42-4cb0-83a8-e34171a6c72c-kube-api-access-kbljs\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.514811 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.514724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbff46be-bf42-4cb0-83a8-e34171a6c72c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.514811 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.514752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-web-config\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.514811 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.514781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.514963 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.514811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-config-volume\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.514963 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.514851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbff46be-bf42-4cb0-83a8-e34171a6c72c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.514963 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.514879 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbff46be-bf42-4cb0-83a8-e34171a6c72c-config-out\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.514963 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.514901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbff46be-bf42-4cb0-83a8-e34171a6c72c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.514963 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.514958 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.515226 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.514989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.515226 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.515017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbff46be-bf42-4cb0-83a8-e34171a6c72c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.515226 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.515051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.515226 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.515073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.515414 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.515350 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbff46be-bf42-4cb0-83a8-e34171a6c72c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.515755 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.515731 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbff46be-bf42-4cb0-83a8-e34171a6c72c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.515921 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.515896 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbff46be-bf42-4cb0-83a8-e34171a6c72c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.518323 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.517862 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-config-volume\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.518323 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.517983 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbff46be-bf42-4cb0-83a8-e34171a6c72c-config-out\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.518323 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.518167 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-web-config\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.518323 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.518283 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.518536 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.518343 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.518536 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.518353 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.518602 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.518555 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbff46be-bf42-4cb0-83a8-e34171a6c72c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.518762 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.518740 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.519575 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.519557 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbff46be-bf42-4cb0-83a8-e34171a6c72c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.523093 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.523075 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbljs\" (UniqueName: \"kubernetes.io/projected/bbff46be-bf42-4cb0-83a8-e34171a6c72c-kube-api-access-kbljs\") pod \"alertmanager-main-0\" (UID: \"bbff46be-bf42-4cb0-83a8-e34171a6c72c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.696492 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.696473 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 08:04:02.828105 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.828076 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 08:04:02.832438 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:04:02.832414 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbff46be_bf42_4cb0_83a8_e34171a6c72c.slice/crio-bd5239e6c51841d15b00ebd08f0898dc54c533641ce9285691328c1ca648c7d3 WatchSource:0}: Error finding container bd5239e6c51841d15b00ebd08f0898dc54c533641ce9285691328c1ca648c7d3: Status 404 returned error can't find the container with id bd5239e6c51841d15b00ebd08f0898dc54c533641ce9285691328c1ca648c7d3 Jun 09 08:04:02.834524 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:02.834506 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 08:04:03.101682 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:03.101597 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbff46be-bf42-4cb0-83a8-e34171a6c72c","Type":"ContainerStarted","Data":"bd5239e6c51841d15b00ebd08f0898dc54c533641ce9285691328c1ca648c7d3"} Jun 09 08:04:04.106174 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.106100 2577 generic.go:356] "Generic (PLEG): container finished" podID="bbff46be-bf42-4cb0-83a8-e34171a6c72c" containerID="c1ffd858d97dbe79abb710190cb797e246c17adfe5ec6a958d7c06273af02d99" exitCode=0 Jun 09 08:04:04.106499 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.106179 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbff46be-bf42-4cb0-83a8-e34171a6c72c","Type":"ContainerDied","Data":"c1ffd858d97dbe79abb710190cb797e246c17adfe5ec6a958d7c06273af02d99"} Jun 09 08:04:04.354796 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.354763 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7699c84f46-cxjl2"] Jun 09 08:04:04.357308 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.357260 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.360124 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.360100 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 08:04:04.360377 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.360343 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 08:04:04.360503 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.360482 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 08:04:04.360943 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.360909 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 08:04:04.361380 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.361362 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hh552\"" Jun 09 08:04:04.361470 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.361403 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 08:04:04.366077 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.365893 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 08:04:04.378069 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.378044 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7699c84f46-cxjl2"] Jun 09 08:04:04.432692 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.432656 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae33783a-d875-442b-aead-1c8a8cae8f7c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.432860 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.432696 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ae33783a-d875-442b-aead-1c8a8cae8f7c-telemeter-client-tls\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.432860 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.432738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ae33783a-d875-442b-aead-1c8a8cae8f7c-federate-client-tls\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.432860 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.432758 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae33783a-d875-442b-aead-1c8a8cae8f7c-metrics-client-ca\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.432860 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.432781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae33783a-d875-442b-aead-1c8a8cae8f7c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.433116 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.432868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk85c\" (UniqueName: \"kubernetes.io/projected/ae33783a-d875-442b-aead-1c8a8cae8f7c-kube-api-access-zk85c\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.433116 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.432912 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ae33783a-d875-442b-aead-1c8a8cae8f7c-secret-telemeter-client\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.433116 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.433035 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae33783a-d875-442b-aead-1c8a8cae8f7c-serving-certs-ca-bundle\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.534239 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.534139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk85c\" (UniqueName: \"kubernetes.io/projected/ae33783a-d875-442b-aead-1c8a8cae8f7c-kube-api-access-zk85c\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.534239 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.534197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ae33783a-d875-442b-aead-1c8a8cae8f7c-secret-telemeter-client\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.534535 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.534303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae33783a-d875-442b-aead-1c8a8cae8f7c-serving-certs-ca-bundle\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.534535 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.534357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae33783a-d875-442b-aead-1c8a8cae8f7c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.534535 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.534399 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ae33783a-d875-442b-aead-1c8a8cae8f7c-telemeter-client-tls\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.534535 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.534450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ae33783a-d875-442b-aead-1c8a8cae8f7c-federate-client-tls\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.534535 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.534474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae33783a-d875-442b-aead-1c8a8cae8f7c-metrics-client-ca\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.534535 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.534495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae33783a-d875-442b-aead-1c8a8cae8f7c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.535625 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.535601 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae33783a-d875-442b-aead-1c8a8cae8f7c-metrics-client-ca\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.536048 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.535985 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae33783a-d875-442b-aead-1c8a8cae8f7c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.536179 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.536056 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae33783a-d875-442b-aead-1c8a8cae8f7c-serving-certs-ca-bundle\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.537274 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.537253 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ae33783a-d875-442b-aead-1c8a8cae8f7c-secret-telemeter-client\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.537598 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.537566 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ae33783a-d875-442b-aead-1c8a8cae8f7c-telemeter-client-tls\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.537719 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.537698 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ae33783a-d875-442b-aead-1c8a8cae8f7c-federate-client-tls\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.537907 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.537890 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae33783a-d875-442b-aead-1c8a8cae8f7c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.543707 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.543680 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk85c\" (UniqueName: \"kubernetes.io/projected/ae33783a-d875-442b-aead-1c8a8cae8f7c-kube-api-access-zk85c\") pod \"telemeter-client-7699c84f46-cxjl2\" (UID: \"ae33783a-d875-442b-aead-1c8a8cae8f7c\") " pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.670408 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.670383 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" Jun 09 08:04:04.832132 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:04.831813 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7699c84f46-cxjl2"] Jun 09 08:04:04.835653 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:04:04.835622 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae33783a_d875_442b_aead_1c8a8cae8f7c.slice/crio-6098c8b86a09e02e916dd89ccf4f4d33cf4df9f1da95a397bdcdd8d69c607b0a WatchSource:0}: Error finding container 6098c8b86a09e02e916dd89ccf4f4d33cf4df9f1da95a397bdcdd8d69c607b0a: Status 404 returned error can't find the container with id 6098c8b86a09e02e916dd89ccf4f4d33cf4df9f1da95a397bdcdd8d69c607b0a Jun 09 08:04:05.112176 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:05.112087 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" event={"ID":"ae33783a-d875-442b-aead-1c8a8cae8f7c","Type":"ContainerStarted","Data":"6098c8b86a09e02e916dd89ccf4f4d33cf4df9f1da95a397bdcdd8d69c607b0a"} Jun 09 08:04:05.646206 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:05.646143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 08:04:05.648744 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:05.648716 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cc82d46-ff16-4d56-a54a-4d8283ab6d5a-metrics-certs\") pod \"network-metrics-daemon-fpbq7\" (UID: \"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a\") " pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 08:04:05.790950 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:05.790903 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n7k9q\"" Jun 09 08:04:05.798065 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:05.798041 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpbq7" Jun 09 08:04:06.080339 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:06.080315 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fpbq7"] Jun 09 08:04:06.082443 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:04:06.082406 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc82d46_ff16_4d56_a54a_4d8283ab6d5a.slice/crio-f35d9936ee1ae83a31f7901d519c6080c786f6bf4068a5ac5dc8ad2d1b8cbc82 WatchSource:0}: Error finding container f35d9936ee1ae83a31f7901d519c6080c786f6bf4068a5ac5dc8ad2d1b8cbc82: Status 404 returned error can't find the container with id f35d9936ee1ae83a31f7901d519c6080c786f6bf4068a5ac5dc8ad2d1b8cbc82 Jun 09 08:04:06.118662 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:06.118638 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbff46be-bf42-4cb0-83a8-e34171a6c72c","Type":"ContainerStarted","Data":"38aa2604fae18f20fa3abbe5092f99ed8e005142b0cc8c6208612fbe19a55010"} Jun 09 08:04:06.118986 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:06.118714 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbff46be-bf42-4cb0-83a8-e34171a6c72c","Type":"ContainerStarted","Data":"95816cd4c07ddddacb4d47d4e93201cbb7dea95a2a98bab9008cda4f5fbc00ec"} Jun 09 08:04:06.119848 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:06.119817 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fpbq7" event={"ID":"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a","Type":"ContainerStarted","Data":"f35d9936ee1ae83a31f7901d519c6080c786f6bf4068a5ac5dc8ad2d1b8cbc82"} Jun 09 08:04:07.127313 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:07.127282 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbff46be-bf42-4cb0-83a8-e34171a6c72c","Type":"ContainerStarted","Data":"1b84de756f2fe767260a0fb77bf50e9c5896f157fd578c17f35a23fd5858b74c"} Jun 09 08:04:07.127743 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:07.127344 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbff46be-bf42-4cb0-83a8-e34171a6c72c","Type":"ContainerStarted","Data":"06d5bc543005277f5ea427529c7cfaf7849330430399ee6a4e0c05363f8322eb"} Jun 09 08:04:07.127743 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:07.127370 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbff46be-bf42-4cb0-83a8-e34171a6c72c","Type":"ContainerStarted","Data":"5e9c6de210b62c3e77bda6e1c5e830741e1cdd9a5b1f191f3303b78200975a21"} Jun 09 08:04:07.127743 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:07.127395 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbff46be-bf42-4cb0-83a8-e34171a6c72c","Type":"ContainerStarted","Data":"b3af5f08e7a84dd9ec1f39edbc9246d230b8a8d92494e27fe25a23e3b4752c5a"} Jun 09 08:04:07.160330 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:07.160276 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.287458211 podStartE2EDuration="5.160258004s" totalImagesPullingTime="2.856509977s" totalInitContainerRuntime="16.289816ms" isStatefulPod=false podCreationTimestamp="2026-06-09 08:04:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:04:07.159043711 +0000 UTC m=+374.828889727" watchObservedRunningTime="2026-06-09 08:04:07.160258004 +0000 UTC m=+374.830104022" Jun 09 08:04:08.133721 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:08.133682 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" event={"ID":"ae33783a-d875-442b-aead-1c8a8cae8f7c","Type":"ContainerStarted","Data":"2f52e6182b57511e6facd76f0bbb5c06b17567873350d9bce2e8fad4ee3c89c3"} Jun 09 08:04:08.134169 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:08.133745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" event={"ID":"ae33783a-d875-442b-aead-1c8a8cae8f7c","Type":"ContainerStarted","Data":"33babd147065b629fdaf11e0bd8ffe35563a0d0c616eb823e1a1868b65d013ca"} Jun 09 08:04:08.134169 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:08.133766 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" event={"ID":"ae33783a-d875-442b-aead-1c8a8cae8f7c","Type":"ContainerStarted","Data":"f219584a3bfef1a478c12af2237f2fc5af43137484bdc760c00cdec4f77a0bfc"} Jun 09 08:04:08.135401 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:08.135369 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fpbq7" event={"ID":"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a","Type":"ContainerStarted","Data":"7dc147d8e41a001a29be22515a77c79b3a0308e439918a04637d824e1f4eef6c"} Jun 09 08:04:08.135533 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:08.135413 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fpbq7" event={"ID":"2cc82d46-ff16-4d56-a54a-4d8283ab6d5a","Type":"ContainerStarted","Data":"e623588fbeee90655dbb6d1f71fc22774f313447445e0be9be0f920f2be2ec11"} Jun 09 08:04:08.161789 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:08.161749 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7699c84f46-cxjl2" podStartSLOduration=1.675815303 podStartE2EDuration="4.161734352s" totalImagesPullingTime="2.485919049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:04:08.160668094 +0000 UTC m=+375.830514111" watchObservedRunningTime="2026-06-09 08:04:08.161734352 +0000 UTC m=+375.831580367" Jun 09 08:04:08.178655 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:08.178618 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fpbq7" podStartSLOduration=373.943582676 podStartE2EDuration="6m15.17860531s" totalImagesPullingTime="1.235022634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 07:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:04:08.177457189 +0000 UTC m=+375.847303207" watchObservedRunningTime="2026-06-09 08:04:08.17860531 +0000 UTC m=+375.848451322" Jun 09 08:04:08.940914 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:08.940880 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7db7f978c4-kq55j"] Jun 09 08:04:08.943615 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:08.943591 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:08.955077 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:08.955053 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db7f978c4-kq55j"] Jun 09 08:04:09.076419 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.076393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e96efa1-015f-49cc-9cda-07c7d370d587-console-oauth-config\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.076561 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.076431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-oauth-serving-cert\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.076561 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.076454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e96efa1-015f-49cc-9cda-07c7d370d587-console-serving-cert\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.076561 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.076477 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-service-ca\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.076561 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.076546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-console-config\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.076689 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.076568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-trusted-ca-bundle\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.076689 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.076589 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkwqb\" (UniqueName: \"kubernetes.io/projected/7e96efa1-015f-49cc-9cda-07c7d370d587-kube-api-access-gkwqb\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.177625 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.177595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-oauth-serving-cert\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.178011 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.177628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e96efa1-015f-49cc-9cda-07c7d370d587-console-serving-cert\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.178011 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.177649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-service-ca\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.178011 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.177695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-console-config\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.178011 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.177721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-trusted-ca-bundle\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.178011 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.177751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkwqb\" (UniqueName: \"kubernetes.io/projected/7e96efa1-015f-49cc-9cda-07c7d370d587-kube-api-access-gkwqb\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.178011 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.177800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e96efa1-015f-49cc-9cda-07c7d370d587-console-oauth-config\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.178442 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.178413 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-service-ca\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.178507 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.178460 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-oauth-serving-cert\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.178507 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.178486 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-console-config\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.178590 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.178573 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-trusted-ca-bundle\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.180214 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.180187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e96efa1-015f-49cc-9cda-07c7d370d587-console-oauth-config\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.180214 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.180198 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e96efa1-015f-49cc-9cda-07c7d370d587-console-serving-cert\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.186542 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.186508 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkwqb\" (UniqueName: \"kubernetes.io/projected/7e96efa1-015f-49cc-9cda-07c7d370d587-kube-api-access-gkwqb\") pod \"console-7db7f978c4-kq55j\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.255827 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.255768 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:09.378808 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:09.378784 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7db7f978c4-kq55j"] Jun 09 08:04:09.381010 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:04:09.380988 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e96efa1_015f_49cc_9cda_07c7d370d587.slice/crio-e444ea54f978c170aee305c61a755fe2a39264de13a2567a1f9f87ad33e6662a WatchSource:0}: Error finding container e444ea54f978c170aee305c61a755fe2a39264de13a2567a1f9f87ad33e6662a: Status 404 returned error can't find the container with id e444ea54f978c170aee305c61a755fe2a39264de13a2567a1f9f87ad33e6662a Jun 09 08:04:10.145360 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:10.145323 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db7f978c4-kq55j" event={"ID":"7e96efa1-015f-49cc-9cda-07c7d370d587","Type":"ContainerStarted","Data":"43662b252439b849c65b02b9f4c7fb3864ecd75546a2d5bd1b0fda9071fc095a"} Jun 09 08:04:10.145528 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:10.145379 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db7f978c4-kq55j" event={"ID":"7e96efa1-015f-49cc-9cda-07c7d370d587","Type":"ContainerStarted","Data":"e444ea54f978c170aee305c61a755fe2a39264de13a2567a1f9f87ad33e6662a"} Jun 09 08:04:10.167649 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:10.167597 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7db7f978c4-kq55j" podStartSLOduration=2.167583781 podStartE2EDuration="2.167583781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:04:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:04:10.166167496 +0000 UTC m=+377.836013512" watchObservedRunningTime="2026-06-09 08:04:10.167583781 +0000 UTC m=+377.837429796" Jun 09 08:04:19.256152 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:19.256098 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:19.256578 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:19.256179 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:19.260837 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:19.260811 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:20.188463 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:20.188437 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:04:20.241076 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:20.241040 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c897fcfb-qgqf4"] Jun 09 08:04:45.262730 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.262667 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64c897fcfb-qgqf4" podUID="a40ea3bf-a778-4c70-b82b-fa4bc4a16b31" containerName="console" containerID="cri-o://5f43aa95794f56f51a485c97062d50d0ebd0dbf87fea02724656a86fcff5f250" gracePeriod=15 Jun 09 08:04:45.522539 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.522485 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:04:45.595275 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.595248 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-oauth-config\") pod \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " Jun 09 08:04:45.595275 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.595277 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-trusted-ca-bundle\") pod \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " Jun 09 08:04:45.595483 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.595323 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-oauth-serving-cert\") pod \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " Jun 09 08:04:45.595483 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.595340 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-serving-cert\") pod \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " Jun 09 08:04:45.595483 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.595359 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-service-ca\") pod \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " Jun 09 08:04:45.595645 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.595482 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-config\") pod \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " Jun 09 08:04:45.595645 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.595527 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrxrm\" (UniqueName: \"kubernetes.io/projected/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-kube-api-access-zrxrm\") pod \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\" (UID: \"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31\") " Jun 09 08:04:45.595788 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.595749 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a40ea3bf-a778-4c70-b82b-fa4bc4a16b31" (UID: "a40ea3bf-a778-4c70-b82b-fa4bc4a16b31"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:04:45.595864 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.595810 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a40ea3bf-a778-4c70-b82b-fa4bc4a16b31" (UID: "a40ea3bf-a778-4c70-b82b-fa4bc4a16b31"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:04:45.595864 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.595820 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-service-ca" (OuterVolumeSpecName: "service-ca") pod "a40ea3bf-a778-4c70-b82b-fa4bc4a16b31" (UID: "a40ea3bf-a778-4c70-b82b-fa4bc4a16b31"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:04:45.595979 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.595867 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-oauth-serving-cert\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:04:45.595979 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.595877 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-config" (OuterVolumeSpecName: "console-config") pod "a40ea3bf-a778-4c70-b82b-fa4bc4a16b31" (UID: "a40ea3bf-a778-4c70-b82b-fa4bc4a16b31"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:04:45.597396 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.597372 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a40ea3bf-a778-4c70-b82b-fa4bc4a16b31" (UID: "a40ea3bf-a778-4c70-b82b-fa4bc4a16b31"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:04:45.597489 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.597394 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a40ea3bf-a778-4c70-b82b-fa4bc4a16b31" (UID: "a40ea3bf-a778-4c70-b82b-fa4bc4a16b31"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:04:45.597562 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.597546 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-kube-api-access-zrxrm" (OuterVolumeSpecName: "kube-api-access-zrxrm") pod "a40ea3bf-a778-4c70-b82b-fa4bc4a16b31" (UID: "a40ea3bf-a778-4c70-b82b-fa4bc4a16b31"). InnerVolumeSpecName "kube-api-access-zrxrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:04:45.697113 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.697083 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-service-ca\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:04:45.697113 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.697106 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:04:45.697113 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.697116 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrxrm\" (UniqueName: \"kubernetes.io/projected/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-kube-api-access-zrxrm\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:04:45.697320 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.697125 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-oauth-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:04:45.697320 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.697133 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-trusted-ca-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:04:45.697320 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:45.697141 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31-console-serving-cert\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:04:46.292156 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:46.292123 2577 generic.go:356] "Generic (PLEG): container finished" podID="a40ea3bf-a778-4c70-b82b-fa4bc4a16b31" containerID="5f43aa95794f56f51a485c97062d50d0ebd0dbf87fea02724656a86fcff5f250" exitCode=0 Jun 09 08:04:46.292556 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:46.292170 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c897fcfb-qgqf4" Jun 09 08:04:46.292556 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:46.292180 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c897fcfb-qgqf4" event={"ID":"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31","Type":"ContainerDied","Data":"5f43aa95794f56f51a485c97062d50d0ebd0dbf87fea02724656a86fcff5f250"} Jun 09 08:04:46.292556 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:46.292219 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c897fcfb-qgqf4" event={"ID":"a40ea3bf-a778-4c70-b82b-fa4bc4a16b31","Type":"ContainerDied","Data":"79b20f0fffd5696babaf6ad7a6790535f9719ed7e924d6376b0cc5f709b2ce62"} Jun 09 08:04:46.292556 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:46.292239 2577 scope.go:117] "RemoveContainer" containerID="5f43aa95794f56f51a485c97062d50d0ebd0dbf87fea02724656a86fcff5f250" Jun 09 08:04:46.301222 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:46.301201 2577 scope.go:117] "RemoveContainer" containerID="5f43aa95794f56f51a485c97062d50d0ebd0dbf87fea02724656a86fcff5f250" Jun 09 08:04:46.301481 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:04:46.301459 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f43aa95794f56f51a485c97062d50d0ebd0dbf87fea02724656a86fcff5f250\": container with ID starting with 5f43aa95794f56f51a485c97062d50d0ebd0dbf87fea02724656a86fcff5f250 not found: ID does not exist" containerID="5f43aa95794f56f51a485c97062d50d0ebd0dbf87fea02724656a86fcff5f250" Jun 09 08:04:46.301548 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:46.301489 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f43aa95794f56f51a485c97062d50d0ebd0dbf87fea02724656a86fcff5f250"} err="failed to get container status \"5f43aa95794f56f51a485c97062d50d0ebd0dbf87fea02724656a86fcff5f250\": rpc error: code = NotFound desc = could not find container \"5f43aa95794f56f51a485c97062d50d0ebd0dbf87fea02724656a86fcff5f250\": container with ID starting with 5f43aa95794f56f51a485c97062d50d0ebd0dbf87fea02724656a86fcff5f250 not found: ID does not exist" Jun 09 08:04:46.313241 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:46.313217 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c897fcfb-qgqf4"] Jun 09 08:04:46.321466 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:46.321439 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64c897fcfb-qgqf4"] Jun 09 08:04:46.790499 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:04:46.790462 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a40ea3bf-a778-4c70-b82b-fa4bc4a16b31" path="/var/lib/kubelet/pods/a40ea3bf-a778-4c70-b82b-fa4bc4a16b31/volumes" Jun 09 08:05:23.416212 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.416132 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fc98bf97d-rsbq4"] Jun 09 08:05:23.416744 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.416509 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a40ea3bf-a778-4c70-b82b-fa4bc4a16b31" containerName="console" Jun 09 08:05:23.416744 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.416529 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a40ea3bf-a778-4c70-b82b-fa4bc4a16b31" containerName="console" Jun 09 08:05:23.416744 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.416612 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a40ea3bf-a778-4c70-b82b-fa4bc4a16b31" containerName="console" Jun 09 08:05:23.419961 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.419940 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.430982 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.430961 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fc98bf97d-rsbq4"] Jun 09 08:05:23.496162 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.496138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51a13358-02db-4abc-a339-7734b84f11f0-console-serving-cert\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.496289 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.496195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-service-ca\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.496289 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.496220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-oauth-serving-cert\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.496289 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.496240 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpcvj\" (UniqueName: \"kubernetes.io/projected/51a13358-02db-4abc-a339-7734b84f11f0-kube-api-access-tpcvj\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.496289 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.496257 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51a13358-02db-4abc-a339-7734b84f11f0-console-oauth-config\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.496289 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.496272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-console-config\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.496477 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.496318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-trusted-ca-bundle\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.597247 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.597207 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-service-ca\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.597438 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.597256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-oauth-serving-cert\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.597438 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.597286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpcvj\" (UniqueName: \"kubernetes.io/projected/51a13358-02db-4abc-a339-7734b84f11f0-kube-api-access-tpcvj\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.597438 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.597309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51a13358-02db-4abc-a339-7734b84f11f0-console-oauth-config\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.597438 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.597329 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-console-config\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.597438 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.597349 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-trusted-ca-bundle\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.597438 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.597391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51a13358-02db-4abc-a339-7734b84f11f0-console-serving-cert\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.598035 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.598000 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-service-ca\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.598150 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.598089 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-oauth-serving-cert\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.598150 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.598133 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-console-config\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.598261 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.598183 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-trusted-ca-bundle\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.599851 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.599820 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51a13358-02db-4abc-a339-7734b84f11f0-console-oauth-config\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.600000 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.599986 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51a13358-02db-4abc-a339-7734b84f11f0-console-serving-cert\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.608781 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.608759 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpcvj\" (UniqueName: \"kubernetes.io/projected/51a13358-02db-4abc-a339-7734b84f11f0-kube-api-access-tpcvj\") pod \"console-7fc98bf97d-rsbq4\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.730254 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.730215 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:23.860460 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:23.860430 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fc98bf97d-rsbq4"] Jun 09 08:05:23.864119 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:05:23.864081 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a13358_02db_4abc_a339_7734b84f11f0.slice/crio-651474e8c8beb75ceee54278bcfc3954cf92629c0a6b57f3d51d7ec0f665bbad WatchSource:0}: Error finding container 651474e8c8beb75ceee54278bcfc3954cf92629c0a6b57f3d51d7ec0f665bbad: Status 404 returned error can't find the container with id 651474e8c8beb75ceee54278bcfc3954cf92629c0a6b57f3d51d7ec0f665bbad Jun 09 08:05:24.443944 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:24.443908 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fc98bf97d-rsbq4" event={"ID":"51a13358-02db-4abc-a339-7734b84f11f0","Type":"ContainerStarted","Data":"f05da067080d5a214150cbe67c989147d605c78f9275c15b47a248e7d80c6839"} Jun 09 08:05:24.444319 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:24.443972 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fc98bf97d-rsbq4" event={"ID":"51a13358-02db-4abc-a339-7734b84f11f0","Type":"ContainerStarted","Data":"651474e8c8beb75ceee54278bcfc3954cf92629c0a6b57f3d51d7ec0f665bbad"} Jun 09 08:05:24.464105 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:24.464058 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fc98bf97d-rsbq4" podStartSLOduration=1.4640432859999999 podStartE2EDuration="1.464043286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:05:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:05:24.461728583 +0000 UTC m=+452.131574599" watchObservedRunningTime="2026-06-09 08:05:24.464043286 +0000 UTC m=+452.133889301" Jun 09 08:05:33.731007 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:33.730971 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:33.731390 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:33.731029 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:33.735905 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:33.735882 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:34.486114 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:34.486088 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:05:34.536481 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:34.536451 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7db7f978c4-kq55j"] Jun 09 08:05:59.559777 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.559717 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7db7f978c4-kq55j" podUID="7e96efa1-015f-49cc-9cda-07c7d370d587" containerName="console" containerID="cri-o://43662b252439b849c65b02b9f4c7fb3864ecd75546a2d5bd1b0fda9071fc095a" gracePeriod=15 Jun 09 08:05:59.799232 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.799210 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:05:59.862966 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.862891 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e96efa1-015f-49cc-9cda-07c7d370d587-console-oauth-config\") pod \"7e96efa1-015f-49cc-9cda-07c7d370d587\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " Jun 09 08:05:59.863084 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.862962 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-console-config\") pod \"7e96efa1-015f-49cc-9cda-07c7d370d587\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " Jun 09 08:05:59.863084 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.862996 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-trusted-ca-bundle\") pod \"7e96efa1-015f-49cc-9cda-07c7d370d587\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " Jun 09 08:05:59.863084 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.863022 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkwqb\" (UniqueName: \"kubernetes.io/projected/7e96efa1-015f-49cc-9cda-07c7d370d587-kube-api-access-gkwqb\") pod \"7e96efa1-015f-49cc-9cda-07c7d370d587\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " Jun 09 08:05:59.863247 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.863094 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-service-ca\") pod \"7e96efa1-015f-49cc-9cda-07c7d370d587\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " Jun 09 08:05:59.863247 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.863129 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e96efa1-015f-49cc-9cda-07c7d370d587-console-serving-cert\") pod \"7e96efa1-015f-49cc-9cda-07c7d370d587\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " Jun 09 08:05:59.863247 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.863157 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-oauth-serving-cert\") pod \"7e96efa1-015f-49cc-9cda-07c7d370d587\" (UID: \"7e96efa1-015f-49cc-9cda-07c7d370d587\") " Jun 09 08:05:59.863432 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.863408 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7e96efa1-015f-49cc-9cda-07c7d370d587" (UID: "7e96efa1-015f-49cc-9cda-07c7d370d587"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:05:59.863495 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.863418 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-console-config" (OuterVolumeSpecName: "console-config") pod "7e96efa1-015f-49cc-9cda-07c7d370d587" (UID: "7e96efa1-015f-49cc-9cda-07c7d370d587"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:05:59.863495 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.863454 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-service-ca" (OuterVolumeSpecName: "service-ca") pod "7e96efa1-015f-49cc-9cda-07c7d370d587" (UID: "7e96efa1-015f-49cc-9cda-07c7d370d587"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:05:59.863663 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.863633 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7e96efa1-015f-49cc-9cda-07c7d370d587" (UID: "7e96efa1-015f-49cc-9cda-07c7d370d587"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:05:59.865068 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.865043 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e96efa1-015f-49cc-9cda-07c7d370d587-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7e96efa1-015f-49cc-9cda-07c7d370d587" (UID: "7e96efa1-015f-49cc-9cda-07c7d370d587"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:05:59.865158 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.865140 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e96efa1-015f-49cc-9cda-07c7d370d587-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7e96efa1-015f-49cc-9cda-07c7d370d587" (UID: "7e96efa1-015f-49cc-9cda-07c7d370d587"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:05:59.865311 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.865296 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e96efa1-015f-49cc-9cda-07c7d370d587-kube-api-access-gkwqb" (OuterVolumeSpecName: "kube-api-access-gkwqb") pod "7e96efa1-015f-49cc-9cda-07c7d370d587" (UID: "7e96efa1-015f-49cc-9cda-07c7d370d587"). InnerVolumeSpecName "kube-api-access-gkwqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:05:59.963757 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.963735 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-service-ca\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:05:59.963757 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.963756 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e96efa1-015f-49cc-9cda-07c7d370d587-console-serving-cert\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:05:59.963874 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.963765 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-oauth-serving-cert\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:05:59.963874 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.963775 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7e96efa1-015f-49cc-9cda-07c7d370d587-console-oauth-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:05:59.963874 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.963783 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-console-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:05:59.963874 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.963791 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e96efa1-015f-49cc-9cda-07c7d370d587-trusted-ca-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:05:59.963874 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:05:59.963799 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkwqb\" (UniqueName: \"kubernetes.io/projected/7e96efa1-015f-49cc-9cda-07c7d370d587-kube-api-access-gkwqb\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:06:00.584471 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:00.584442 2577 generic.go:356] "Generic (PLEG): container finished" podID="7e96efa1-015f-49cc-9cda-07c7d370d587" containerID="43662b252439b849c65b02b9f4c7fb3864ecd75546a2d5bd1b0fda9071fc095a" exitCode=0 Jun 09 08:06:00.584965 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:00.584495 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7db7f978c4-kq55j" Jun 09 08:06:00.584965 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:00.584538 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db7f978c4-kq55j" event={"ID":"7e96efa1-015f-49cc-9cda-07c7d370d587","Type":"ContainerDied","Data":"43662b252439b849c65b02b9f4c7fb3864ecd75546a2d5bd1b0fda9071fc095a"} Jun 09 08:06:00.584965 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:00.584593 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7db7f978c4-kq55j" event={"ID":"7e96efa1-015f-49cc-9cda-07c7d370d587","Type":"ContainerDied","Data":"e444ea54f978c170aee305c61a755fe2a39264de13a2567a1f9f87ad33e6662a"} Jun 09 08:06:00.584965 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:00.584616 2577 scope.go:117] "RemoveContainer" containerID="43662b252439b849c65b02b9f4c7fb3864ecd75546a2d5bd1b0fda9071fc095a" Jun 09 08:06:00.593138 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:00.593122 2577 scope.go:117] "RemoveContainer" containerID="43662b252439b849c65b02b9f4c7fb3864ecd75546a2d5bd1b0fda9071fc095a" Jun 09 08:06:00.593383 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:06:00.593366 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43662b252439b849c65b02b9f4c7fb3864ecd75546a2d5bd1b0fda9071fc095a\": container with ID starting with 43662b252439b849c65b02b9f4c7fb3864ecd75546a2d5bd1b0fda9071fc095a not found: ID does not exist" containerID="43662b252439b849c65b02b9f4c7fb3864ecd75546a2d5bd1b0fda9071fc095a" Jun 09 08:06:00.593436 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:00.593389 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43662b252439b849c65b02b9f4c7fb3864ecd75546a2d5bd1b0fda9071fc095a"} err="failed to get container status \"43662b252439b849c65b02b9f4c7fb3864ecd75546a2d5bd1b0fda9071fc095a\": rpc error: code = NotFound desc = could not find container \"43662b252439b849c65b02b9f4c7fb3864ecd75546a2d5bd1b0fda9071fc095a\": container with ID starting with 43662b252439b849c65b02b9f4c7fb3864ecd75546a2d5bd1b0fda9071fc095a not found: ID does not exist" Jun 09 08:06:00.606080 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:00.606056 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7db7f978c4-kq55j"] Jun 09 08:06:00.609769 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:00.609749 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7db7f978c4-kq55j"] Jun 09 08:06:00.790071 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:00.790046 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e96efa1-015f-49cc-9cda-07c7d370d587" path="/var/lib/kubelet/pods/7e96efa1-015f-49cc-9cda-07c7d370d587/volumes" Jun 09 08:06:30.129504 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.129470 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc"] Jun 09 08:06:30.129988 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.129782 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e96efa1-015f-49cc-9cda-07c7d370d587" containerName="console" Jun 09 08:06:30.129988 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.129792 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e96efa1-015f-49cc-9cda-07c7d370d587" containerName="console" Jun 09 08:06:30.129988 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.129840 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e96efa1-015f-49cc-9cda-07c7d370d587" containerName="console" Jun 09 08:06:30.132948 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.132918 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" Jun 09 08:06:30.135584 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.135560 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 08:06:30.135707 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.135584 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 08:06:30.136600 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.136584 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gmtrs\"" Jun 09 08:06:30.142031 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.142007 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc"] Jun 09 08:06:30.303213 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.303181 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2358ccfb-860d-466f-b694-2d5bad84cc0c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc\" (UID: \"2358ccfb-860d-466f-b694-2d5bad84cc0c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" Jun 09 08:06:30.303213 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.303214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2358ccfb-860d-466f-b694-2d5bad84cc0c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc\" (UID: \"2358ccfb-860d-466f-b694-2d5bad84cc0c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" Jun 09 08:06:30.303385 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.303238 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg2cf\" (UniqueName: \"kubernetes.io/projected/2358ccfb-860d-466f-b694-2d5bad84cc0c-kube-api-access-rg2cf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc\" (UID: \"2358ccfb-860d-466f-b694-2d5bad84cc0c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" Jun 09 08:06:30.404513 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.404455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2358ccfb-860d-466f-b694-2d5bad84cc0c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc\" (UID: \"2358ccfb-860d-466f-b694-2d5bad84cc0c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" Jun 09 08:06:30.404513 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.404487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2358ccfb-860d-466f-b694-2d5bad84cc0c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc\" (UID: \"2358ccfb-860d-466f-b694-2d5bad84cc0c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" Jun 09 08:06:30.404658 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.404518 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg2cf\" (UniqueName: \"kubernetes.io/projected/2358ccfb-860d-466f-b694-2d5bad84cc0c-kube-api-access-rg2cf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc\" (UID: \"2358ccfb-860d-466f-b694-2d5bad84cc0c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" Jun 09 08:06:30.404794 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.404775 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2358ccfb-860d-466f-b694-2d5bad84cc0c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc\" (UID: \"2358ccfb-860d-466f-b694-2d5bad84cc0c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" Jun 09 08:06:30.404854 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.404810 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2358ccfb-860d-466f-b694-2d5bad84cc0c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc\" (UID: \"2358ccfb-860d-466f-b694-2d5bad84cc0c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" Jun 09 08:06:30.412679 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.412652 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg2cf\" (UniqueName: \"kubernetes.io/projected/2358ccfb-860d-466f-b694-2d5bad84cc0c-kube-api-access-rg2cf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc\" (UID: \"2358ccfb-860d-466f-b694-2d5bad84cc0c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" Jun 09 08:06:30.443488 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.443467 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" Jun 09 08:06:30.570650 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.570623 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc"] Jun 09 08:06:30.573854 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:06:30.573818 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2358ccfb_860d_466f_b694_2d5bad84cc0c.slice/crio-f6e6d624cdb3835bb4bd46a2b156e905fb6cac24af8b43d045dbc02c360cbfa7 WatchSource:0}: Error finding container f6e6d624cdb3835bb4bd46a2b156e905fb6cac24af8b43d045dbc02c360cbfa7: Status 404 returned error can't find the container with id f6e6d624cdb3835bb4bd46a2b156e905fb6cac24af8b43d045dbc02c360cbfa7 Jun 09 08:06:30.705383 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:30.705359 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" event={"ID":"2358ccfb-860d-466f-b694-2d5bad84cc0c","Type":"ContainerStarted","Data":"f6e6d624cdb3835bb4bd46a2b156e905fb6cac24af8b43d045dbc02c360cbfa7"} Jun 09 08:06:40.750688 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:40.750653 2577 generic.go:356] "Generic (PLEG): container finished" podID="2358ccfb-860d-466f-b694-2d5bad84cc0c" containerID="2beeb19c0159ca8bee665aa92426465ae7662ce55a56db3eca5234db85dd7655" exitCode=0 Jun 09 08:06:40.751032 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:40.750731 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" event={"ID":"2358ccfb-860d-466f-b694-2d5bad84cc0c","Type":"ContainerDied","Data":"2beeb19c0159ca8bee665aa92426465ae7662ce55a56db3eca5234db85dd7655"} Jun 09 08:06:42.761420 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:42.761382 2577 generic.go:356] "Generic (PLEG): container finished" podID="2358ccfb-860d-466f-b694-2d5bad84cc0c" containerID="5d927b5ec4f9a641995583ab70b53b80f1ecd409903490c4e7ab4299eaab4fe2" exitCode=0 Jun 09 08:06:42.761850 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:42.761468 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" event={"ID":"2358ccfb-860d-466f-b694-2d5bad84cc0c","Type":"ContainerDied","Data":"5d927b5ec4f9a641995583ab70b53b80f1ecd409903490c4e7ab4299eaab4fe2"} Jun 09 08:06:49.795231 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:49.795192 2577 generic.go:356] "Generic (PLEG): container finished" podID="2358ccfb-860d-466f-b694-2d5bad84cc0c" containerID="29ab52438c78abda6836d4a03f6f8e2ea6843cacdd46c8a14af309c49e41e1ef" exitCode=0 Jun 09 08:06:49.795641 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:49.795245 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" event={"ID":"2358ccfb-860d-466f-b694-2d5bad84cc0c","Type":"ContainerDied","Data":"29ab52438c78abda6836d4a03f6f8e2ea6843cacdd46c8a14af309c49e41e1ef"} Jun 09 08:06:50.926793 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:50.926761 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" Jun 09 08:06:50.969102 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:50.969074 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2358ccfb-860d-466f-b694-2d5bad84cc0c-util\") pod \"2358ccfb-860d-466f-b694-2d5bad84cc0c\" (UID: \"2358ccfb-860d-466f-b694-2d5bad84cc0c\") " Jun 09 08:06:50.969255 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:50.969200 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg2cf\" (UniqueName: \"kubernetes.io/projected/2358ccfb-860d-466f-b694-2d5bad84cc0c-kube-api-access-rg2cf\") pod \"2358ccfb-860d-466f-b694-2d5bad84cc0c\" (UID: \"2358ccfb-860d-466f-b694-2d5bad84cc0c\") " Jun 09 08:06:50.969255 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:50.969248 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2358ccfb-860d-466f-b694-2d5bad84cc0c-bundle\") pod \"2358ccfb-860d-466f-b694-2d5bad84cc0c\" (UID: \"2358ccfb-860d-466f-b694-2d5bad84cc0c\") " Jun 09 08:06:50.969986 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:50.969965 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2358ccfb-860d-466f-b694-2d5bad84cc0c-bundle" (OuterVolumeSpecName: "bundle") pod "2358ccfb-860d-466f-b694-2d5bad84cc0c" (UID: "2358ccfb-860d-466f-b694-2d5bad84cc0c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:06:50.971398 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:50.971375 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2358ccfb-860d-466f-b694-2d5bad84cc0c-kube-api-access-rg2cf" (OuterVolumeSpecName: "kube-api-access-rg2cf") pod "2358ccfb-860d-466f-b694-2d5bad84cc0c" (UID: "2358ccfb-860d-466f-b694-2d5bad84cc0c"). InnerVolumeSpecName "kube-api-access-rg2cf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:06:50.973427 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:50.973407 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2358ccfb-860d-466f-b694-2d5bad84cc0c-util" (OuterVolumeSpecName: "util") pod "2358ccfb-860d-466f-b694-2d5bad84cc0c" (UID: "2358ccfb-860d-466f-b694-2d5bad84cc0c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:06:51.070321 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:51.070251 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg2cf\" (UniqueName: \"kubernetes.io/projected/2358ccfb-860d-466f-b694-2d5bad84cc0c-kube-api-access-rg2cf\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:06:51.070321 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:51.070277 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2358ccfb-860d-466f-b694-2d5bad84cc0c-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:06:51.070321 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:51.070289 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2358ccfb-860d-466f-b694-2d5bad84cc0c-util\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:06:51.804597 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:51.804568 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" Jun 09 08:06:51.804597 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:51.804588 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dhkvxc" event={"ID":"2358ccfb-860d-466f-b694-2d5bad84cc0c","Type":"ContainerDied","Data":"f6e6d624cdb3835bb4bd46a2b156e905fb6cac24af8b43d045dbc02c360cbfa7"} Jun 09 08:06:51.804801 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:51.804626 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6e6d624cdb3835bb4bd46a2b156e905fb6cac24af8b43d045dbc02c360cbfa7" Jun 09 08:06:58.084490 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.084460 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-47grx"] Jun 09 08:06:58.084854 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.084765 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2358ccfb-860d-466f-b694-2d5bad84cc0c" containerName="extract" Jun 09 08:06:58.084854 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.084776 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2358ccfb-860d-466f-b694-2d5bad84cc0c" containerName="extract" Jun 09 08:06:58.084854 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.084789 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2358ccfb-860d-466f-b694-2d5bad84cc0c" containerName="util" Jun 09 08:06:58.084854 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.084795 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2358ccfb-860d-466f-b694-2d5bad84cc0c" containerName="util" Jun 09 08:06:58.084854 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.084806 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2358ccfb-860d-466f-b694-2d5bad84cc0c" containerName="pull" Jun 09 08:06:58.084854 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.084812 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2358ccfb-860d-466f-b694-2d5bad84cc0c" containerName="pull" Jun 09 08:06:58.085079 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.084865 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2358ccfb-860d-466f-b694-2d5bad84cc0c" containerName="extract" Jun 09 08:06:58.117733 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.117711 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-47grx"] Jun 09 08:06:58.117860 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.117791 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-47grx" Jun 09 08:06:58.120703 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.120683 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 08:06:58.120815 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.120684 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6mm2n\"" Jun 09 08:06:58.120875 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.120863 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 08:06:58.227554 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.227529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkr9p\" (UniqueName: \"kubernetes.io/projected/0130112d-4a94-4d6c-948c-b9a2c469b4ca-kube-api-access-vkr9p\") pod \"cert-manager-operator-controller-manager-57757f7cfc-47grx\" (UID: \"0130112d-4a94-4d6c-948c-b9a2c469b4ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-47grx" Jun 09 08:06:58.227667 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.227582 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0130112d-4a94-4d6c-948c-b9a2c469b4ca-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-47grx\" (UID: \"0130112d-4a94-4d6c-948c-b9a2c469b4ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-47grx" Jun 09 08:06:58.328784 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.328754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkr9p\" (UniqueName: \"kubernetes.io/projected/0130112d-4a94-4d6c-948c-b9a2c469b4ca-kube-api-access-vkr9p\") pod \"cert-manager-operator-controller-manager-57757f7cfc-47grx\" (UID: \"0130112d-4a94-4d6c-948c-b9a2c469b4ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-47grx" Jun 09 08:06:58.328891 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.328814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0130112d-4a94-4d6c-948c-b9a2c469b4ca-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-47grx\" (UID: \"0130112d-4a94-4d6c-948c-b9a2c469b4ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-47grx" Jun 09 08:06:58.329140 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.329124 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0130112d-4a94-4d6c-948c-b9a2c469b4ca-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-47grx\" (UID: \"0130112d-4a94-4d6c-948c-b9a2c469b4ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-47grx" Jun 09 08:06:58.339925 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.339878 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkr9p\" (UniqueName: \"kubernetes.io/projected/0130112d-4a94-4d6c-948c-b9a2c469b4ca-kube-api-access-vkr9p\") pod \"cert-manager-operator-controller-manager-57757f7cfc-47grx\" (UID: \"0130112d-4a94-4d6c-948c-b9a2c469b4ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-47grx" Jun 09 08:06:58.426512 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.426491 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-47grx" Jun 09 08:06:58.571763 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.571720 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-47grx"] Jun 09 08:06:58.573981 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:06:58.573954 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0130112d_4a94_4d6c_948c_b9a2c469b4ca.slice/crio-c2ddb7d2c2afabaf3f81bd537c18bee6979ed74c0ab5cad54741237fb179e19e WatchSource:0}: Error finding container c2ddb7d2c2afabaf3f81bd537c18bee6979ed74c0ab5cad54741237fb179e19e: Status 404 returned error can't find the container with id c2ddb7d2c2afabaf3f81bd537c18bee6979ed74c0ab5cad54741237fb179e19e Jun 09 08:06:58.831883 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:06:58.831855 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-47grx" event={"ID":"0130112d-4a94-4d6c-948c-b9a2c469b4ca","Type":"ContainerStarted","Data":"c2ddb7d2c2afabaf3f81bd537c18bee6979ed74c0ab5cad54741237fb179e19e"} Jun 09 08:07:00.842136 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:00.842101 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-47grx" event={"ID":"0130112d-4a94-4d6c-948c-b9a2c469b4ca","Type":"ContainerStarted","Data":"6a1f2e0c196958dce3062b13dd78654b1b427213222594db3fe3004ddc29c9b3"} Jun 09 08:07:00.863814 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:00.863759 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-47grx" podStartSLOduration=0.801950597 podStartE2EDuration="2.863742222s" totalImagesPullingTime="2.061791625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:06:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:07:00.861650211 +0000 UTC m=+548.531496226" watchObservedRunningTime="2026-06-09 08:07:00.863742222 +0000 UTC m=+548.533588236" Jun 09 08:07:01.811969 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:01.811922 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh"] Jun 09 08:07:01.835884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:01.835856 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" Jun 09 08:07:01.843194 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:01.843173 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 08:07:01.843646 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:01.843409 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 08:07:01.844341 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:01.844323 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gmtrs\"" Jun 09 08:07:01.847014 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:01.846992 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh"] Jun 09 08:07:01.959075 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:01.959040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j8s7\" (UniqueName: \"kubernetes.io/projected/bc976078-10a6-4ae9-995e-2e0786c5f89b-kube-api-access-7j8s7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh\" (UID: \"bc976078-10a6-4ae9-995e-2e0786c5f89b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" Jun 09 08:07:01.959231 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:01.959108 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc976078-10a6-4ae9-995e-2e0786c5f89b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh\" (UID: \"bc976078-10a6-4ae9-995e-2e0786c5f89b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" Jun 09 08:07:01.959231 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:01.959136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc976078-10a6-4ae9-995e-2e0786c5f89b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh\" (UID: \"bc976078-10a6-4ae9-995e-2e0786c5f89b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" Jun 09 08:07:02.059756 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:02.059721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc976078-10a6-4ae9-995e-2e0786c5f89b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh\" (UID: \"bc976078-10a6-4ae9-995e-2e0786c5f89b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" Jun 09 08:07:02.059756 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:02.059754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc976078-10a6-4ae9-995e-2e0786c5f89b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh\" (UID: \"bc976078-10a6-4ae9-995e-2e0786c5f89b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" Jun 09 08:07:02.059991 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:02.059810 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j8s7\" (UniqueName: \"kubernetes.io/projected/bc976078-10a6-4ae9-995e-2e0786c5f89b-kube-api-access-7j8s7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh\" (UID: \"bc976078-10a6-4ae9-995e-2e0786c5f89b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" Jun 09 08:07:02.060104 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:02.060086 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc976078-10a6-4ae9-995e-2e0786c5f89b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh\" (UID: \"bc976078-10a6-4ae9-995e-2e0786c5f89b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" Jun 09 08:07:02.060189 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:02.060171 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc976078-10a6-4ae9-995e-2e0786c5f89b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh\" (UID: \"bc976078-10a6-4ae9-995e-2e0786c5f89b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" Jun 09 08:07:02.070012 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:02.069957 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j8s7\" (UniqueName: \"kubernetes.io/projected/bc976078-10a6-4ae9-995e-2e0786c5f89b-kube-api-access-7j8s7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh\" (UID: \"bc976078-10a6-4ae9-995e-2e0786c5f89b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" Jun 09 08:07:02.146303 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:02.146280 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" Jun 09 08:07:02.296684 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:02.296567 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh"] Jun 09 08:07:02.299514 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:07:02.299485 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc976078_10a6_4ae9_995e_2e0786c5f89b.slice/crio-8b37ac6c681f934c59675bc244d15e7d0e974bf1400ee733f8fb47cb69b79931 WatchSource:0}: Error finding container 8b37ac6c681f934c59675bc244d15e7d0e974bf1400ee733f8fb47cb69b79931: Status 404 returned error can't find the container with id 8b37ac6c681f934c59675bc244d15e7d0e974bf1400ee733f8fb47cb69b79931 Jun 09 08:07:02.858565 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:02.858528 2577 generic.go:356] "Generic (PLEG): container finished" podID="bc976078-10a6-4ae9-995e-2e0786c5f89b" containerID="4d2dedd3c0ec80a838cbd4d5a64e392247bdb6c3a70a30b961b242b800311bb1" exitCode=0 Jun 09 08:07:02.859050 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:02.858590 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" event={"ID":"bc976078-10a6-4ae9-995e-2e0786c5f89b","Type":"ContainerDied","Data":"4d2dedd3c0ec80a838cbd4d5a64e392247bdb6c3a70a30b961b242b800311bb1"} Jun 09 08:07:02.859050 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:02.858649 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" event={"ID":"bc976078-10a6-4ae9-995e-2e0786c5f89b","Type":"ContainerStarted","Data":"8b37ac6c681f934c59675bc244d15e7d0e974bf1400ee733f8fb47cb69b79931"} Jun 09 08:07:03.653493 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:03.653461 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx"] Jun 09 08:07:03.675368 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:03.675336 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx"] Jun 09 08:07:03.675562 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:03.675430 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx" Jun 09 08:07:03.678254 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:03.678226 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 08:07:03.678379 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:03.678262 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 08:07:03.679402 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:03.679381 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-tbbsx\"" Jun 09 08:07:03.776337 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:03.776296 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b05f3b9-6f64-4d31-adf3-6f1be5f061ba-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5wqxx\" (UID: \"3b05f3b9-6f64-4d31-adf3-6f1be5f061ba\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx" Jun 09 08:07:03.776534 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:03.776410 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjqth\" (UniqueName: \"kubernetes.io/projected/3b05f3b9-6f64-4d31-adf3-6f1be5f061ba-kube-api-access-zjqth\") pod \"cert-manager-webhook-7dc76cbb94-5wqxx\" (UID: \"3b05f3b9-6f64-4d31-adf3-6f1be5f061ba\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx" Jun 09 08:07:03.877462 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:03.877428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b05f3b9-6f64-4d31-adf3-6f1be5f061ba-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5wqxx\" (UID: \"3b05f3b9-6f64-4d31-adf3-6f1be5f061ba\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx" Jun 09 08:07:03.877908 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:03.877518 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjqth\" (UniqueName: \"kubernetes.io/projected/3b05f3b9-6f64-4d31-adf3-6f1be5f061ba-kube-api-access-zjqth\") pod \"cert-manager-webhook-7dc76cbb94-5wqxx\" (UID: \"3b05f3b9-6f64-4d31-adf3-6f1be5f061ba\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx" Jun 09 08:07:03.890482 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:03.890459 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b05f3b9-6f64-4d31-adf3-6f1be5f061ba-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5wqxx\" (UID: \"3b05f3b9-6f64-4d31-adf3-6f1be5f061ba\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx" Jun 09 08:07:03.901383 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:03.901356 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjqth\" (UniqueName: \"kubernetes.io/projected/3b05f3b9-6f64-4d31-adf3-6f1be5f061ba-kube-api-access-zjqth\") pod \"cert-manager-webhook-7dc76cbb94-5wqxx\" (UID: \"3b05f3b9-6f64-4d31-adf3-6f1be5f061ba\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx" Jun 09 08:07:03.984997 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:03.984954 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx" Jun 09 08:07:04.109502 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:04.109478 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx"] Jun 09 08:07:04.111784 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:07:04.111760 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b05f3b9_6f64_4d31_adf3_6f1be5f061ba.slice/crio-f60ba21b3761fa0e438d0b5bc34d89e6c1bd3389ac51b14906738ffd6d1b452d WatchSource:0}: Error finding container f60ba21b3761fa0e438d0b5bc34d89e6c1bd3389ac51b14906738ffd6d1b452d: Status 404 returned error can't find the container with id f60ba21b3761fa0e438d0b5bc34d89e6c1bd3389ac51b14906738ffd6d1b452d Jun 09 08:07:04.868879 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:04.868847 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx" event={"ID":"3b05f3b9-6f64-4d31-adf3-6f1be5f061ba","Type":"ContainerStarted","Data":"f60ba21b3761fa0e438d0b5bc34d89e6c1bd3389ac51b14906738ffd6d1b452d"} Jun 09 08:07:06.879827 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:06.879795 2577 generic.go:356] "Generic (PLEG): container finished" podID="bc976078-10a6-4ae9-995e-2e0786c5f89b" containerID="7754b0f63a83767c8e025dd6a731ba1d215277308f2fa5262c37f32544919937" exitCode=0 Jun 09 08:07:06.880213 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:06.879899 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" event={"ID":"bc976078-10a6-4ae9-995e-2e0786c5f89b","Type":"ContainerDied","Data":"7754b0f63a83767c8e025dd6a731ba1d215277308f2fa5262c37f32544919937"} Jun 09 08:07:07.890763 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:07.890720 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx" event={"ID":"3b05f3b9-6f64-4d31-adf3-6f1be5f061ba","Type":"ContainerStarted","Data":"700b265a02680a549c3f35ccdb0864e22343ebf4659b2d5969612be21c5ddd3d"} Jun 09 08:07:07.891192 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:07.890853 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx" Jun 09 08:07:07.892749 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:07.892724 2577 generic.go:356] "Generic (PLEG): container finished" podID="bc976078-10a6-4ae9-995e-2e0786c5f89b" containerID="bd886df0977a50ec93616c8ea1e99b31f8d9907e4e4fb9dffeabdc17394a407e" exitCode=0 Jun 09 08:07:07.892816 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:07.892770 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" event={"ID":"bc976078-10a6-4ae9-995e-2e0786c5f89b","Type":"ContainerDied","Data":"bd886df0977a50ec93616c8ea1e99b31f8d9907e4e4fb9dffeabdc17394a407e"} Jun 09 08:07:07.907705 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:07.907659 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx" podStartSLOduration=1.291655869 podStartE2EDuration="4.907645714s" totalImagesPullingTime="3.615989845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:07:07.906364735 +0000 UTC m=+555.576210746" watchObservedRunningTime="2026-06-09 08:07:07.907645714 +0000 UTC m=+555.577491728" Jun 09 08:07:09.022017 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:09.021989 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" Jun 09 08:07:09.117853 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:09.117825 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc976078-10a6-4ae9-995e-2e0786c5f89b-util\") pod \"bc976078-10a6-4ae9-995e-2e0786c5f89b\" (UID: \"bc976078-10a6-4ae9-995e-2e0786c5f89b\") " Jun 09 08:07:09.118022 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:09.117868 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j8s7\" (UniqueName: \"kubernetes.io/projected/bc976078-10a6-4ae9-995e-2e0786c5f89b-kube-api-access-7j8s7\") pod \"bc976078-10a6-4ae9-995e-2e0786c5f89b\" (UID: \"bc976078-10a6-4ae9-995e-2e0786c5f89b\") " Jun 09 08:07:09.118022 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:09.117918 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc976078-10a6-4ae9-995e-2e0786c5f89b-bundle\") pod \"bc976078-10a6-4ae9-995e-2e0786c5f89b\" (UID: \"bc976078-10a6-4ae9-995e-2e0786c5f89b\") " Jun 09 08:07:09.118379 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:09.118349 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc976078-10a6-4ae9-995e-2e0786c5f89b-bundle" (OuterVolumeSpecName: "bundle") pod "bc976078-10a6-4ae9-995e-2e0786c5f89b" (UID: "bc976078-10a6-4ae9-995e-2e0786c5f89b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:07:09.119919 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:09.119895 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc976078-10a6-4ae9-995e-2e0786c5f89b-kube-api-access-7j8s7" (OuterVolumeSpecName: "kube-api-access-7j8s7") pod "bc976078-10a6-4ae9-995e-2e0786c5f89b" (UID: "bc976078-10a6-4ae9-995e-2e0786c5f89b"). InnerVolumeSpecName "kube-api-access-7j8s7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:07:09.122644 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:09.122624 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc976078-10a6-4ae9-995e-2e0786c5f89b-util" (OuterVolumeSpecName: "util") pod "bc976078-10a6-4ae9-995e-2e0786c5f89b" (UID: "bc976078-10a6-4ae9-995e-2e0786c5f89b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:07:09.219204 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:09.219173 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc976078-10a6-4ae9-995e-2e0786c5f89b-util\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:07:09.219204 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:09.219201 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j8s7\" (UniqueName: \"kubernetes.io/projected/bc976078-10a6-4ae9-995e-2e0786c5f89b-kube-api-access-7j8s7\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:07:09.219204 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:09.219211 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc976078-10a6-4ae9-995e-2e0786c5f89b-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:07:09.903277 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:09.903250 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" Jun 09 08:07:09.903277 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:09.903268 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwbsdh" event={"ID":"bc976078-10a6-4ae9-995e-2e0786c5f89b","Type":"ContainerDied","Data":"8b37ac6c681f934c59675bc244d15e7d0e974bf1400ee733f8fb47cb69b79931"} Jun 09 08:07:09.903476 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:09.903309 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b37ac6c681f934c59675bc244d15e7d0e974bf1400ee733f8fb47cb69b79931" Jun 09 08:07:13.899898 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:13.899868 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5wqxx" Jun 09 08:07:14.339974 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.339940 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-mh52h"] Jun 09 08:07:14.340274 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.340261 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc976078-10a6-4ae9-995e-2e0786c5f89b" containerName="extract" Jun 09 08:07:14.340312 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.340275 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc976078-10a6-4ae9-995e-2e0786c5f89b" containerName="extract" Jun 09 08:07:14.340312 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.340284 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc976078-10a6-4ae9-995e-2e0786c5f89b" containerName="pull" Jun 09 08:07:14.340312 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.340290 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc976078-10a6-4ae9-995e-2e0786c5f89b" containerName="pull" Jun 09 08:07:14.340312 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.340304 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc976078-10a6-4ae9-995e-2e0786c5f89b" containerName="util" Jun 09 08:07:14.340312 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.340310 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc976078-10a6-4ae9-995e-2e0786c5f89b" containerName="util" Jun 09 08:07:14.340472 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.340364 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc976078-10a6-4ae9-995e-2e0786c5f89b" containerName="extract" Jun 09 08:07:14.343355 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.343339 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-mh52h" Jun 09 08:07:14.345700 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.345684 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-g8s4t\"" Jun 09 08:07:14.351055 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.351031 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-mh52h"] Jun 09 08:07:14.470560 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.470523 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93b698cf-d37f-4937-8f46-a514dd24744d-bound-sa-token\") pod \"cert-manager-59c77684cc-mh52h\" (UID: \"93b698cf-d37f-4937-8f46-a514dd24744d\") " pod="cert-manager/cert-manager-59c77684cc-mh52h" Jun 09 08:07:14.470734 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.470583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbjbf\" (UniqueName: \"kubernetes.io/projected/93b698cf-d37f-4937-8f46-a514dd24744d-kube-api-access-sbjbf\") pod \"cert-manager-59c77684cc-mh52h\" (UID: \"93b698cf-d37f-4937-8f46-a514dd24744d\") " pod="cert-manager/cert-manager-59c77684cc-mh52h" Jun 09 08:07:14.572076 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.572036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbjbf\" (UniqueName: \"kubernetes.io/projected/93b698cf-d37f-4937-8f46-a514dd24744d-kube-api-access-sbjbf\") pod \"cert-manager-59c77684cc-mh52h\" (UID: \"93b698cf-d37f-4937-8f46-a514dd24744d\") " pod="cert-manager/cert-manager-59c77684cc-mh52h" Jun 09 08:07:14.572258 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.572142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93b698cf-d37f-4937-8f46-a514dd24744d-bound-sa-token\") pod \"cert-manager-59c77684cc-mh52h\" (UID: \"93b698cf-d37f-4937-8f46-a514dd24744d\") " pod="cert-manager/cert-manager-59c77684cc-mh52h" Jun 09 08:07:14.584860 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.584827 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93b698cf-d37f-4937-8f46-a514dd24744d-bound-sa-token\") pod \"cert-manager-59c77684cc-mh52h\" (UID: \"93b698cf-d37f-4937-8f46-a514dd24744d\") " pod="cert-manager/cert-manager-59c77684cc-mh52h" Jun 09 08:07:14.585000 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.584924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbjbf\" (UniqueName: \"kubernetes.io/projected/93b698cf-d37f-4937-8f46-a514dd24744d-kube-api-access-sbjbf\") pod \"cert-manager-59c77684cc-mh52h\" (UID: \"93b698cf-d37f-4937-8f46-a514dd24744d\") " pod="cert-manager/cert-manager-59c77684cc-mh52h" Jun 09 08:07:14.653534 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.653435 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-mh52h" Jun 09 08:07:14.780080 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.780049 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-mh52h"] Jun 09 08:07:14.783509 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:07:14.783487 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93b698cf_d37f_4937_8f46_a514dd24744d.slice/crio-a186d14fb7d3bd2ec6e8954f255d074a5e21f30a8bf48412a4fe0a0d72260343 WatchSource:0}: Error finding container a186d14fb7d3bd2ec6e8954f255d074a5e21f30a8bf48412a4fe0a0d72260343: Status 404 returned error can't find the container with id a186d14fb7d3bd2ec6e8954f255d074a5e21f30a8bf48412a4fe0a0d72260343 Jun 09 08:07:14.926278 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.926243 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-mh52h" event={"ID":"93b698cf-d37f-4937-8f46-a514dd24744d","Type":"ContainerStarted","Data":"4e351edc8130eb78286a513d767b506eb9bfd35fc73242e2c6dfb73b0a782240"} Jun 09 08:07:14.926278 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.926284 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-mh52h" event={"ID":"93b698cf-d37f-4937-8f46-a514dd24744d","Type":"ContainerStarted","Data":"a186d14fb7d3bd2ec6e8954f255d074a5e21f30a8bf48412a4fe0a0d72260343"} Jun 09 08:07:14.943870 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:14.943124 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-mh52h" podStartSLOduration=0.943105276 podStartE2EDuration="943.105276ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:07:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:07:14.942814929 +0000 UTC m=+562.612660965" watchObservedRunningTime="2026-06-09 08:07:14.943105276 +0000 UTC m=+562.612951292" Jun 09 08:07:15.853333 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:15.853299 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62mgh"] Jun 09 08:07:15.856507 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:15.856493 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62mgh" Jun 09 08:07:15.858991 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:15.858970 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 08:07:15.858991 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:15.858987 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 08:07:15.859991 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:15.859973 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2hccq\"" Jun 09 08:07:15.866253 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:15.866232 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62mgh"] Jun 09 08:07:15.983746 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:15.983716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05dd2060-e7dc-4125-aba0-6a83ad021efc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-62mgh\" (UID: \"05dd2060-e7dc-4125-aba0-6a83ad021efc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62mgh" Jun 09 08:07:15.984102 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:15.983752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x62dd\" (UniqueName: \"kubernetes.io/projected/05dd2060-e7dc-4125-aba0-6a83ad021efc-kube-api-access-x62dd\") pod \"openshift-lws-operator-fd8ccff4c-62mgh\" (UID: \"05dd2060-e7dc-4125-aba0-6a83ad021efc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62mgh" Jun 09 08:07:16.084961 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:16.084914 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05dd2060-e7dc-4125-aba0-6a83ad021efc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-62mgh\" (UID: \"05dd2060-e7dc-4125-aba0-6a83ad021efc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62mgh" Jun 09 08:07:16.085107 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:16.084975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x62dd\" (UniqueName: \"kubernetes.io/projected/05dd2060-e7dc-4125-aba0-6a83ad021efc-kube-api-access-x62dd\") pod \"openshift-lws-operator-fd8ccff4c-62mgh\" (UID: \"05dd2060-e7dc-4125-aba0-6a83ad021efc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62mgh" Jun 09 08:07:16.085361 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:16.085339 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05dd2060-e7dc-4125-aba0-6a83ad021efc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-62mgh\" (UID: \"05dd2060-e7dc-4125-aba0-6a83ad021efc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62mgh" Jun 09 08:07:16.093199 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:16.093175 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x62dd\" (UniqueName: \"kubernetes.io/projected/05dd2060-e7dc-4125-aba0-6a83ad021efc-kube-api-access-x62dd\") pod \"openshift-lws-operator-fd8ccff4c-62mgh\" (UID: \"05dd2060-e7dc-4125-aba0-6a83ad021efc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62mgh" Jun 09 08:07:16.166256 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:16.166193 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62mgh" Jun 09 08:07:16.294175 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:16.294113 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62mgh"] Jun 09 08:07:16.296590 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:07:16.296562 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05dd2060_e7dc_4125_aba0_6a83ad021efc.slice/crio-427d3e53a1139326368778e8c5000796a8c505fb9ca44ec89679bc03137c4bea WatchSource:0}: Error finding container 427d3e53a1139326368778e8c5000796a8c505fb9ca44ec89679bc03137c4bea: Status 404 returned error can't find the container with id 427d3e53a1139326368778e8c5000796a8c505fb9ca44ec89679bc03137c4bea Jun 09 08:07:16.938223 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:16.938187 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62mgh" event={"ID":"05dd2060-e7dc-4125-aba0-6a83ad021efc","Type":"ContainerStarted","Data":"427d3e53a1139326368778e8c5000796a8c505fb9ca44ec89679bc03137c4bea"} Jun 09 08:07:18.950302 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:18.950268 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62mgh" event={"ID":"05dd2060-e7dc-4125-aba0-6a83ad021efc","Type":"ContainerStarted","Data":"02c6a666cae5a0ad5229804d5c0607fcc882fe6b2f83eed3e22f12d98529fe76"} Jun 09 08:07:18.968521 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:18.968473 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-62mgh" podStartSLOduration=2.067167184 podStartE2EDuration="3.968459135s" totalImagesPullingTime="1.901291951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:07:18.966979758 +0000 UTC m=+566.636825774" watchObservedRunningTime="2026-06-09 08:07:18.968459135 +0000 UTC m=+566.638305149" Jun 09 08:07:21.636578 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.636543 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs"] Jun 09 08:07:21.640165 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.640149 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" Jun 09 08:07:21.642742 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.642717 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 08:07:21.643811 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.643796 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gmtrs\"" Jun 09 08:07:21.643865 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.643797 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 08:07:21.647564 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.647318 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs"] Jun 09 08:07:21.734348 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.734320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcgvz\" (UniqueName: \"kubernetes.io/projected/70be787b-fd53-4dd2-9c46-70b37dffcfd5-kube-api-access-gcgvz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs\" (UID: \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" Jun 09 08:07:21.734502 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.734388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70be787b-fd53-4dd2-9c46-70b37dffcfd5-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs\" (UID: \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" Jun 09 08:07:21.734502 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.734422 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70be787b-fd53-4dd2-9c46-70b37dffcfd5-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs\" (UID: \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" Jun 09 08:07:21.835045 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.835008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcgvz\" (UniqueName: \"kubernetes.io/projected/70be787b-fd53-4dd2-9c46-70b37dffcfd5-kube-api-access-gcgvz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs\" (UID: \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" Jun 09 08:07:21.835225 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.835164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70be787b-fd53-4dd2-9c46-70b37dffcfd5-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs\" (UID: \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" Jun 09 08:07:21.835225 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.835204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70be787b-fd53-4dd2-9c46-70b37dffcfd5-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs\" (UID: \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" Jun 09 08:07:21.835568 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.835554 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70be787b-fd53-4dd2-9c46-70b37dffcfd5-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs\" (UID: \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" Jun 09 08:07:21.835604 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.835577 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70be787b-fd53-4dd2-9c46-70b37dffcfd5-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs\" (UID: \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" Jun 09 08:07:21.844120 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.844094 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcgvz\" (UniqueName: \"kubernetes.io/projected/70be787b-fd53-4dd2-9c46-70b37dffcfd5-kube-api-access-gcgvz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs\" (UID: \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" Jun 09 08:07:21.950444 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:21.950414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" Jun 09 08:07:22.080920 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:22.080893 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs"] Jun 09 08:07:22.082986 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:07:22.082959 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70be787b_fd53_4dd2_9c46_70b37dffcfd5.slice/crio-d9116561c61694edf316e24a35396146bb65b530e84db6481e8ff20aff98dff3 WatchSource:0}: Error finding container d9116561c61694edf316e24a35396146bb65b530e84db6481e8ff20aff98dff3: Status 404 returned error can't find the container with id d9116561c61694edf316e24a35396146bb65b530e84db6481e8ff20aff98dff3 Jun 09 08:07:22.972421 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:22.972379 2577 generic.go:356] "Generic (PLEG): container finished" podID="70be787b-fd53-4dd2-9c46-70b37dffcfd5" containerID="66896f6f65357b1c708f269996e1b41565d7bd1fa22d19ef35fd66aceddde5cf" exitCode=0 Jun 09 08:07:22.972805 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:22.972426 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" event={"ID":"70be787b-fd53-4dd2-9c46-70b37dffcfd5","Type":"ContainerDied","Data":"66896f6f65357b1c708f269996e1b41565d7bd1fa22d19ef35fd66aceddde5cf"} Jun 09 08:07:22.972805 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:22.972468 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" event={"ID":"70be787b-fd53-4dd2-9c46-70b37dffcfd5","Type":"ContainerStarted","Data":"d9116561c61694edf316e24a35396146bb65b530e84db6481e8ff20aff98dff3"} Jun 09 08:07:23.980532 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:23.980501 2577 generic.go:356] "Generic (PLEG): container finished" podID="70be787b-fd53-4dd2-9c46-70b37dffcfd5" containerID="77d7570eb6339c0268964d4adb78245c4c032f2366ec3b5d6f773cd99e433a38" exitCode=0 Jun 09 08:07:23.980925 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:23.980594 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" event={"ID":"70be787b-fd53-4dd2-9c46-70b37dffcfd5","Type":"ContainerDied","Data":"77d7570eb6339c0268964d4adb78245c4c032f2366ec3b5d6f773cd99e433a38"} Jun 09 08:07:24.987068 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:24.987038 2577 generic.go:356] "Generic (PLEG): container finished" podID="70be787b-fd53-4dd2-9c46-70b37dffcfd5" containerID="ce97cfe44714aacb9db8361be0a765a3666f742a9187a7f2fb8b1c38a17e0dd6" exitCode=0 Jun 09 08:07:24.987466 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:24.987124 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" event={"ID":"70be787b-fd53-4dd2-9c46-70b37dffcfd5","Type":"ContainerDied","Data":"ce97cfe44714aacb9db8361be0a765a3666f742a9187a7f2fb8b1c38a17e0dd6"} Jun 09 08:07:26.121004 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:26.120977 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" Jun 09 08:07:26.172470 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:26.172434 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcgvz\" (UniqueName: \"kubernetes.io/projected/70be787b-fd53-4dd2-9c46-70b37dffcfd5-kube-api-access-gcgvz\") pod \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\" (UID: \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\") " Jun 09 08:07:26.172638 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:26.172493 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70be787b-fd53-4dd2-9c46-70b37dffcfd5-bundle\") pod \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\" (UID: \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\") " Jun 09 08:07:26.172638 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:26.172545 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70be787b-fd53-4dd2-9c46-70b37dffcfd5-util\") pod \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\" (UID: \"70be787b-fd53-4dd2-9c46-70b37dffcfd5\") " Jun 09 08:07:26.173210 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:26.173180 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70be787b-fd53-4dd2-9c46-70b37dffcfd5-bundle" (OuterVolumeSpecName: "bundle") pod "70be787b-fd53-4dd2-9c46-70b37dffcfd5" (UID: "70be787b-fd53-4dd2-9c46-70b37dffcfd5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:07:26.174566 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:26.174545 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70be787b-fd53-4dd2-9c46-70b37dffcfd5-kube-api-access-gcgvz" (OuterVolumeSpecName: "kube-api-access-gcgvz") pod "70be787b-fd53-4dd2-9c46-70b37dffcfd5" (UID: "70be787b-fd53-4dd2-9c46-70b37dffcfd5"). InnerVolumeSpecName "kube-api-access-gcgvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:07:26.178117 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:26.178095 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70be787b-fd53-4dd2-9c46-70b37dffcfd5-util" (OuterVolumeSpecName: "util") pod "70be787b-fd53-4dd2-9c46-70b37dffcfd5" (UID: "70be787b-fd53-4dd2-9c46-70b37dffcfd5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:07:26.273703 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:26.273617 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcgvz\" (UniqueName: \"kubernetes.io/projected/70be787b-fd53-4dd2-9c46-70b37dffcfd5-kube-api-access-gcgvz\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:07:26.273703 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:26.273646 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70be787b-fd53-4dd2-9c46-70b37dffcfd5-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:07:26.273703 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:26.273654 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70be787b-fd53-4dd2-9c46-70b37dffcfd5-util\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:07:27.000256 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:27.000217 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" event={"ID":"70be787b-fd53-4dd2-9c46-70b37dffcfd5","Type":"ContainerDied","Data":"d9116561c61694edf316e24a35396146bb65b530e84db6481e8ff20aff98dff3"} Jun 09 08:07:27.000416 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:27.000272 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9116561c61694edf316e24a35396146bb65b530e84db6481e8ff20aff98dff3" Jun 09 08:07:27.000416 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:27.000231 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdq4phs" Jun 09 08:07:38.950028 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.949994 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n"] Jun 09 08:07:38.950504 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.950311 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70be787b-fd53-4dd2-9c46-70b37dffcfd5" containerName="util" Jun 09 08:07:38.950504 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.950321 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="70be787b-fd53-4dd2-9c46-70b37dffcfd5" containerName="util" Jun 09 08:07:38.950504 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.950329 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70be787b-fd53-4dd2-9c46-70b37dffcfd5" containerName="pull" Jun 09 08:07:38.950504 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.950335 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="70be787b-fd53-4dd2-9c46-70b37dffcfd5" containerName="pull" Jun 09 08:07:38.950504 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.950345 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70be787b-fd53-4dd2-9c46-70b37dffcfd5" containerName="extract" Jun 09 08:07:38.950504 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.950351 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="70be787b-fd53-4dd2-9c46-70b37dffcfd5" containerName="extract" Jun 09 08:07:38.950504 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.950407 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="70be787b-fd53-4dd2-9c46-70b37dffcfd5" containerName="extract" Jun 09 08:07:38.952872 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.952850 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:38.956317 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.956293 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8qlhg\"" Jun 09 08:07:38.964245 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.964228 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 08:07:38.964536 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.964522 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 08:07:38.964696 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.964684 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 08:07:38.964761 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.964744 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 08:07:38.969485 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.969460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cjrh\" (UniqueName: \"kubernetes.io/projected/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-kube-api-access-7cjrh\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:38.969570 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.969494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-webhook-cert\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:38.969611 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.969580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-tmp\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:38.969653 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.969639 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-manifests\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:38.969688 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.969660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:38.991228 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:38.991202 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n"] Jun 09 08:07:39.070016 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:39.069987 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-tmp\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:39.070188 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:39.070036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-manifests\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:39.070188 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:39.070052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:39.070188 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:39.070083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cjrh\" (UniqueName: \"kubernetes.io/projected/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-kube-api-access-7cjrh\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:39.070188 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:39.070105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-webhook-cert\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:39.070494 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:39.070472 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-manifests\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:39.072464 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:39.072438 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-tmp\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:39.072556 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:39.072534 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:39.072763 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:39.072740 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-webhook-cert\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:39.080989 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:39.080964 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cjrh\" (UniqueName: \"kubernetes.io/projected/733bd9e4-e1ca-4bab-89c4-b8c64dcb2208-kube-api-access-7cjrh\") pod \"opendatahub-operator-controller-manager-c6b94fd7b-xdm4n\" (UID: \"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208\") " pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:39.263340 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:39.263279 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:39.425228 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:39.425193 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n"] Jun 09 08:07:39.428791 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:07:39.428764 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733bd9e4_e1ca_4bab_89c4_b8c64dcb2208.slice/crio-9cb42a6527748dfaf44e28d42c8e0d016781afe1bef0f966d3a98d47d1840fd6 WatchSource:0}: Error finding container 9cb42a6527748dfaf44e28d42c8e0d016781afe1bef0f966d3a98d47d1840fd6: Status 404 returned error can't find the container with id 9cb42a6527748dfaf44e28d42c8e0d016781afe1bef0f966d3a98d47d1840fd6 Jun 09 08:07:40.061420 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:40.061380 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" event={"ID":"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208","Type":"ContainerStarted","Data":"9cb42a6527748dfaf44e28d42c8e0d016781afe1bef0f966d3a98d47d1840fd6"} Jun 09 08:07:43.079234 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:43.079199 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" event={"ID":"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208","Type":"ContainerStarted","Data":"29f08af8dd46a3e7d4d1eb6a2e6a59ee937b55a88050fdd120a8d0050b5d9b28"} Jun 09 08:07:44.085408 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:44.085374 2577 generic.go:356] "Generic (PLEG): container finished" podID="733bd9e4-e1ca-4bab-89c4-b8c64dcb2208" containerID="29f08af8dd46a3e7d4d1eb6a2e6a59ee937b55a88050fdd120a8d0050b5d9b28" exitCode=0 Jun 09 08:07:44.085808 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:44.085473 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" event={"ID":"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208","Type":"ContainerDied","Data":"29f08af8dd46a3e7d4d1eb6a2e6a59ee937b55a88050fdd120a8d0050b5d9b28"} Jun 09 08:07:45.092380 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:45.092345 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" event={"ID":"733bd9e4-e1ca-4bab-89c4-b8c64dcb2208","Type":"ContainerStarted","Data":"57d874ffd89c1c672022e03bbd6fda5fd0ec74ce30eae9b1c82cc3d6c14454b6"} Jun 09 08:07:45.092771 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:45.092493 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:45.118507 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:45.118457 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" podStartSLOduration=2.999168132 podStartE2EDuration="7.118442188s" totalImagesPullingTime="3.187257776s" totalInitContainerRuntime="932.01628ms" isStatefulPod=false podCreationTimestamp="2026-06-09 08:07:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:07:45.116971086 +0000 UTC m=+592.786817103" watchObservedRunningTime="2026-06-09 08:07:45.118442188 +0000 UTC m=+592.788288184" Jun 09 08:07:52.771806 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:52.771774 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/2.log" Jun 09 08:07:52.772292 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:52.772215 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/2.log" Jun 09 08:07:56.099450 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:56.099421 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c6b94fd7b-xdm4n" Jun 09 08:07:58.366273 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.366234 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-69895d85c6-gp96q"] Jun 09 08:07:58.369728 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.369710 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69895d85c6-gp96q" Jun 09 08:07:58.372888 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.372864 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 08:07:58.373209 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.373191 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 08:07:58.374468 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.374430 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 08:07:58.374468 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.374462 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 08:07:58.374645 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.374493 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ht4ld\"" Jun 09 08:07:58.381036 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.381015 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69895d85c6-gp96q"] Jun 09 08:07:58.434937 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.434902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af33d4bf-5969-4d16-8feb-b72b325fc6d4-tmp\") pod \"kube-auth-proxy-69895d85c6-gp96q\" (UID: \"af33d4bf-5969-4d16-8feb-b72b325fc6d4\") " pod="openshift-ingress/kube-auth-proxy-69895d85c6-gp96q" Jun 09 08:07:58.435113 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.435020 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqrxh\" (UniqueName: \"kubernetes.io/projected/af33d4bf-5969-4d16-8feb-b72b325fc6d4-kube-api-access-cqrxh\") pod \"kube-auth-proxy-69895d85c6-gp96q\" (UID: \"af33d4bf-5969-4d16-8feb-b72b325fc6d4\") " pod="openshift-ingress/kube-auth-proxy-69895d85c6-gp96q" Jun 09 08:07:58.435113 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.435061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af33d4bf-5969-4d16-8feb-b72b325fc6d4-tls-certs\") pod \"kube-auth-proxy-69895d85c6-gp96q\" (UID: \"af33d4bf-5969-4d16-8feb-b72b325fc6d4\") " pod="openshift-ingress/kube-auth-proxy-69895d85c6-gp96q" Jun 09 08:07:58.535907 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.535873 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqrxh\" (UniqueName: \"kubernetes.io/projected/af33d4bf-5969-4d16-8feb-b72b325fc6d4-kube-api-access-cqrxh\") pod \"kube-auth-proxy-69895d85c6-gp96q\" (UID: \"af33d4bf-5969-4d16-8feb-b72b325fc6d4\") " pod="openshift-ingress/kube-auth-proxy-69895d85c6-gp96q" Jun 09 08:07:58.535907 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.535909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af33d4bf-5969-4d16-8feb-b72b325fc6d4-tls-certs\") pod \"kube-auth-proxy-69895d85c6-gp96q\" (UID: \"af33d4bf-5969-4d16-8feb-b72b325fc6d4\") " pod="openshift-ingress/kube-auth-proxy-69895d85c6-gp96q" Jun 09 08:07:58.536120 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.535975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af33d4bf-5969-4d16-8feb-b72b325fc6d4-tmp\") pod \"kube-auth-proxy-69895d85c6-gp96q\" (UID: \"af33d4bf-5969-4d16-8feb-b72b325fc6d4\") " pod="openshift-ingress/kube-auth-proxy-69895d85c6-gp96q" Jun 09 08:07:58.538450 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.538409 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af33d4bf-5969-4d16-8feb-b72b325fc6d4-tmp\") pod \"kube-auth-proxy-69895d85c6-gp96q\" (UID: \"af33d4bf-5969-4d16-8feb-b72b325fc6d4\") " pod="openshift-ingress/kube-auth-proxy-69895d85c6-gp96q" Jun 09 08:07:58.538608 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.538594 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af33d4bf-5969-4d16-8feb-b72b325fc6d4-tls-certs\") pod \"kube-auth-proxy-69895d85c6-gp96q\" (UID: \"af33d4bf-5969-4d16-8feb-b72b325fc6d4\") " pod="openshift-ingress/kube-auth-proxy-69895d85c6-gp96q" Jun 09 08:07:58.544268 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.544247 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqrxh\" (UniqueName: \"kubernetes.io/projected/af33d4bf-5969-4d16-8feb-b72b325fc6d4-kube-api-access-cqrxh\") pod \"kube-auth-proxy-69895d85c6-gp96q\" (UID: \"af33d4bf-5969-4d16-8feb-b72b325fc6d4\") " pod="openshift-ingress/kube-auth-proxy-69895d85c6-gp96q" Jun 09 08:07:58.680395 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.680363 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69895d85c6-gp96q" Jun 09 08:07:58.714583 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.714551 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-7fzgx"] Jun 09 08:07:58.718200 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.718183 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-7fzgx" Jun 09 08:07:58.721040 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.721019 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ccj6k\"" Jun 09 08:07:58.721150 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.721054 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 08:07:58.730155 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.730084 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-7fzgx"] Jun 09 08:07:58.819699 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.819675 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69895d85c6-gp96q"] Jun 09 08:07:58.821781 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:07:58.821751 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf33d4bf_5969_4d16_8feb_b72b325fc6d4.slice/crio-f1ad4df3af45cbd0e912715fcc87583d691328646389c283c1c41e8cc0feb0e7 WatchSource:0}: Error finding container f1ad4df3af45cbd0e912715fcc87583d691328646389c283c1c41e8cc0feb0e7: Status 404 returned error can't find the container with id f1ad4df3af45cbd0e912715fcc87583d691328646389c283c1c41e8cc0feb0e7 Jun 09 08:07:58.840427 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.840404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bcb29f7-8693-49b6-82fe-2980579a5411-cert\") pod \"odh-model-controller-6dc94f689f-7fzgx\" (UID: \"4bcb29f7-8693-49b6-82fe-2980579a5411\") " pod="opendatahub/odh-model-controller-6dc94f689f-7fzgx" Jun 09 08:07:58.840528 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.840444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p277v\" (UniqueName: \"kubernetes.io/projected/4bcb29f7-8693-49b6-82fe-2980579a5411-kube-api-access-p277v\") pod \"odh-model-controller-6dc94f689f-7fzgx\" (UID: \"4bcb29f7-8693-49b6-82fe-2980579a5411\") " pod="opendatahub/odh-model-controller-6dc94f689f-7fzgx" Jun 09 08:07:58.941728 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.941641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bcb29f7-8693-49b6-82fe-2980579a5411-cert\") pod \"odh-model-controller-6dc94f689f-7fzgx\" (UID: \"4bcb29f7-8693-49b6-82fe-2980579a5411\") " pod="opendatahub/odh-model-controller-6dc94f689f-7fzgx" Jun 09 08:07:58.941728 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.941687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p277v\" (UniqueName: \"kubernetes.io/projected/4bcb29f7-8693-49b6-82fe-2980579a5411-kube-api-access-p277v\") pod \"odh-model-controller-6dc94f689f-7fzgx\" (UID: \"4bcb29f7-8693-49b6-82fe-2980579a5411\") " pod="opendatahub/odh-model-controller-6dc94f689f-7fzgx" Jun 09 08:07:58.941965 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:07:58.941791 2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 08:07:58.941965 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:07:58.941852 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bcb29f7-8693-49b6-82fe-2980579a5411-cert podName:4bcb29f7-8693-49b6-82fe-2980579a5411 nodeName:}" failed. No retries permitted until 2026-06-09 08:07:59.441833746 +0000 UTC m=+607.111679760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4bcb29f7-8693-49b6-82fe-2980579a5411-cert") pod "odh-model-controller-6dc94f689f-7fzgx" (UID: "4bcb29f7-8693-49b6-82fe-2980579a5411") : secret "odh-model-controller-webhook-cert" not found Jun 09 08:07:58.953572 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:58.953544 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p277v\" (UniqueName: \"kubernetes.io/projected/4bcb29f7-8693-49b6-82fe-2980579a5411-kube-api-access-p277v\") pod \"odh-model-controller-6dc94f689f-7fzgx\" (UID: \"4bcb29f7-8693-49b6-82fe-2980579a5411\") " pod="opendatahub/odh-model-controller-6dc94f689f-7fzgx" Jun 09 08:07:59.160723 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.160671 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69895d85c6-gp96q" event={"ID":"af33d4bf-5969-4d16-8feb-b72b325fc6d4","Type":"ContainerStarted","Data":"f1ad4df3af45cbd0e912715fcc87583d691328646389c283c1c41e8cc0feb0e7"} Jun 09 08:07:59.231296 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.231216 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cg7kp"] Jun 09 08:07:59.235059 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.235041 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-cg7kp" Jun 09 08:07:59.238601 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.238581 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-6fv2w\"" Jun 09 08:07:59.242165 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.242149 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 08:07:59.252764 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.252742 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cg7kp"] Jun 09 08:07:59.344684 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.344649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7e4a91d-61c6-4593-8c17-a1e6256a4af9-tls-certs\") pod \"model-serving-api-5dd488fc48-cg7kp\" (UID: \"f7e4a91d-61c6-4593-8c17-a1e6256a4af9\") " pod="opendatahub/model-serving-api-5dd488fc48-cg7kp" Jun 09 08:07:59.344840 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.344728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csxbj\" (UniqueName: \"kubernetes.io/projected/f7e4a91d-61c6-4593-8c17-a1e6256a4af9-kube-api-access-csxbj\") pod \"model-serving-api-5dd488fc48-cg7kp\" (UID: \"f7e4a91d-61c6-4593-8c17-a1e6256a4af9\") " pod="opendatahub/model-serving-api-5dd488fc48-cg7kp" Jun 09 08:07:59.445305 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.445272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bcb29f7-8693-49b6-82fe-2980579a5411-cert\") pod \"odh-model-controller-6dc94f689f-7fzgx\" (UID: \"4bcb29f7-8693-49b6-82fe-2980579a5411\") " pod="opendatahub/odh-model-controller-6dc94f689f-7fzgx" Jun 09 08:07:59.445305 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.445310 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csxbj\" (UniqueName: \"kubernetes.io/projected/f7e4a91d-61c6-4593-8c17-a1e6256a4af9-kube-api-access-csxbj\") pod \"model-serving-api-5dd488fc48-cg7kp\" (UID: \"f7e4a91d-61c6-4593-8c17-a1e6256a4af9\") " pod="opendatahub/model-serving-api-5dd488fc48-cg7kp" Jun 09 08:07:59.445735 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.445386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7e4a91d-61c6-4593-8c17-a1e6256a4af9-tls-certs\") pod \"model-serving-api-5dd488fc48-cg7kp\" (UID: \"f7e4a91d-61c6-4593-8c17-a1e6256a4af9\") " pod="opendatahub/model-serving-api-5dd488fc48-cg7kp" Jun 09 08:07:59.447729 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.447705 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bcb29f7-8693-49b6-82fe-2980579a5411-cert\") pod \"odh-model-controller-6dc94f689f-7fzgx\" (UID: \"4bcb29f7-8693-49b6-82fe-2980579a5411\") " pod="opendatahub/odh-model-controller-6dc94f689f-7fzgx" Jun 09 08:07:59.447842 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.447709 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7e4a91d-61c6-4593-8c17-a1e6256a4af9-tls-certs\") pod \"model-serving-api-5dd488fc48-cg7kp\" (UID: \"f7e4a91d-61c6-4593-8c17-a1e6256a4af9\") " pod="opendatahub/model-serving-api-5dd488fc48-cg7kp" Jun 09 08:07:59.454281 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.454262 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csxbj\" (UniqueName: \"kubernetes.io/projected/f7e4a91d-61c6-4593-8c17-a1e6256a4af9-kube-api-access-csxbj\") pod \"model-serving-api-5dd488fc48-cg7kp\" (UID: \"f7e4a91d-61c6-4593-8c17-a1e6256a4af9\") " pod="opendatahub/model-serving-api-5dd488fc48-cg7kp" Jun 09 08:07:59.545624 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.545540 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-cg7kp" Jun 09 08:07:59.632249 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.632215 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-7fzgx" Jun 09 08:07:59.708134 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.707947 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cg7kp"] Jun 09 08:07:59.710582 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:07:59.710286 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e4a91d_61c6_4593_8c17_a1e6256a4af9.slice/crio-f6d7df6b9dbe42ed3886a6ae80a639930e1d1139d53c277a1a9cb468d47cf238 WatchSource:0}: Error finding container f6d7df6b9dbe42ed3886a6ae80a639930e1d1139d53c277a1a9cb468d47cf238: Status 404 returned error can't find the container with id f6d7df6b9dbe42ed3886a6ae80a639930e1d1139d53c277a1a9cb468d47cf238 Jun 09 08:07:59.802968 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:07:59.802943 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-7fzgx"] Jun 09 08:07:59.806075 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:07:59.805815 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bcb29f7_8693_49b6_82fe_2980579a5411.slice/crio-083bd22fca2afbd6086959f76b28007da27895424cb1df6bd1def57fd5c859a0 WatchSource:0}: Error finding container 083bd22fca2afbd6086959f76b28007da27895424cb1df6bd1def57fd5c859a0: Status 404 returned error can't find the container with id 083bd22fca2afbd6086959f76b28007da27895424cb1df6bd1def57fd5c859a0 Jun 09 08:08:00.168096 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:00.168065 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-cg7kp" event={"ID":"f7e4a91d-61c6-4593-8c17-a1e6256a4af9","Type":"ContainerStarted","Data":"f6d7df6b9dbe42ed3886a6ae80a639930e1d1139d53c277a1a9cb468d47cf238"} Jun 09 08:08:00.169320 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:00.169293 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-7fzgx" event={"ID":"4bcb29f7-8693-49b6-82fe-2980579a5411","Type":"ContainerStarted","Data":"083bd22fca2afbd6086959f76b28007da27895424cb1df6bd1def57fd5c859a0"} Jun 09 08:08:02.179828 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.179791 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr"] Jun 09 08:08:02.187359 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.187336 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" Jun 09 08:08:02.190028 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.189960 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 08:08:02.190579 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.190552 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr"] Jun 09 08:08:02.191259 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.191225 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gmtrs\"" Jun 09 08:08:02.191368 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.191267 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 08:08:02.271822 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.271782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4da5275-f6b0-42da-9c7c-9603af20c3e3-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr\" (UID: \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" Jun 09 08:08:02.271981 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.271869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8xs6\" (UniqueName: \"kubernetes.io/projected/c4da5275-f6b0-42da-9c7c-9603af20c3e3-kube-api-access-j8xs6\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr\" (UID: \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" Jun 09 08:08:02.271981 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.271924 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4da5275-f6b0-42da-9c7c-9603af20c3e3-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr\" (UID: \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" Jun 09 08:08:02.373247 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.373212 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4da5275-f6b0-42da-9c7c-9603af20c3e3-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr\" (UID: \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" Jun 09 08:08:02.373413 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.373337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4da5275-f6b0-42da-9c7c-9603af20c3e3-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr\" (UID: \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" Jun 09 08:08:02.373413 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.373362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8xs6\" (UniqueName: \"kubernetes.io/projected/c4da5275-f6b0-42da-9c7c-9603af20c3e3-kube-api-access-j8xs6\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr\" (UID: \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" Jun 09 08:08:02.373694 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.373668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4da5275-f6b0-42da-9c7c-9603af20c3e3-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr\" (UID: \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" Jun 09 08:08:02.373774 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.373678 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4da5275-f6b0-42da-9c7c-9603af20c3e3-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr\" (UID: \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" Jun 09 08:08:02.382475 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.382449 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8xs6\" (UniqueName: \"kubernetes.io/projected/c4da5275-f6b0-42da-9c7c-9603af20c3e3-kube-api-access-j8xs6\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr\" (UID: \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" Jun 09 08:08:02.498385 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:02.498313 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" Jun 09 08:08:04.569856 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:04.569831 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr"] Jun 09 08:08:04.572331 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:08:04.572301 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4da5275_f6b0_42da_9c7c_9603af20c3e3.slice/crio-274193c674359264c770535ee3ffb130a78b604b50abd23393b276d15afbe6d8 WatchSource:0}: Error finding container 274193c674359264c770535ee3ffb130a78b604b50abd23393b276d15afbe6d8: Status 404 returned error can't find the container with id 274193c674359264c770535ee3ffb130a78b604b50abd23393b276d15afbe6d8 Jun 09 08:08:05.201032 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:05.200996 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-7fzgx" event={"ID":"4bcb29f7-8693-49b6-82fe-2980579a5411","Type":"ContainerStarted","Data":"b4961cc067f690269278603d019b84e8424b55abb7e491916f610bc3ea35fbd1"} Jun 09 08:08:05.201220 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:05.201087 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-7fzgx" Jun 09 08:08:05.202486 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:05.202462 2577 generic.go:356] "Generic (PLEG): container finished" podID="c4da5275-f6b0-42da-9c7c-9603af20c3e3" containerID="a0f7bd9897bc6a5f6b9b00d43593b8fdeca4fd3fd527db4fbde41bb1585c20c2" exitCode=0 Jun 09 08:08:05.202602 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:05.202539 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" event={"ID":"c4da5275-f6b0-42da-9c7c-9603af20c3e3","Type":"ContainerDied","Data":"a0f7bd9897bc6a5f6b9b00d43593b8fdeca4fd3fd527db4fbde41bb1585c20c2"} Jun 09 08:08:05.202602 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:05.202585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" event={"ID":"c4da5275-f6b0-42da-9c7c-9603af20c3e3","Type":"ContainerStarted","Data":"274193c674359264c770535ee3ffb130a78b604b50abd23393b276d15afbe6d8"} Jun 09 08:08:05.204672 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:05.204650 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69895d85c6-gp96q" event={"ID":"af33d4bf-5969-4d16-8feb-b72b325fc6d4","Type":"ContainerStarted","Data":"f36da07c918b5c473953853aa570b95950e280ffd645cc6ac227e675b038206f"} Jun 09 08:08:05.206297 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:05.206201 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-cg7kp" event={"ID":"f7e4a91d-61c6-4593-8c17-a1e6256a4af9","Type":"ContainerStarted","Data":"75103076c3e24d9807638aee33d237d3ed879fa52de82583a38f4fc1e283ad5a"} Jun 09 08:08:05.206380 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:05.206328 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-cg7kp" Jun 09 08:08:05.219605 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:05.219550 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-7fzgx" podStartSLOduration=2.602882084 podStartE2EDuration="7.21953587s" totalImagesPullingTime="4.616653786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:08:05.218091596 +0000 UTC m=+612.887937626" watchObservedRunningTime="2026-06-09 08:08:05.21953587 +0000 UTC m=+612.889381885" Jun 09 08:08:05.237089 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:05.237038 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-cg7kp" podStartSLOduration=1.534842684 podStartE2EDuration="6.237024009s" totalImagesPullingTime="4.702181325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:07:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:08:05.236709276 +0000 UTC m=+612.906555291" watchObservedRunningTime="2026-06-09 08:08:05.237024009 +0000 UTC m=+612.906870006" Jun 09 08:08:05.255790 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:05.255720 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-69895d85c6-gp96q" podStartSLOduration=1.661875744 podStartE2EDuration="7.255700033s" totalImagesPullingTime="5.593824289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:08:05.254092687 +0000 UTC m=+612.923938742" watchObservedRunningTime="2026-06-09 08:08:05.255700033 +0000 UTC m=+612.925546052" Jun 09 08:08:06.213412 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:06.213374 2577 generic.go:356] "Generic (PLEG): container finished" podID="c4da5275-f6b0-42da-9c7c-9603af20c3e3" containerID="e1c78aa7fa640984508d106a0425afb21acbe8ca620140c34672ad3dcebe3bdb" exitCode=0 Jun 09 08:08:06.213888 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:06.213432 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" event={"ID":"c4da5275-f6b0-42da-9c7c-9603af20c3e3","Type":"ContainerDied","Data":"e1c78aa7fa640984508d106a0425afb21acbe8ca620140c34672ad3dcebe3bdb"} Jun 09 08:08:07.220567 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:07.220538 2577 generic.go:356] "Generic (PLEG): container finished" podID="c4da5275-f6b0-42da-9c7c-9603af20c3e3" containerID="508ef5f02fe3522dd6e6ccf902daa44787d544a60adb3c2a61e1743e8edebb0b" exitCode=0 Jun 09 08:08:07.220923 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:07.220576 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" event={"ID":"c4da5275-f6b0-42da-9c7c-9603af20c3e3","Type":"ContainerDied","Data":"508ef5f02fe3522dd6e6ccf902daa44787d544a60adb3c2a61e1743e8edebb0b"} Jun 09 08:08:08.351384 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.351361 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" Jun 09 08:08:08.532068 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.531979 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8xs6\" (UniqueName: \"kubernetes.io/projected/c4da5275-f6b0-42da-9c7c-9603af20c3e3-kube-api-access-j8xs6\") pod \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\" (UID: \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\") " Jun 09 08:08:08.532068 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.532067 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4da5275-f6b0-42da-9c7c-9603af20c3e3-bundle\") pod \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\" (UID: \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\") " Jun 09 08:08:08.532291 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.532092 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4da5275-f6b0-42da-9c7c-9603af20c3e3-util\") pod \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\" (UID: \"c4da5275-f6b0-42da-9c7c-9603af20c3e3\") " Jun 09 08:08:08.533242 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.533206 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4da5275-f6b0-42da-9c7c-9603af20c3e3-bundle" (OuterVolumeSpecName: "bundle") pod "c4da5275-f6b0-42da-9c7c-9603af20c3e3" (UID: "c4da5275-f6b0-42da-9c7c-9603af20c3e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:08:08.534480 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.534455 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4da5275-f6b0-42da-9c7c-9603af20c3e3-kube-api-access-j8xs6" (OuterVolumeSpecName: "kube-api-access-j8xs6") pod "c4da5275-f6b0-42da-9c7c-9603af20c3e3" (UID: "c4da5275-f6b0-42da-9c7c-9603af20c3e3"). InnerVolumeSpecName "kube-api-access-j8xs6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:08:08.540875 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.540838 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4da5275-f6b0-42da-9c7c-9603af20c3e3-util" (OuterVolumeSpecName: "util") pod "c4da5275-f6b0-42da-9c7c-9603af20c3e3" (UID: "c4da5275-f6b0-42da-9c7c-9603af20c3e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:08:08.633165 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.633131 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8xs6\" (UniqueName: \"kubernetes.io/projected/c4da5275-f6b0-42da-9c7c-9603af20c3e3-kube-api-access-j8xs6\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:08:08.633165 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.633161 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4da5275-f6b0-42da-9c7c-9603af20c3e3-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:08:08.633165 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.633172 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4da5275-f6b0-42da-9c7c-9603af20c3e3-util\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:08:08.652740 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.652703 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dqv5t"] Jun 09 08:08:08.653112 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.653098 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4da5275-f6b0-42da-9c7c-9603af20c3e3" containerName="pull" Jun 09 08:08:08.653162 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.653113 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4da5275-f6b0-42da-9c7c-9603af20c3e3" containerName="pull" Jun 09 08:08:08.653162 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.653127 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4da5275-f6b0-42da-9c7c-9603af20c3e3" containerName="extract" Jun 09 08:08:08.653162 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.653133 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4da5275-f6b0-42da-9c7c-9603af20c3e3" containerName="extract" Jun 09 08:08:08.653162 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.653142 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4da5275-f6b0-42da-9c7c-9603af20c3e3" containerName="util" Jun 09 08:08:08.653162 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.653147 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4da5275-f6b0-42da-9c7c-9603af20c3e3" containerName="util" Jun 09 08:08:08.653339 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.653219 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4da5275-f6b0-42da-9c7c-9603af20c3e3" containerName="extract" Jun 09 08:08:08.656499 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.656481 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-dqv5t" Jun 09 08:08:08.664828 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.664808 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-w8kgf\"" Jun 09 08:08:08.665174 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.665158 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 09 08:08:08.690601 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.690547 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dqv5t"] Jun 09 08:08:08.692315 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.692295 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d"] Jun 09 08:08:08.695530 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.695515 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d" Jun 09 08:08:08.699600 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.699581 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-k9cjg\"" Jun 09 08:08:08.702732 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.702711 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 08:08:08.732196 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.732160 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d"] Jun 09 08:08:08.834364 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.834327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/846f55b3-19c5-447a-903f-8b67d43ceee5-cert\") pod \"kserve-controller-manager-69fc866d76-dqv5t\" (UID: \"846f55b3-19c5-447a-903f-8b67d43ceee5\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dqv5t" Jun 09 08:08:08.834543 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.834367 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6flsj\" (UniqueName: \"kubernetes.io/projected/846f55b3-19c5-447a-903f-8b67d43ceee5-kube-api-access-6flsj\") pod \"kserve-controller-manager-69fc866d76-dqv5t\" (UID: \"846f55b3-19c5-447a-903f-8b67d43ceee5\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dqv5t" Jun 09 08:08:08.834543 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.834482 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a60aabf-c648-4efa-9ac3-f7b2010cd32c-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-q954d\" (UID: \"7a60aabf-c648-4efa-9ac3-f7b2010cd32c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d" Jun 09 08:08:08.834543 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.834508 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgt2g\" (UniqueName: \"kubernetes.io/projected/7a60aabf-c648-4efa-9ac3-f7b2010cd32c-kube-api-access-cgt2g\") pod \"llmisvc-controller-manager-864bfd7bc9-q954d\" (UID: \"7a60aabf-c648-4efa-9ac3-f7b2010cd32c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d" Jun 09 08:08:08.935413 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.935370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/846f55b3-19c5-447a-903f-8b67d43ceee5-cert\") pod \"kserve-controller-manager-69fc866d76-dqv5t\" (UID: \"846f55b3-19c5-447a-903f-8b67d43ceee5\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dqv5t" Jun 09 08:08:08.935597 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.935414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6flsj\" (UniqueName: \"kubernetes.io/projected/846f55b3-19c5-447a-903f-8b67d43ceee5-kube-api-access-6flsj\") pod \"kserve-controller-manager-69fc866d76-dqv5t\" (UID: \"846f55b3-19c5-447a-903f-8b67d43ceee5\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dqv5t" Jun 09 08:08:08.935597 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.935521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a60aabf-c648-4efa-9ac3-f7b2010cd32c-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-q954d\" (UID: \"7a60aabf-c648-4efa-9ac3-f7b2010cd32c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d" Jun 09 08:08:08.935597 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.935537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgt2g\" (UniqueName: \"kubernetes.io/projected/7a60aabf-c648-4efa-9ac3-f7b2010cd32c-kube-api-access-cgt2g\") pod \"llmisvc-controller-manager-864bfd7bc9-q954d\" (UID: \"7a60aabf-c648-4efa-9ac3-f7b2010cd32c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d" Jun 09 08:08:08.938043 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.938019 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a60aabf-c648-4efa-9ac3-f7b2010cd32c-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-q954d\" (UID: \"7a60aabf-c648-4efa-9ac3-f7b2010cd32c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d" Jun 09 08:08:08.938149 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.938090 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/846f55b3-19c5-447a-903f-8b67d43ceee5-cert\") pod \"kserve-controller-manager-69fc866d76-dqv5t\" (UID: \"846f55b3-19c5-447a-903f-8b67d43ceee5\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dqv5t" Jun 09 08:08:08.945326 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.945292 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6flsj\" (UniqueName: \"kubernetes.io/projected/846f55b3-19c5-447a-903f-8b67d43ceee5-kube-api-access-6flsj\") pod \"kserve-controller-manager-69fc866d76-dqv5t\" (UID: \"846f55b3-19c5-447a-903f-8b67d43ceee5\") " pod="opendatahub/kserve-controller-manager-69fc866d76-dqv5t" Jun 09 08:08:08.945458 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.945370 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgt2g\" (UniqueName: \"kubernetes.io/projected/7a60aabf-c648-4efa-9ac3-f7b2010cd32c-kube-api-access-cgt2g\") pod \"llmisvc-controller-manager-864bfd7bc9-q954d\" (UID: \"7a60aabf-c648-4efa-9ac3-f7b2010cd32c\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d" Jun 09 08:08:08.966300 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:08.966270 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-dqv5t" Jun 09 08:08:09.005539 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:09.005504 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d" Jun 09 08:08:09.114663 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:09.112289 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-dqv5t"] Jun 09 08:08:09.131967 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:08:09.131907 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846f55b3_19c5_447a_903f_8b67d43ceee5.slice/crio-8b237853adb571a4e1ca2727dbda3915c84f88b954e55222aaf27fc8e32923ce WatchSource:0}: Error finding container 8b237853adb571a4e1ca2727dbda3915c84f88b954e55222aaf27fc8e32923ce: Status 404 returned error can't find the container with id 8b237853adb571a4e1ca2727dbda3915c84f88b954e55222aaf27fc8e32923ce Jun 09 08:08:09.169253 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:09.169224 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d"] Jun 09 08:08:09.170190 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:08:09.170166 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7a60aabf_c648_4efa_9ac3_f7b2010cd32c.slice/crio-8c6328cbb4b9125ea0ea5b7cf1bdb115451048448c825ceb94b0785cc2a12e64 WatchSource:0}: Error finding container 8c6328cbb4b9125ea0ea5b7cf1bdb115451048448c825ceb94b0785cc2a12e64: Status 404 returned error can't find the container with id 8c6328cbb4b9125ea0ea5b7cf1bdb115451048448c825ceb94b0785cc2a12e64 Jun 09 08:08:09.232247 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:09.232212 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d" event={"ID":"7a60aabf-c648-4efa-9ac3-f7b2010cd32c","Type":"ContainerStarted","Data":"8c6328cbb4b9125ea0ea5b7cf1bdb115451048448c825ceb94b0785cc2a12e64"} Jun 09 08:08:09.233350 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:09.233326 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-dqv5t" event={"ID":"846f55b3-19c5-447a-903f-8b67d43ceee5","Type":"ContainerStarted","Data":"8b237853adb571a4e1ca2727dbda3915c84f88b954e55222aaf27fc8e32923ce"} Jun 09 08:08:09.235074 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:09.235049 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" event={"ID":"c4da5275-f6b0-42da-9c7c-9603af20c3e3","Type":"ContainerDied","Data":"274193c674359264c770535ee3ffb130a78b604b50abd23393b276d15afbe6d8"} Jun 09 08:08:09.235144 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:09.235094 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065jftr" Jun 09 08:08:09.235187 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:09.235094 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="274193c674359264c770535ee3ffb130a78b604b50abd23393b276d15afbe6d8" Jun 09 08:08:13.261160 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:13.261123 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d" event={"ID":"7a60aabf-c648-4efa-9ac3-f7b2010cd32c","Type":"ContainerStarted","Data":"daac59493813db9b2c84c7848013cedc7df22c69610bda670846ceddc350957c"} Jun 09 08:08:13.261594 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:13.261242 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d" Jun 09 08:08:13.262761 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:13.262738 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-dqv5t" event={"ID":"846f55b3-19c5-447a-903f-8b67d43ceee5","Type":"ContainerStarted","Data":"4e25114bc3ee64909232e449bcd5153ecd0c1dc7815224134b3c4be6ce7209fb"} Jun 09 08:08:13.262877 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:13.262782 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-dqv5t" Jun 09 08:08:13.282045 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:13.282002 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d" podStartSLOduration=1.86199711 podStartE2EDuration="5.28198995s" totalImagesPullingTime="3.41999284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:08:13.279224542 +0000 UTC m=+620.949070560" watchObservedRunningTime="2026-06-09 08:08:13.28198995 +0000 UTC m=+620.951835965" Jun 09 08:08:13.297822 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:13.297780 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-dqv5t" podStartSLOduration=1.844044392 podStartE2EDuration="5.297768446s" totalImagesPullingTime="3.453724054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:08:13.296139455 +0000 UTC m=+620.965985470" watchObservedRunningTime="2026-06-09 08:08:13.297768446 +0000 UTC m=+620.967614482" Jun 09 08:08:16.215573 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:16.215536 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-7fzgx" Jun 09 08:08:16.217447 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:16.217429 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-cg7kp" Jun 09 08:08:17.220631 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.220597 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j"] Jun 09 08:08:17.229098 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.229080 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" Jun 09 08:08:17.233201 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.233182 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 08:08:17.233297 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.233224 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 08:08:17.234391 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.234374 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gmtrs\"" Jun 09 08:08:17.264960 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.264915 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j"] Jun 09 08:08:17.312705 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.312669 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/693f5966-76d4-45cb-bc9f-307352699443-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j\" (UID: \"693f5966-76d4-45cb-bc9f-307352699443\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" Jun 09 08:08:17.312907 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.312712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/693f5966-76d4-45cb-bc9f-307352699443-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j\" (UID: \"693f5966-76d4-45cb-bc9f-307352699443\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" Jun 09 08:08:17.312907 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.312747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpzqw\" (UniqueName: \"kubernetes.io/projected/693f5966-76d4-45cb-bc9f-307352699443-kube-api-access-mpzqw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j\" (UID: \"693f5966-76d4-45cb-bc9f-307352699443\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" Jun 09 08:08:17.413768 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.413732 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/693f5966-76d4-45cb-bc9f-307352699443-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j\" (UID: \"693f5966-76d4-45cb-bc9f-307352699443\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" Jun 09 08:08:17.413980 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.413784 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/693f5966-76d4-45cb-bc9f-307352699443-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j\" (UID: \"693f5966-76d4-45cb-bc9f-307352699443\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" Jun 09 08:08:17.413980 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.413821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpzqw\" (UniqueName: \"kubernetes.io/projected/693f5966-76d4-45cb-bc9f-307352699443-kube-api-access-mpzqw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j\" (UID: \"693f5966-76d4-45cb-bc9f-307352699443\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" Jun 09 08:08:17.414244 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.414222 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/693f5966-76d4-45cb-bc9f-307352699443-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j\" (UID: \"693f5966-76d4-45cb-bc9f-307352699443\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" Jun 09 08:08:17.414283 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.414236 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/693f5966-76d4-45cb-bc9f-307352699443-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j\" (UID: \"693f5966-76d4-45cb-bc9f-307352699443\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" Jun 09 08:08:17.425117 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.425082 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpzqw\" (UniqueName: \"kubernetes.io/projected/693f5966-76d4-45cb-bc9f-307352699443-kube-api-access-mpzqw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j\" (UID: \"693f5966-76d4-45cb-bc9f-307352699443\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" Jun 09 08:08:17.538701 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.538622 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" Jun 09 08:08:17.735027 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:17.734990 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j"] Jun 09 08:08:17.736174 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:08:17.736149 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693f5966_76d4_45cb_bc9f_307352699443.slice/crio-fddba5ea601d12589cb5d92754ad5f2fae6f718c90f858b1de599e0cc4a37000 WatchSource:0}: Error finding container fddba5ea601d12589cb5d92754ad5f2fae6f718c90f858b1de599e0cc4a37000: Status 404 returned error can't find the container with id fddba5ea601d12589cb5d92754ad5f2fae6f718c90f858b1de599e0cc4a37000 Jun 09 08:08:18.289924 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.289890 2577 generic.go:356] "Generic (PLEG): container finished" podID="693f5966-76d4-45cb-bc9f-307352699443" containerID="fcf2a9f36ba0bde399c943552f4a7f84cf0ee13a92c0bd06040bdc7e6855e7b1" exitCode=0 Jun 09 08:08:18.290302 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.289964 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" event={"ID":"693f5966-76d4-45cb-bc9f-307352699443","Type":"ContainerDied","Data":"fcf2a9f36ba0bde399c943552f4a7f84cf0ee13a92c0bd06040bdc7e6855e7b1"} Jun 09 08:08:18.290302 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.290014 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" event={"ID":"693f5966-76d4-45cb-bc9f-307352699443","Type":"ContainerStarted","Data":"fddba5ea601d12589cb5d92754ad5f2fae6f718c90f858b1de599e0cc4a37000"} Jun 09 08:08:18.640721 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.640644 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-lqs82"] Jun 09 08:08:18.644239 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.644219 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lqs82" Jun 09 08:08:18.649351 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.649325 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-wlc2q\"" Jun 09 08:08:18.649459 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.649388 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 08:08:18.649459 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.649411 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 08:08:18.663784 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.663762 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-lqs82"] Jun 09 08:08:18.726120 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.726096 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/19206145-d714-457d-a309-72cd49869e57-operator-config\") pod \"servicemesh-operator3-57f65f65fb-lqs82\" (UID: \"19206145-d714-457d-a309-72cd49869e57\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lqs82" Jun 09 08:08:18.726272 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.726163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nmsw\" (UniqueName: \"kubernetes.io/projected/19206145-d714-457d-a309-72cd49869e57-kube-api-access-7nmsw\") pod \"servicemesh-operator3-57f65f65fb-lqs82\" (UID: \"19206145-d714-457d-a309-72cd49869e57\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lqs82" Jun 09 08:08:18.826913 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.826887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nmsw\" (UniqueName: \"kubernetes.io/projected/19206145-d714-457d-a309-72cd49869e57-kube-api-access-7nmsw\") pod \"servicemesh-operator3-57f65f65fb-lqs82\" (UID: \"19206145-d714-457d-a309-72cd49869e57\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lqs82" Jun 09 08:08:18.827096 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.826998 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/19206145-d714-457d-a309-72cd49869e57-operator-config\") pod \"servicemesh-operator3-57f65f65fb-lqs82\" (UID: \"19206145-d714-457d-a309-72cd49869e57\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lqs82" Jun 09 08:08:18.829431 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.829411 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/19206145-d714-457d-a309-72cd49869e57-operator-config\") pod \"servicemesh-operator3-57f65f65fb-lqs82\" (UID: \"19206145-d714-457d-a309-72cd49869e57\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lqs82" Jun 09 08:08:18.840367 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.840347 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nmsw\" (UniqueName: \"kubernetes.io/projected/19206145-d714-457d-a309-72cd49869e57-kube-api-access-7nmsw\") pod \"servicemesh-operator3-57f65f65fb-lqs82\" (UID: \"19206145-d714-457d-a309-72cd49869e57\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lqs82" Jun 09 08:08:18.953226 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:18.953195 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lqs82" Jun 09 08:08:19.097204 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:19.097163 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-lqs82"] Jun 09 08:08:19.102602 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:08:19.102574 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19206145_d714_457d_a309_72cd49869e57.slice/crio-58a06e50cbe7fce2cb1cf46c6ad6cb893234f9cca907c2f498fcdcbe567b37a5 WatchSource:0}: Error finding container 58a06e50cbe7fce2cb1cf46c6ad6cb893234f9cca907c2f498fcdcbe567b37a5: Status 404 returned error can't find the container with id 58a06e50cbe7fce2cb1cf46c6ad6cb893234f9cca907c2f498fcdcbe567b37a5 Jun 09 08:08:19.296557 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:19.296482 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lqs82" event={"ID":"19206145-d714-457d-a309-72cd49869e57","Type":"ContainerStarted","Data":"58a06e50cbe7fce2cb1cf46c6ad6cb893234f9cca907c2f498fcdcbe567b37a5"} Jun 09 08:08:20.306661 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:20.306627 2577 generic.go:356] "Generic (PLEG): container finished" podID="693f5966-76d4-45cb-bc9f-307352699443" containerID="d20f80c4f8a18f3b4b0cdf9e24882a582fa808278355f69c42870808b2b1e71b" exitCode=0 Jun 09 08:08:20.307141 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:20.306712 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" event={"ID":"693f5966-76d4-45cb-bc9f-307352699443","Type":"ContainerDied","Data":"d20f80c4f8a18f3b4b0cdf9e24882a582fa808278355f69c42870808b2b1e71b"} Jun 09 08:08:21.315977 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:21.315917 2577 generic.go:356] "Generic (PLEG): container finished" podID="693f5966-76d4-45cb-bc9f-307352699443" containerID="87f008aa3fa6001170ed23a42a394f038541cd8cdf6c6cbae850f9fe485d768f" exitCode=0 Jun 09 08:08:21.315977 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:21.315964 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" event={"ID":"693f5966-76d4-45cb-bc9f-307352699443","Type":"ContainerDied","Data":"87f008aa3fa6001170ed23a42a394f038541cd8cdf6c6cbae850f9fe485d768f"} Jun 09 08:08:22.324361 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:22.324318 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lqs82" event={"ID":"19206145-d714-457d-a309-72cd49869e57","Type":"ContainerStarted","Data":"91a360fb5ace111620e7d8dd7c72d819e57ec1071b9b0eb05a6d777297a47e45"} Jun 09 08:08:22.324800 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:22.324388 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lqs82" Jun 09 08:08:22.347896 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:22.347843 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lqs82" podStartSLOduration=1.6083321910000001 podStartE2EDuration="4.347828316s" totalImagesPullingTime="2.739496125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:08:22.344427067 +0000 UTC m=+630.014273083" watchObservedRunningTime="2026-06-09 08:08:22.347828316 +0000 UTC m=+630.017674330" Jun 09 08:08:22.459502 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:22.459476 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" Jun 09 08:08:22.567809 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:22.567773 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/693f5966-76d4-45cb-bc9f-307352699443-util\") pod \"693f5966-76d4-45cb-bc9f-307352699443\" (UID: \"693f5966-76d4-45cb-bc9f-307352699443\") " Jun 09 08:08:22.568012 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:22.567827 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpzqw\" (UniqueName: \"kubernetes.io/projected/693f5966-76d4-45cb-bc9f-307352699443-kube-api-access-mpzqw\") pod \"693f5966-76d4-45cb-bc9f-307352699443\" (UID: \"693f5966-76d4-45cb-bc9f-307352699443\") " Jun 09 08:08:22.568012 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:22.567911 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/693f5966-76d4-45cb-bc9f-307352699443-bundle\") pod \"693f5966-76d4-45cb-bc9f-307352699443\" (UID: \"693f5966-76d4-45cb-bc9f-307352699443\") " Jun 09 08:08:22.568897 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:22.568871 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/693f5966-76d4-45cb-bc9f-307352699443-bundle" (OuterVolumeSpecName: "bundle") pod "693f5966-76d4-45cb-bc9f-307352699443" (UID: "693f5966-76d4-45cb-bc9f-307352699443"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:08:22.570049 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:22.570022 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/693f5966-76d4-45cb-bc9f-307352699443-kube-api-access-mpzqw" (OuterVolumeSpecName: "kube-api-access-mpzqw") pod "693f5966-76d4-45cb-bc9f-307352699443" (UID: "693f5966-76d4-45cb-bc9f-307352699443"). InnerVolumeSpecName "kube-api-access-mpzqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:08:22.573087 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:22.573056 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/693f5966-76d4-45cb-bc9f-307352699443-util" (OuterVolumeSpecName: "util") pod "693f5966-76d4-45cb-bc9f-307352699443" (UID: "693f5966-76d4-45cb-bc9f-307352699443"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:08:22.668674 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:22.668636 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/693f5966-76d4-45cb-bc9f-307352699443-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:08:22.668674 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:22.668667 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/693f5966-76d4-45cb-bc9f-307352699443-util\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:08:22.668674 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:22.668676 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpzqw\" (UniqueName: \"kubernetes.io/projected/693f5966-76d4-45cb-bc9f-307352699443-kube-api-access-mpzqw\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:08:23.331463 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:23.331433 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" Jun 09 08:08:23.331888 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:23.331459 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6sq7j" event={"ID":"693f5966-76d4-45cb-bc9f-307352699443","Type":"ContainerDied","Data":"fddba5ea601d12589cb5d92754ad5f2fae6f718c90f858b1de599e0cc4a37000"} Jun 09 08:08:23.331888 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:23.331508 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fddba5ea601d12589cb5d92754ad5f2fae6f718c90f858b1de599e0cc4a37000" Jun 09 08:08:28.657599 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.657568 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-75fff5c4cd-xggqr"] Jun 09 08:08:28.657999 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.657949 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693f5966-76d4-45cb-bc9f-307352699443" containerName="extract" Jun 09 08:08:28.657999 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.657962 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="693f5966-76d4-45cb-bc9f-307352699443" containerName="extract" Jun 09 08:08:28.657999 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.657982 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693f5966-76d4-45cb-bc9f-307352699443" containerName="util" Jun 09 08:08:28.657999 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.657988 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="693f5966-76d4-45cb-bc9f-307352699443" containerName="util" Jun 09 08:08:28.657999 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.657999 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="693f5966-76d4-45cb-bc9f-307352699443" containerName="pull" Jun 09 08:08:28.658184 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.658005 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="693f5966-76d4-45cb-bc9f-307352699443" containerName="pull" Jun 09 08:08:28.658184 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.658060 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="693f5966-76d4-45cb-bc9f-307352699443" containerName="extract" Jun 09 08:08:28.661444 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.661423 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-75fff5c4cd-xggqr" Jun 09 08:08:28.664111 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.664084 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zmpcp\"" Jun 09 08:08:28.664111 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.664084 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 08:08:28.671653 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.671624 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-75fff5c4cd-xggqr"] Jun 09 08:08:28.718752 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.718720 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a9eba66f-4e48-4aee-a3ad-4327f747ae14-redirect-config\") pod \"dashboard-redirect-75fff5c4cd-xggqr\" (UID: \"a9eba66f-4e48-4aee-a3ad-4327f747ae14\") " pod="opendatahub/dashboard-redirect-75fff5c4cd-xggqr" Jun 09 08:08:28.718920 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.718759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxlpn\" (UniqueName: \"kubernetes.io/projected/a9eba66f-4e48-4aee-a3ad-4327f747ae14-kube-api-access-rxlpn\") pod \"dashboard-redirect-75fff5c4cd-xggqr\" (UID: \"a9eba66f-4e48-4aee-a3ad-4327f747ae14\") " pod="opendatahub/dashboard-redirect-75fff5c4cd-xggqr" Jun 09 08:08:28.819883 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.819849 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a9eba66f-4e48-4aee-a3ad-4327f747ae14-redirect-config\") pod \"dashboard-redirect-75fff5c4cd-xggqr\" (UID: \"a9eba66f-4e48-4aee-a3ad-4327f747ae14\") " pod="opendatahub/dashboard-redirect-75fff5c4cd-xggqr" Jun 09 08:08:28.819883 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.819885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxlpn\" (UniqueName: \"kubernetes.io/projected/a9eba66f-4e48-4aee-a3ad-4327f747ae14-kube-api-access-rxlpn\") pod \"dashboard-redirect-75fff5c4cd-xggqr\" (UID: \"a9eba66f-4e48-4aee-a3ad-4327f747ae14\") " pod="opendatahub/dashboard-redirect-75fff5c4cd-xggqr" Jun 09 08:08:28.820559 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.820541 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a9eba66f-4e48-4aee-a3ad-4327f747ae14-redirect-config\") pod \"dashboard-redirect-75fff5c4cd-xggqr\" (UID: \"a9eba66f-4e48-4aee-a3ad-4327f747ae14\") " pod="opendatahub/dashboard-redirect-75fff5c4cd-xggqr" Jun 09 08:08:28.828427 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.828399 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxlpn\" (UniqueName: \"kubernetes.io/projected/a9eba66f-4e48-4aee-a3ad-4327f747ae14-kube-api-access-rxlpn\") pod \"dashboard-redirect-75fff5c4cd-xggqr\" (UID: \"a9eba66f-4e48-4aee-a3ad-4327f747ae14\") " pod="opendatahub/dashboard-redirect-75fff5c4cd-xggqr" Jun 09 08:08:28.972105 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:28.972072 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-75fff5c4cd-xggqr" Jun 09 08:08:29.104228 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:29.104205 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-75fff5c4cd-xggqr"] Jun 09 08:08:29.105886 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:08:29.105859 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9eba66f_4e48_4aee_a3ad_4327f747ae14.slice/crio-0053c5abd14c23fa4609ef35f47022bb1c247cefc7ac250a75eb2fb079ebd1a4 WatchSource:0}: Error finding container 0053c5abd14c23fa4609ef35f47022bb1c247cefc7ac250a75eb2fb079ebd1a4: Status 404 returned error can't find the container with id 0053c5abd14c23fa4609ef35f47022bb1c247cefc7ac250a75eb2fb079ebd1a4 Jun 09 08:08:29.361750 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:29.361681 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-75fff5c4cd-xggqr" event={"ID":"a9eba66f-4e48-4aee-a3ad-4327f747ae14","Type":"ContainerStarted","Data":"0053c5abd14c23fa4609ef35f47022bb1c247cefc7ac250a75eb2fb079ebd1a4"} Jun 09 08:08:31.374793 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:31.374755 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-75fff5c4cd-xggqr" event={"ID":"a9eba66f-4e48-4aee-a3ad-4327f747ae14","Type":"ContainerStarted","Data":"7ae7be86e90f3de54f045c2db2e0b5c472531b425e98b8cad564c2f0dd4eebcb"} Jun 09 08:08:31.393085 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:31.393040 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-75fff5c4cd-xggqr" podStartSLOduration=1.596447524 podStartE2EDuration="3.393027029s" totalImagesPullingTime="1.796579505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:08:31.391192561 +0000 UTC m=+639.061038575" watchObservedRunningTime="2026-06-09 08:08:31.393027029 +0000 UTC m=+639.062873044" Jun 09 08:08:33.334120 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:33.334095 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lqs82" Jun 09 08:08:44.269571 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:44.269541 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-q954d" Jun 09 08:08:44.272857 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:44.272833 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-dqv5t" Jun 09 08:08:59.796168 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:59.796134 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d8s7r"] Jun 09 08:08:59.811855 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:59.811831 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d8s7r"] Jun 09 08:08:59.812011 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:59.811912 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d8s7r" Jun 09 08:08:59.814789 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:59.814765 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 08:08:59.814948 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:59.814767 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 08:08:59.814948 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:59.814809 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-7554d\"" Jun 09 08:08:59.968041 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:08:59.968011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx6nd\" (UniqueName: \"kubernetes.io/projected/3a795072-8041-44b6-b6fc-5b03fe719955-kube-api-access-xx6nd\") pod \"kuadrant-operator-catalog-d8s7r\" (UID: \"3a795072-8041-44b6-b6fc-5b03fe719955\") " pod="kuadrant-system/kuadrant-operator-catalog-d8s7r" Jun 09 08:09:00.069419 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:00.069346 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx6nd\" (UniqueName: \"kubernetes.io/projected/3a795072-8041-44b6-b6fc-5b03fe719955-kube-api-access-xx6nd\") pod \"kuadrant-operator-catalog-d8s7r\" (UID: \"3a795072-8041-44b6-b6fc-5b03fe719955\") " pod="kuadrant-system/kuadrant-operator-catalog-d8s7r" Jun 09 08:09:00.077792 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:00.077766 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx6nd\" (UniqueName: \"kubernetes.io/projected/3a795072-8041-44b6-b6fc-5b03fe719955-kube-api-access-xx6nd\") pod \"kuadrant-operator-catalog-d8s7r\" (UID: \"3a795072-8041-44b6-b6fc-5b03fe719955\") " pod="kuadrant-system/kuadrant-operator-catalog-d8s7r" Jun 09 08:09:00.121856 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:00.121833 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d8s7r" Jun 09 08:09:00.158642 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:00.158614 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d8s7r"] Jun 09 08:09:00.258273 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:00.258251 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d8s7r"] Jun 09 08:09:00.259983 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:09:00.259955 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a795072_8041_44b6_b6fc_5b03fe719955.slice/crio-bc223995cd01668a66fc8dabdaef42cfa6829ddc5da9f8c6450fe3d8df24017d WatchSource:0}: Error finding container bc223995cd01668a66fc8dabdaef42cfa6829ddc5da9f8c6450fe3d8df24017d: Status 404 returned error can't find the container with id bc223995cd01668a66fc8dabdaef42cfa6829ddc5da9f8c6450fe3d8df24017d Jun 09 08:09:00.369265 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:00.369205 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88v9w"] Jun 09 08:09:00.374048 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:00.374033 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-88v9w" Jun 09 08:09:00.379531 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:00.379510 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88v9w"] Jun 09 08:09:00.474284 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:00.474264 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvbnv\" (UniqueName: \"kubernetes.io/projected/30dc06e1-26de-480f-ae9e-b5b9f5b44d2d-kube-api-access-dvbnv\") pod \"kuadrant-operator-catalog-88v9w\" (UID: \"30dc06e1-26de-480f-ae9e-b5b9f5b44d2d\") " pod="kuadrant-system/kuadrant-operator-catalog-88v9w" Jun 09 08:09:00.538704 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:00.538676 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d8s7r" event={"ID":"3a795072-8041-44b6-b6fc-5b03fe719955","Type":"ContainerStarted","Data":"bc223995cd01668a66fc8dabdaef42cfa6829ddc5da9f8c6450fe3d8df24017d"} Jun 09 08:09:00.575127 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:00.575104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvbnv\" (UniqueName: \"kubernetes.io/projected/30dc06e1-26de-480f-ae9e-b5b9f5b44d2d-kube-api-access-dvbnv\") pod \"kuadrant-operator-catalog-88v9w\" (UID: \"30dc06e1-26de-480f-ae9e-b5b9f5b44d2d\") " pod="kuadrant-system/kuadrant-operator-catalog-88v9w" Jun 09 08:09:00.584643 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:00.584626 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvbnv\" (UniqueName: \"kubernetes.io/projected/30dc06e1-26de-480f-ae9e-b5b9f5b44d2d-kube-api-access-dvbnv\") pod \"kuadrant-operator-catalog-88v9w\" (UID: \"30dc06e1-26de-480f-ae9e-b5b9f5b44d2d\") " pod="kuadrant-system/kuadrant-operator-catalog-88v9w" Jun 09 08:09:00.684327 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:00.684307 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-88v9w" Jun 09 08:09:00.823328 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:00.823303 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-88v9w"] Jun 09 08:09:00.825614 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:09:00.825587 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30dc06e1_26de_480f_ae9e_b5b9f5b44d2d.slice/crio-0c0058db43fea83dbe71169b7d3a0b220995a285a6e3c8fb642020dc3f420f8a WatchSource:0}: Error finding container 0c0058db43fea83dbe71169b7d3a0b220995a285a6e3c8fb642020dc3f420f8a: Status 404 returned error can't find the container with id 0c0058db43fea83dbe71169b7d3a0b220995a285a6e3c8fb642020dc3f420f8a Jun 09 08:09:01.545649 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:01.545608 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-88v9w" event={"ID":"30dc06e1-26de-480f-ae9e-b5b9f5b44d2d","Type":"ContainerStarted","Data":"0c0058db43fea83dbe71169b7d3a0b220995a285a6e3c8fb642020dc3f420f8a"} Jun 09 08:09:03.496977 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.496922 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6"] Jun 09 08:09:03.502191 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.502175 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.502904 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.502883 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.503033 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.502910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.503033 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.502966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.503033 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.502989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.503159 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.503039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.503159 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.503064 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.503159 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.503086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxpws\" (UniqueName: \"kubernetes.io/projected/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-kube-api-access-bxpws\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.504679 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.504655 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 08:09:03.504790 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.504706 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 08:09:03.504790 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.504760 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 08:09:03.504790 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.504767 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7964k\"" Jun 09 08:09:03.504987 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.504974 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 08:09:03.511724 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.511696 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6"] Jun 09 08:09:03.557864 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.557830 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-88v9w" event={"ID":"30dc06e1-26de-480f-ae9e-b5b9f5b44d2d","Type":"ContainerStarted","Data":"bc2f2534fe71c398194cd246c1119d4844f830afe79c87588be87d2026487e85"} Jun 09 08:09:03.559264 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.559243 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d8s7r" event={"ID":"3a795072-8041-44b6-b6fc-5b03fe719955","Type":"ContainerStarted","Data":"bc6463055811cfd71a17e285e2d8593291b5fb5824d2df2cae422a91eaca76d2"} Jun 09 08:09:03.559359 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.559334 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-d8s7r" podUID="3a795072-8041-44b6-b6fc-5b03fe719955" containerName="registry-server" containerID="cri-o://bc6463055811cfd71a17e285e2d8593291b5fb5824d2df2cae422a91eaca76d2" gracePeriod=2 Jun 09 08:09:03.576040 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.576000 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-88v9w" podStartSLOduration=1.8363573949999998 podStartE2EDuration="3.575986231s" totalImagesPullingTime="1.739628836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:09:03.575064922 +0000 UTC m=+671.244910937" watchObservedRunningTime="2026-06-09 08:09:03.575986231 +0000 UTC m=+671.245832243" Jun 09 08:09:03.591461 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.591421 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-d8s7r" podStartSLOduration=2.289011496 podStartE2EDuration="4.591407125s" totalImagesPullingTime="2.302395629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:09:03.58990865 +0000 UTC m=+671.259754678" watchObservedRunningTime="2026-06-09 08:09:03.591407125 +0000 UTC m=+671.261253140" Jun 09 08:09:03.603560 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.603531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.603657 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.603568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.603839 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.603819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxpws\" (UniqueName: \"kubernetes.io/projected/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-kube-api-access-bxpws\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.603904 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.603895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.603986 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.603918 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.603986 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.603972 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.604108 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.603988 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.604584 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.604561 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.606036 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.606011 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.606135 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.606053 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.606135 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.606067 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.606236 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.606160 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.612303 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.612284 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.612376 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.612292 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxpws\" (UniqueName: \"kubernetes.io/projected/5ec9720b-5ee1-4a07-b7cb-41e47d10e128-kube-api-access-bxpws\") pod \"istiod-openshift-gateway-75c67f8887-shvk6\" (UID: \"5ec9720b-5ee1-4a07-b7cb-41e47d10e128\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.812780 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.812755 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d8s7r" Jun 09 08:09:03.812894 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.812762 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:03.906037 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.905950 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx6nd\" (UniqueName: \"kubernetes.io/projected/3a795072-8041-44b6-b6fc-5b03fe719955-kube-api-access-xx6nd\") pod \"3a795072-8041-44b6-b6fc-5b03fe719955\" (UID: \"3a795072-8041-44b6-b6fc-5b03fe719955\") " Jun 09 08:09:03.909402 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.909367 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a795072-8041-44b6-b6fc-5b03fe719955-kube-api-access-xx6nd" (OuterVolumeSpecName: "kube-api-access-xx6nd") pod "3a795072-8041-44b6-b6fc-5b03fe719955" (UID: "3a795072-8041-44b6-b6fc-5b03fe719955"). InnerVolumeSpecName "kube-api-access-xx6nd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:09:03.950543 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.950509 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6"] Jun 09 08:09:03.951736 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:09:03.951713 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec9720b_5ee1_4a07_b7cb_41e47d10e128.slice/crio-2040397574a489335f320d316d1da7a78c5def7812d8c8c5d45cb68a28e07f29 WatchSource:0}: Error finding container 2040397574a489335f320d316d1da7a78c5def7812d8c8c5d45cb68a28e07f29: Status 404 returned error can't find the container with id 2040397574a489335f320d316d1da7a78c5def7812d8c8c5d45cb68a28e07f29 Jun 09 08:09:03.953847 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:03.953828 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 08:09:04.006837 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:04.006816 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx6nd\" (UniqueName: \"kubernetes.io/projected/3a795072-8041-44b6-b6fc-5b03fe719955-kube-api-access-xx6nd\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:04.566464 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:04.566363 2577 generic.go:356] "Generic (PLEG): container finished" podID="3a795072-8041-44b6-b6fc-5b03fe719955" containerID="bc6463055811cfd71a17e285e2d8593291b5fb5824d2df2cae422a91eaca76d2" exitCode=0 Jun 09 08:09:04.566464 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:04.566404 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d8s7r" Jun 09 08:09:04.566973 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:04.566466 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d8s7r" event={"ID":"3a795072-8041-44b6-b6fc-5b03fe719955","Type":"ContainerDied","Data":"bc6463055811cfd71a17e285e2d8593291b5fb5824d2df2cae422a91eaca76d2"} Jun 09 08:09:04.566973 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:04.566524 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d8s7r" event={"ID":"3a795072-8041-44b6-b6fc-5b03fe719955","Type":"ContainerDied","Data":"bc223995cd01668a66fc8dabdaef42cfa6829ddc5da9f8c6450fe3d8df24017d"} Jun 09 08:09:04.566973 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:04.566550 2577 scope.go:117] "RemoveContainer" containerID="bc6463055811cfd71a17e285e2d8593291b5fb5824d2df2cae422a91eaca76d2" Jun 09 08:09:04.568070 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:04.568044 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" event={"ID":"5ec9720b-5ee1-4a07-b7cb-41e47d10e128","Type":"ContainerStarted","Data":"2040397574a489335f320d316d1da7a78c5def7812d8c8c5d45cb68a28e07f29"} Jun 09 08:09:04.576763 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:04.576744 2577 scope.go:117] "RemoveContainer" containerID="bc6463055811cfd71a17e285e2d8593291b5fb5824d2df2cae422a91eaca76d2" Jun 09 08:09:04.577071 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:09:04.577055 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc6463055811cfd71a17e285e2d8593291b5fb5824d2df2cae422a91eaca76d2\": container with ID starting with bc6463055811cfd71a17e285e2d8593291b5fb5824d2df2cae422a91eaca76d2 not found: ID does not exist" containerID="bc6463055811cfd71a17e285e2d8593291b5fb5824d2df2cae422a91eaca76d2" Jun 09 08:09:04.577114 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:04.577087 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc6463055811cfd71a17e285e2d8593291b5fb5824d2df2cae422a91eaca76d2"} err="failed to get container status \"bc6463055811cfd71a17e285e2d8593291b5fb5824d2df2cae422a91eaca76d2\": rpc error: code = NotFound desc = could not find container \"bc6463055811cfd71a17e285e2d8593291b5fb5824d2df2cae422a91eaca76d2\": container with ID starting with bc6463055811cfd71a17e285e2d8593291b5fb5824d2df2cae422a91eaca76d2 not found: ID does not exist" Jun 09 08:09:04.589508 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:04.589477 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d8s7r"] Jun 09 08:09:04.593231 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:04.593209 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d8s7r"] Jun 09 08:09:04.792444 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:04.792413 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a795072-8041-44b6-b6fc-5b03fe719955" path="/var/lib/kubelet/pods/3a795072-8041-44b6-b6fc-5b03fe719955/volumes" Jun 09 08:09:06.294508 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:06.294460 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 08:09:06.294775 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:06.294538 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 08:09:06.582025 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:06.581946 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" event={"ID":"5ec9720b-5ee1-4a07-b7cb-41e47d10e128","Type":"ContainerStarted","Data":"79a208833509c1815a9f63b0541b3a6a15e627e755f9ee6562910147650c9ff3"} Jun 09 08:09:06.582025 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:06.582014 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:06.605474 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:06.605424 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" podStartSLOduration=1.2652164799999999 podStartE2EDuration="3.605407945s" totalImagesPullingTime="2.340191465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:09:06.60216527 +0000 UTC m=+674.272011289" watchObservedRunningTime="2026-06-09 08:09:06.605407945 +0000 UTC m=+674.275253963" Jun 09 08:09:07.589624 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:07.589597 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-shvk6" Jun 09 08:09:09.428101 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.428067 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-748dbb7b45-96msb"] Jun 09 08:09:09.428735 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.428712 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a795072-8041-44b6-b6fc-5b03fe719955" containerName="registry-server" Jun 09 08:09:09.428735 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.428737 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a795072-8041-44b6-b6fc-5b03fe719955" containerName="registry-server" Jun 09 08:09:09.428874 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.428842 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a795072-8041-44b6-b6fc-5b03fe719955" containerName="registry-server" Jun 09 08:09:09.432168 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.432144 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.442669 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.442648 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-748dbb7b45-96msb"] Jun 09 08:09:09.456727 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.456699 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-console-oauth-config\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.456835 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.456733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-oauth-serving-cert\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.456903 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.456855 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-console-config\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.456903 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.456894 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-service-ca\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.457041 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.456969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-trusted-ca-bundle\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.457041 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.456996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf9bl\" (UniqueName: \"kubernetes.io/projected/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-kube-api-access-cf9bl\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.457130 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.457040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-console-serving-cert\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.557734 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.557707 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-console-config\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.557833 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.557744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-service-ca\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.557833 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.557781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-trusted-ca-bundle\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.557833 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.557804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf9bl\" (UniqueName: \"kubernetes.io/projected/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-kube-api-access-cf9bl\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.557833 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.557831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-console-serving-cert\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.558092 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.557870 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-console-oauth-config\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.558092 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.557897 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-oauth-serving-cert\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.558530 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.558503 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-console-config\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.558624 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.558589 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-service-ca\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.558712 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.558690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-oauth-serving-cert\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.558760 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.558697 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-trusted-ca-bundle\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.560348 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.560320 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-console-oauth-config\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.560425 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.560404 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-console-serving-cert\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.566791 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.566774 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf9bl\" (UniqueName: \"kubernetes.io/projected/7eb6c6dc-1d3f-496f-8cc5-0723620c59ad-kube-api-access-cf9bl\") pod \"console-748dbb7b45-96msb\" (UID: \"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad\") " pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.742776 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.742711 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:09.874335 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:09.874312 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-748dbb7b45-96msb"] Jun 09 08:09:09.875877 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:09:09.875851 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb6c6dc_1d3f_496f_8cc5_0723620c59ad.slice/crio-b14b84eef85640294a5f63b750aef9a427a7b9ee22f76ddd9df72447b74ffc2a WatchSource:0}: Error finding container b14b84eef85640294a5f63b750aef9a427a7b9ee22f76ddd9df72447b74ffc2a: Status 404 returned error can't find the container with id b14b84eef85640294a5f63b750aef9a427a7b9ee22f76ddd9df72447b74ffc2a Jun 09 08:09:10.607878 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:10.607847 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748dbb7b45-96msb" event={"ID":"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad","Type":"ContainerStarted","Data":"b5dedde6e6440feac3aaf5d8649b944f766d125338ce061ff0805e69b4ee6e34"} Jun 09 08:09:10.608240 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:10.607891 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748dbb7b45-96msb" event={"ID":"7eb6c6dc-1d3f-496f-8cc5-0723620c59ad","Type":"ContainerStarted","Data":"b14b84eef85640294a5f63b750aef9a427a7b9ee22f76ddd9df72447b74ffc2a"} Jun 09 08:09:10.630108 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:10.630065 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-748dbb7b45-96msb" podStartSLOduration=1.6300510510000001 podStartE2EDuration="1.630051051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:09:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:09:10.627957998 +0000 UTC m=+678.297804015" watchObservedRunningTime="2026-06-09 08:09:10.630051051 +0000 UTC m=+678.299897066" Jun 09 08:09:10.684459 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:10.684437 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-88v9w" Jun 09 08:09:10.684595 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:10.684495 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-88v9w" Jun 09 08:09:10.706292 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:10.706270 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-88v9w" Jun 09 08:09:11.634662 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:11.634631 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-88v9w" Jun 09 08:09:15.122333 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.122303 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr"] Jun 09 08:09:15.125578 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.125562 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" Jun 09 08:09:15.128170 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.128149 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7vhhw\"" Jun 09 08:09:15.134096 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.134072 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr"] Jun 09 08:09:15.207983 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.207961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c75f19-58d6-4c91-9a0c-2b328578a77a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr\" (UID: \"20c75f19-58d6-4c91-9a0c-2b328578a77a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" Jun 09 08:09:15.208082 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.207995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c75f19-58d6-4c91-9a0c-2b328578a77a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr\" (UID: \"20c75f19-58d6-4c91-9a0c-2b328578a77a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" Jun 09 08:09:15.208082 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.208049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6x2k\" (UniqueName: \"kubernetes.io/projected/20c75f19-58d6-4c91-9a0c-2b328578a77a-kube-api-access-m6x2k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr\" (UID: \"20c75f19-58d6-4c91-9a0c-2b328578a77a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" Jun 09 08:09:15.309345 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.309324 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c75f19-58d6-4c91-9a0c-2b328578a77a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr\" (UID: \"20c75f19-58d6-4c91-9a0c-2b328578a77a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" Jun 09 08:09:15.309451 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.309356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c75f19-58d6-4c91-9a0c-2b328578a77a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr\" (UID: \"20c75f19-58d6-4c91-9a0c-2b328578a77a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" Jun 09 08:09:15.309451 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.309385 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6x2k\" (UniqueName: \"kubernetes.io/projected/20c75f19-58d6-4c91-9a0c-2b328578a77a-kube-api-access-m6x2k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr\" (UID: \"20c75f19-58d6-4c91-9a0c-2b328578a77a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" Jun 09 08:09:15.309725 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.309708 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c75f19-58d6-4c91-9a0c-2b328578a77a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr\" (UID: \"20c75f19-58d6-4c91-9a0c-2b328578a77a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" Jun 09 08:09:15.309765 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.309746 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c75f19-58d6-4c91-9a0c-2b328578a77a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr\" (UID: \"20c75f19-58d6-4c91-9a0c-2b328578a77a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" Jun 09 08:09:15.318167 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.318150 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6x2k\" (UniqueName: \"kubernetes.io/projected/20c75f19-58d6-4c91-9a0c-2b328578a77a-kube-api-access-m6x2k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr\" (UID: \"20c75f19-58d6-4c91-9a0c-2b328578a77a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" Jun 09 08:09:15.436269 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.436249 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" Jun 09 08:09:15.569950 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.569908 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr"] Jun 09 08:09:15.571817 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:09:15.571789 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c75f19_58d6_4c91_9a0c_2b328578a77a.slice/crio-3c8d88d5277eb29b3ec00f9699172ba4c738b99ebb7776c08a344c45758dd79e WatchSource:0}: Error finding container 3c8d88d5277eb29b3ec00f9699172ba4c738b99ebb7776c08a344c45758dd79e: Status 404 returned error can't find the container with id 3c8d88d5277eb29b3ec00f9699172ba4c738b99ebb7776c08a344c45758dd79e Jun 09 08:09:15.635980 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.635956 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" event={"ID":"20c75f19-58d6-4c91-9a0c-2b328578a77a","Type":"ContainerStarted","Data":"3c8d88d5277eb29b3ec00f9699172ba4c738b99ebb7776c08a344c45758dd79e"} Jun 09 08:09:15.721583 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.721526 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct"] Jun 09 08:09:15.725216 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.725201 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" Jun 09 08:09:15.732440 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.732419 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct"] Jun 09 08:09:15.816085 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.816060 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f69fd8b-7e99-404b-82ed-f72d09034747-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct\" (UID: \"1f69fd8b-7e99-404b-82ed-f72d09034747\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" Jun 09 08:09:15.816195 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.816101 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f69fd8b-7e99-404b-82ed-f72d09034747-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct\" (UID: \"1f69fd8b-7e99-404b-82ed-f72d09034747\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" Jun 09 08:09:15.816195 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.816142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prmmq\" (UniqueName: \"kubernetes.io/projected/1f69fd8b-7e99-404b-82ed-f72d09034747-kube-api-access-prmmq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct\" (UID: \"1f69fd8b-7e99-404b-82ed-f72d09034747\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" Jun 09 08:09:15.917334 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.917306 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f69fd8b-7e99-404b-82ed-f72d09034747-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct\" (UID: \"1f69fd8b-7e99-404b-82ed-f72d09034747\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" Jun 09 08:09:15.917422 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.917382 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f69fd8b-7e99-404b-82ed-f72d09034747-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct\" (UID: \"1f69fd8b-7e99-404b-82ed-f72d09034747\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" Jun 09 08:09:15.917461 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.917421 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prmmq\" (UniqueName: \"kubernetes.io/projected/1f69fd8b-7e99-404b-82ed-f72d09034747-kube-api-access-prmmq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct\" (UID: \"1f69fd8b-7e99-404b-82ed-f72d09034747\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" Jun 09 08:09:15.917555 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.917533 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f69fd8b-7e99-404b-82ed-f72d09034747-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct\" (UID: \"1f69fd8b-7e99-404b-82ed-f72d09034747\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" Jun 09 08:09:15.917668 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.917653 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f69fd8b-7e99-404b-82ed-f72d09034747-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct\" (UID: \"1f69fd8b-7e99-404b-82ed-f72d09034747\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" Jun 09 08:09:15.926475 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:15.926453 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prmmq\" (UniqueName: \"kubernetes.io/projected/1f69fd8b-7e99-404b-82ed-f72d09034747-kube-api-access-prmmq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct\" (UID: \"1f69fd8b-7e99-404b-82ed-f72d09034747\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" Jun 09 08:09:16.051160 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.051090 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" Jun 09 08:09:16.179290 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.179264 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct"] Jun 09 08:09:16.180653 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:09:16.180628 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f69fd8b_7e99_404b_82ed_f72d09034747.slice/crio-46f0881732df4d081731adc23204d6e28a721b04f317f1ff62bbf51e45340c4d WatchSource:0}: Error finding container 46f0881732df4d081731adc23204d6e28a721b04f317f1ff62bbf51e45340c4d: Status 404 returned error can't find the container with id 46f0881732df4d081731adc23204d6e28a721b04f317f1ff62bbf51e45340c4d Jun 09 08:09:16.324596 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.324538 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf"] Jun 09 08:09:16.328315 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.328300 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" Jun 09 08:09:16.335706 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.335682 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf"] Jun 09 08:09:16.421134 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.421108 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e5960cf-1e65-48f6-aaf5-8d277e963839-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf\" (UID: \"8e5960cf-1e65-48f6-aaf5-8d277e963839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" Jun 09 08:09:16.421250 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.421198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e5960cf-1e65-48f6-aaf5-8d277e963839-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf\" (UID: \"8e5960cf-1e65-48f6-aaf5-8d277e963839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" Jun 09 08:09:16.421250 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.421239 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57c5r\" (UniqueName: \"kubernetes.io/projected/8e5960cf-1e65-48f6-aaf5-8d277e963839-kube-api-access-57c5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf\" (UID: \"8e5960cf-1e65-48f6-aaf5-8d277e963839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" Jun 09 08:09:16.522301 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.522277 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e5960cf-1e65-48f6-aaf5-8d277e963839-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf\" (UID: \"8e5960cf-1e65-48f6-aaf5-8d277e963839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" Jun 09 08:09:16.522385 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.522312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57c5r\" (UniqueName: \"kubernetes.io/projected/8e5960cf-1e65-48f6-aaf5-8d277e963839-kube-api-access-57c5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf\" (UID: \"8e5960cf-1e65-48f6-aaf5-8d277e963839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" Jun 09 08:09:16.522437 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.522384 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e5960cf-1e65-48f6-aaf5-8d277e963839-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf\" (UID: \"8e5960cf-1e65-48f6-aaf5-8d277e963839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" Jun 09 08:09:16.522707 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.522688 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e5960cf-1e65-48f6-aaf5-8d277e963839-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf\" (UID: \"8e5960cf-1e65-48f6-aaf5-8d277e963839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" Jun 09 08:09:16.522747 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.522716 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e5960cf-1e65-48f6-aaf5-8d277e963839-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf\" (UID: \"8e5960cf-1e65-48f6-aaf5-8d277e963839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" Jun 09 08:09:16.529889 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.529864 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57c5r\" (UniqueName: \"kubernetes.io/projected/8e5960cf-1e65-48f6-aaf5-8d277e963839-kube-api-access-57c5r\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf\" (UID: \"8e5960cf-1e65-48f6-aaf5-8d277e963839\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" Jun 09 08:09:16.643347 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.643284 2577 generic.go:356] "Generic (PLEG): container finished" podID="20c75f19-58d6-4c91-9a0c-2b328578a77a" containerID="23a702e22de45d379d8db6d16475e83bc617480489120b54c58c6fc89a03ca92" exitCode=0 Jun 09 08:09:16.643440 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.643362 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" event={"ID":"20c75f19-58d6-4c91-9a0c-2b328578a77a","Type":"ContainerDied","Data":"23a702e22de45d379d8db6d16475e83bc617480489120b54c58c6fc89a03ca92"} Jun 09 08:09:16.645033 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.645012 2577 generic.go:356] "Generic (PLEG): container finished" podID="1f69fd8b-7e99-404b-82ed-f72d09034747" containerID="304c04e2b9311ab47de2e18bbb9d66225377d35d5eba5689305f82f98a4aa547" exitCode=0 Jun 09 08:09:16.645116 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.645089 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" event={"ID":"1f69fd8b-7e99-404b-82ed-f72d09034747","Type":"ContainerDied","Data":"304c04e2b9311ab47de2e18bbb9d66225377d35d5eba5689305f82f98a4aa547"} Jun 09 08:09:16.645158 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.645126 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" event={"ID":"1f69fd8b-7e99-404b-82ed-f72d09034747","Type":"ContainerStarted","Data":"46f0881732df4d081731adc23204d6e28a721b04f317f1ff62bbf51e45340c4d"} Jun 09 08:09:16.660613 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.660593 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" Jun 09 08:09:16.719667 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.719623 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b"] Jun 09 08:09:16.724628 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.724605 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" Jun 09 08:09:16.733845 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.733818 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b"] Jun 09 08:09:16.798476 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.798440 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf"] Jun 09 08:09:16.800051 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:09:16.800027 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5960cf_1e65_48f6_aaf5_8d277e963839.slice/crio-e9c28354048789565be737c6f8275757d20d801f111b1512245a1cdc40ed9624 WatchSource:0}: Error finding container e9c28354048789565be737c6f8275757d20d801f111b1512245a1cdc40ed9624: Status 404 returned error can't find the container with id e9c28354048789565be737c6f8275757d20d801f111b1512245a1cdc40ed9624 Jun 09 08:09:16.825137 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.825113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acccb45b-e7f2-4343-b52b-1f1a0dfff882-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b\" (UID: \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" Jun 09 08:09:16.825313 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.825144 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx89n\" (UniqueName: \"kubernetes.io/projected/acccb45b-e7f2-4343-b52b-1f1a0dfff882-kube-api-access-nx89n\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b\" (UID: \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" Jun 09 08:09:16.825313 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.825188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acccb45b-e7f2-4343-b52b-1f1a0dfff882-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b\" (UID: \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" Jun 09 08:09:16.926490 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.926464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acccb45b-e7f2-4343-b52b-1f1a0dfff882-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b\" (UID: \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" Jun 09 08:09:16.926589 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.926495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx89n\" (UniqueName: \"kubernetes.io/projected/acccb45b-e7f2-4343-b52b-1f1a0dfff882-kube-api-access-nx89n\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b\" (UID: \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" Jun 09 08:09:16.926589 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.926528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acccb45b-e7f2-4343-b52b-1f1a0dfff882-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b\" (UID: \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" Jun 09 08:09:16.926814 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.926794 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acccb45b-e7f2-4343-b52b-1f1a0dfff882-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b\" (UID: \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" Jun 09 08:09:16.926879 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.926856 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acccb45b-e7f2-4343-b52b-1f1a0dfff882-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b\" (UID: \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" Jun 09 08:09:16.935042 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:16.935026 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx89n\" (UniqueName: \"kubernetes.io/projected/acccb45b-e7f2-4343-b52b-1f1a0dfff882-kube-api-access-nx89n\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b\" (UID: \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" Jun 09 08:09:17.035522 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:17.035501 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" Jun 09 08:09:17.168510 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:17.168483 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b"] Jun 09 08:09:17.169169 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:09:17.169139 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacccb45b_e7f2_4343_b52b_1f1a0dfff882.slice/crio-9728f98c928405281bc935f049dbdbe65eeae9efeda0db472a072972b25c4d6e WatchSource:0}: Error finding container 9728f98c928405281bc935f049dbdbe65eeae9efeda0db472a072972b25c4d6e: Status 404 returned error can't find the container with id 9728f98c928405281bc935f049dbdbe65eeae9efeda0db472a072972b25c4d6e Jun 09 08:09:17.653587 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:17.653561 2577 generic.go:356] "Generic (PLEG): container finished" podID="acccb45b-e7f2-4343-b52b-1f1a0dfff882" containerID="bf14e1fb7ae680f8148eeea29537f6145ed9afd82175f3625146fc5ef12e32da" exitCode=0 Jun 09 08:09:17.653909 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:17.653644 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" event={"ID":"acccb45b-e7f2-4343-b52b-1f1a0dfff882","Type":"ContainerDied","Data":"bf14e1fb7ae680f8148eeea29537f6145ed9afd82175f3625146fc5ef12e32da"} Jun 09 08:09:17.653909 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:17.653690 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" event={"ID":"acccb45b-e7f2-4343-b52b-1f1a0dfff882","Type":"ContainerStarted","Data":"9728f98c928405281bc935f049dbdbe65eeae9efeda0db472a072972b25c4d6e"} Jun 09 08:09:17.655434 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:17.655411 2577 generic.go:356] "Generic (PLEG): container finished" podID="8e5960cf-1e65-48f6-aaf5-8d277e963839" containerID="d86c0c8c99a1c4318c00463e95f4aa81ac8ce4298c6e9fc186a183b6138ecadc" exitCode=0 Jun 09 08:09:17.655538 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:17.655521 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" event={"ID":"8e5960cf-1e65-48f6-aaf5-8d277e963839","Type":"ContainerDied","Data":"d86c0c8c99a1c4318c00463e95f4aa81ac8ce4298c6e9fc186a183b6138ecadc"} Jun 09 08:09:17.655610 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:17.655560 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" event={"ID":"8e5960cf-1e65-48f6-aaf5-8d277e963839","Type":"ContainerStarted","Data":"e9c28354048789565be737c6f8275757d20d801f111b1512245a1cdc40ed9624"} Jun 09 08:09:18.669199 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:18.669170 2577 generic.go:356] "Generic (PLEG): container finished" podID="1f69fd8b-7e99-404b-82ed-f72d09034747" containerID="6791c25229756d6814c58730d40e06848ce6b4e7cb67235e1bd4914a59e9f91c" exitCode=0 Jun 09 08:09:18.669575 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:18.669206 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" event={"ID":"1f69fd8b-7e99-404b-82ed-f72d09034747","Type":"ContainerDied","Data":"6791c25229756d6814c58730d40e06848ce6b4e7cb67235e1bd4914a59e9f91c"} Jun 09 08:09:18.671200 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:18.671183 2577 generic.go:356] "Generic (PLEG): container finished" podID="8e5960cf-1e65-48f6-aaf5-8d277e963839" containerID="0478352fca42c7ee6710c17e2290ce9e339a0113fd826e2865978e282f68017d" exitCode=0 Jun 09 08:09:18.671291 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:18.671269 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" event={"ID":"8e5960cf-1e65-48f6-aaf5-8d277e963839","Type":"ContainerDied","Data":"0478352fca42c7ee6710c17e2290ce9e339a0113fd826e2865978e282f68017d"} Jun 09 08:09:18.673268 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:18.673248 2577 generic.go:356] "Generic (PLEG): container finished" podID="20c75f19-58d6-4c91-9a0c-2b328578a77a" containerID="6b0218f03aabd0fce0837797bf2a6276f1a388d0752adfc22c4aef3781687aba" exitCode=0 Jun 09 08:09:18.673357 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:18.673322 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" event={"ID":"20c75f19-58d6-4c91-9a0c-2b328578a77a","Type":"ContainerDied","Data":"6b0218f03aabd0fce0837797bf2a6276f1a388d0752adfc22c4aef3781687aba"} Jun 09 08:09:18.675236 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:18.675215 2577 generic.go:356] "Generic (PLEG): container finished" podID="acccb45b-e7f2-4343-b52b-1f1a0dfff882" containerID="d62ee7a9a184dcc07cdf13d175325aae6e33ac66e1bae5449a13bd0d5ba72a2c" exitCode=0 Jun 09 08:09:18.675322 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:18.675247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" event={"ID":"acccb45b-e7f2-4343-b52b-1f1a0dfff882","Type":"ContainerDied","Data":"d62ee7a9a184dcc07cdf13d175325aae6e33ac66e1bae5449a13bd0d5ba72a2c"} Jun 09 08:09:19.683144 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:19.683114 2577 generic.go:356] "Generic (PLEG): container finished" podID="20c75f19-58d6-4c91-9a0c-2b328578a77a" containerID="cbd415187035363f9d37759311c95c73f9d90feb2a788f96041a9daf17911d6d" exitCode=0 Jun 09 08:09:19.683585 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:19.683189 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" event={"ID":"20c75f19-58d6-4c91-9a0c-2b328578a77a","Type":"ContainerDied","Data":"cbd415187035363f9d37759311c95c73f9d90feb2a788f96041a9daf17911d6d"} Jun 09 08:09:19.685262 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:19.685236 2577 generic.go:356] "Generic (PLEG): container finished" podID="acccb45b-e7f2-4343-b52b-1f1a0dfff882" containerID="575dd3d28208938c8291769384c25135808c306c93fd4393cd5e65f673f9a5ea" exitCode=0 Jun 09 08:09:19.685381 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:19.685321 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" event={"ID":"acccb45b-e7f2-4343-b52b-1f1a0dfff882","Type":"ContainerDied","Data":"575dd3d28208938c8291769384c25135808c306c93fd4393cd5e65f673f9a5ea"} Jun 09 08:09:19.687297 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:19.687276 2577 generic.go:356] "Generic (PLEG): container finished" podID="1f69fd8b-7e99-404b-82ed-f72d09034747" containerID="c8fca40cd0ff24b08253a5441117a8554acb09e2882fc56c2ec81e6b1d67796f" exitCode=0 Jun 09 08:09:19.687398 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:19.687349 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" event={"ID":"1f69fd8b-7e99-404b-82ed-f72d09034747","Type":"ContainerDied","Data":"c8fca40cd0ff24b08253a5441117a8554acb09e2882fc56c2ec81e6b1d67796f"} Jun 09 08:09:19.689351 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:19.689330 2577 generic.go:356] "Generic (PLEG): container finished" podID="8e5960cf-1e65-48f6-aaf5-8d277e963839" containerID="c5173f371ab205ee3a7f81cf551c1f2b9e90c4525c345487005a69223f1c5d3b" exitCode=0 Jun 09 08:09:19.689428 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:19.689385 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" event={"ID":"8e5960cf-1e65-48f6-aaf5-8d277e963839","Type":"ContainerDied","Data":"c5173f371ab205ee3a7f81cf551c1f2b9e90c4525c345487005a69223f1c5d3b"} Jun 09 08:09:19.742916 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:19.742853 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:19.742916 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:19.742901 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:19.747265 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:19.747246 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:20.700761 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:20.700725 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-748dbb7b45-96msb" Jun 09 08:09:20.759016 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:20.758984 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fc98bf97d-rsbq4"] Jun 09 08:09:20.897089 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:20.897005 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" Jun 09 08:09:20.943275 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:20.943254 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" Jun 09 08:09:20.947158 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:20.947109 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" Jun 09 08:09:20.950771 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:20.950751 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" Jun 09 08:09:20.963810 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:20.963791 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f69fd8b-7e99-404b-82ed-f72d09034747-util\") pod \"1f69fd8b-7e99-404b-82ed-f72d09034747\" (UID: \"1f69fd8b-7e99-404b-82ed-f72d09034747\") " Jun 09 08:09:20.963954 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:20.963846 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f69fd8b-7e99-404b-82ed-f72d09034747-bundle\") pod \"1f69fd8b-7e99-404b-82ed-f72d09034747\" (UID: \"1f69fd8b-7e99-404b-82ed-f72d09034747\") " Jun 09 08:09:20.963954 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:20.963899 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prmmq\" (UniqueName: \"kubernetes.io/projected/1f69fd8b-7e99-404b-82ed-f72d09034747-kube-api-access-prmmq\") pod \"1f69fd8b-7e99-404b-82ed-f72d09034747\" (UID: \"1f69fd8b-7e99-404b-82ed-f72d09034747\") " Jun 09 08:09:20.964400 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:20.964378 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f69fd8b-7e99-404b-82ed-f72d09034747-bundle" (OuterVolumeSpecName: "bundle") pod "1f69fd8b-7e99-404b-82ed-f72d09034747" (UID: "1f69fd8b-7e99-404b-82ed-f72d09034747"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:09:20.966119 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:20.966096 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f69fd8b-7e99-404b-82ed-f72d09034747-kube-api-access-prmmq" (OuterVolumeSpecName: "kube-api-access-prmmq") pod "1f69fd8b-7e99-404b-82ed-f72d09034747" (UID: "1f69fd8b-7e99-404b-82ed-f72d09034747"). InnerVolumeSpecName "kube-api-access-prmmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:09:20.970559 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:20.970539 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f69fd8b-7e99-404b-82ed-f72d09034747-util" (OuterVolumeSpecName: "util") pod "1f69fd8b-7e99-404b-82ed-f72d09034747" (UID: "1f69fd8b-7e99-404b-82ed-f72d09034747"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:09:21.065435 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.065408 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx89n\" (UniqueName: \"kubernetes.io/projected/acccb45b-e7f2-4343-b52b-1f1a0dfff882-kube-api-access-nx89n\") pod \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\" (UID: \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\") " Jun 09 08:09:21.065615 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.065487 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e5960cf-1e65-48f6-aaf5-8d277e963839-bundle\") pod \"8e5960cf-1e65-48f6-aaf5-8d277e963839\" (UID: \"8e5960cf-1e65-48f6-aaf5-8d277e963839\") " Jun 09 08:09:21.065615 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.065506 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e5960cf-1e65-48f6-aaf5-8d277e963839-util\") pod \"8e5960cf-1e65-48f6-aaf5-8d277e963839\" (UID: \"8e5960cf-1e65-48f6-aaf5-8d277e963839\") " Jun 09 08:09:21.065615 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.065526 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57c5r\" (UniqueName: \"kubernetes.io/projected/8e5960cf-1e65-48f6-aaf5-8d277e963839-kube-api-access-57c5r\") pod \"8e5960cf-1e65-48f6-aaf5-8d277e963839\" (UID: \"8e5960cf-1e65-48f6-aaf5-8d277e963839\") " Jun 09 08:09:21.065615 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.065546 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acccb45b-e7f2-4343-b52b-1f1a0dfff882-bundle\") pod \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\" (UID: \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\") " Jun 09 08:09:21.065615 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.065578 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acccb45b-e7f2-4343-b52b-1f1a0dfff882-util\") pod \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\" (UID: \"acccb45b-e7f2-4343-b52b-1f1a0dfff882\") " Jun 09 08:09:21.065895 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.065637 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c75f19-58d6-4c91-9a0c-2b328578a77a-util\") pod \"20c75f19-58d6-4c91-9a0c-2b328578a77a\" (UID: \"20c75f19-58d6-4c91-9a0c-2b328578a77a\") " Jun 09 08:09:21.065895 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.065673 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c75f19-58d6-4c91-9a0c-2b328578a77a-bundle\") pod \"20c75f19-58d6-4c91-9a0c-2b328578a77a\" (UID: \"20c75f19-58d6-4c91-9a0c-2b328578a77a\") " Jun 09 08:09:21.065895 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.065720 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6x2k\" (UniqueName: \"kubernetes.io/projected/20c75f19-58d6-4c91-9a0c-2b328578a77a-kube-api-access-m6x2k\") pod \"20c75f19-58d6-4c91-9a0c-2b328578a77a\" (UID: \"20c75f19-58d6-4c91-9a0c-2b328578a77a\") " Jun 09 08:09:21.066088 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.066071 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f69fd8b-7e99-404b-82ed-f72d09034747-util\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:21.066140 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.066089 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f69fd8b-7e99-404b-82ed-f72d09034747-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:21.066140 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.066102 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prmmq\" (UniqueName: \"kubernetes.io/projected/1f69fd8b-7e99-404b-82ed-f72d09034747-kube-api-access-prmmq\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:21.066592 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.066557 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acccb45b-e7f2-4343-b52b-1f1a0dfff882-bundle" (OuterVolumeSpecName: "bundle") pod "acccb45b-e7f2-4343-b52b-1f1a0dfff882" (UID: "acccb45b-e7f2-4343-b52b-1f1a0dfff882"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:09:21.066959 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.066890 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e5960cf-1e65-48f6-aaf5-8d277e963839-bundle" (OuterVolumeSpecName: "bundle") pod "8e5960cf-1e65-48f6-aaf5-8d277e963839" (UID: "8e5960cf-1e65-48f6-aaf5-8d277e963839"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:09:21.067211 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.067172 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20c75f19-58d6-4c91-9a0c-2b328578a77a-bundle" (OuterVolumeSpecName: "bundle") pod "20c75f19-58d6-4c91-9a0c-2b328578a77a" (UID: "20c75f19-58d6-4c91-9a0c-2b328578a77a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:09:21.067916 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.067894 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acccb45b-e7f2-4343-b52b-1f1a0dfff882-kube-api-access-nx89n" (OuterVolumeSpecName: "kube-api-access-nx89n") pod "acccb45b-e7f2-4343-b52b-1f1a0dfff882" (UID: "acccb45b-e7f2-4343-b52b-1f1a0dfff882"). InnerVolumeSpecName "kube-api-access-nx89n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:09:21.068262 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.068245 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20c75f19-58d6-4c91-9a0c-2b328578a77a-kube-api-access-m6x2k" (OuterVolumeSpecName: "kube-api-access-m6x2k") pod "20c75f19-58d6-4c91-9a0c-2b328578a77a" (UID: "20c75f19-58d6-4c91-9a0c-2b328578a77a"). InnerVolumeSpecName "kube-api-access-m6x2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:09:21.068826 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.068813 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e5960cf-1e65-48f6-aaf5-8d277e963839-kube-api-access-57c5r" (OuterVolumeSpecName: "kube-api-access-57c5r") pod "8e5960cf-1e65-48f6-aaf5-8d277e963839" (UID: "8e5960cf-1e65-48f6-aaf5-8d277e963839"). InnerVolumeSpecName "kube-api-access-57c5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:09:21.074452 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.074408 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acccb45b-e7f2-4343-b52b-1f1a0dfff882-util" (OuterVolumeSpecName: "util") pod "acccb45b-e7f2-4343-b52b-1f1a0dfff882" (UID: "acccb45b-e7f2-4343-b52b-1f1a0dfff882"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:09:21.074727 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.074709 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e5960cf-1e65-48f6-aaf5-8d277e963839-util" (OuterVolumeSpecName: "util") pod "8e5960cf-1e65-48f6-aaf5-8d277e963839" (UID: "8e5960cf-1e65-48f6-aaf5-8d277e963839"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:09:21.167240 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.167208 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acccb45b-e7f2-4343-b52b-1f1a0dfff882-util\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:21.167240 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.167237 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20c75f19-58d6-4c91-9a0c-2b328578a77a-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:21.167240 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.167248 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6x2k\" (UniqueName: \"kubernetes.io/projected/20c75f19-58d6-4c91-9a0c-2b328578a77a-kube-api-access-m6x2k\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:21.167472 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.167258 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx89n\" (UniqueName: \"kubernetes.io/projected/acccb45b-e7f2-4343-b52b-1f1a0dfff882-kube-api-access-nx89n\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:21.167472 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.167267 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e5960cf-1e65-48f6-aaf5-8d277e963839-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:21.167472 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.167274 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e5960cf-1e65-48f6-aaf5-8d277e963839-util\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:21.167472 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.167282 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57c5r\" (UniqueName: \"kubernetes.io/projected/8e5960cf-1e65-48f6-aaf5-8d277e963839-kube-api-access-57c5r\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:21.167472 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.167290 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acccb45b-e7f2-4343-b52b-1f1a0dfff882-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:21.183794 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.183762 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20c75f19-58d6-4c91-9a0c-2b328578a77a-util" (OuterVolumeSpecName: "util") pod "20c75f19-58d6-4c91-9a0c-2b328578a77a" (UID: "20c75f19-58d6-4c91-9a0c-2b328578a77a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:09:21.268220 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.268140 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20c75f19-58d6-4c91-9a0c-2b328578a77a-util\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:21.702721 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.702693 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" Jun 09 08:09:21.703157 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.702684 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr" event={"ID":"20c75f19-58d6-4c91-9a0c-2b328578a77a","Type":"ContainerDied","Data":"3c8d88d5277eb29b3ec00f9699172ba4c738b99ebb7776c08a344c45758dd79e"} Jun 09 08:09:21.703157 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.702860 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c8d88d5277eb29b3ec00f9699172ba4c738b99ebb7776c08a344c45758dd79e" Jun 09 08:09:21.704669 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.704650 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" Jun 09 08:09:21.704806 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.704682 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b" event={"ID":"acccb45b-e7f2-4343-b52b-1f1a0dfff882","Type":"ContainerDied","Data":"9728f98c928405281bc935f049dbdbe65eeae9efeda0db472a072972b25c4d6e"} Jun 09 08:09:21.704806 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.704726 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9728f98c928405281bc935f049dbdbe65eeae9efeda0db472a072972b25c4d6e" Jun 09 08:09:21.706718 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.706696 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" event={"ID":"1f69fd8b-7e99-404b-82ed-f72d09034747","Type":"ContainerDied","Data":"46f0881732df4d081731adc23204d6e28a721b04f317f1ff62bbf51e45340c4d"} Jun 09 08:09:21.706802 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.706734 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46f0881732df4d081731adc23204d6e28a721b04f317f1ff62bbf51e45340c4d" Jun 09 08:09:21.706802 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.706708 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct" Jun 09 08:09:21.708671 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.708655 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" Jun 09 08:09:21.708770 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.708692 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf" event={"ID":"8e5960cf-1e65-48f6-aaf5-8d277e963839","Type":"ContainerDied","Data":"e9c28354048789565be737c6f8275757d20d801f111b1512245a1cdc40ed9624"} Jun 09 08:09:21.708770 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:21.708733 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9c28354048789565be737c6f8275757d20d801f111b1512245a1cdc40ed9624" Jun 09 08:09:37.798522 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.798476 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v"] Jun 09 08:09:37.799400 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799372 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f69fd8b-7e99-404b-82ed-f72d09034747" containerName="pull" Jun 09 08:09:37.799515 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799406 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f69fd8b-7e99-404b-82ed-f72d09034747" containerName="pull" Jun 09 08:09:37.799515 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799426 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20c75f19-58d6-4c91-9a0c-2b328578a77a" containerName="extract" Jun 09 08:09:37.799515 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799435 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="20c75f19-58d6-4c91-9a0c-2b328578a77a" containerName="extract" Jun 09 08:09:37.799515 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799463 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20c75f19-58d6-4c91-9a0c-2b328578a77a" containerName="util" Jun 09 08:09:37.799515 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799472 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="20c75f19-58d6-4c91-9a0c-2b328578a77a" containerName="util" Jun 09 08:09:37.799515 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799481 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acccb45b-e7f2-4343-b52b-1f1a0dfff882" containerName="pull" Jun 09 08:09:37.799515 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799489 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="acccb45b-e7f2-4343-b52b-1f1a0dfff882" containerName="pull" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799526 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f69fd8b-7e99-404b-82ed-f72d09034747" containerName="util" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799534 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f69fd8b-7e99-404b-82ed-f72d09034747" containerName="util" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799545 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e5960cf-1e65-48f6-aaf5-8d277e963839" containerName="util" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799553 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e5960cf-1e65-48f6-aaf5-8d277e963839" containerName="util" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799572 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e5960cf-1e65-48f6-aaf5-8d277e963839" containerName="extract" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799580 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e5960cf-1e65-48f6-aaf5-8d277e963839" containerName="extract" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799601 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acccb45b-e7f2-4343-b52b-1f1a0dfff882" containerName="extract" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799609 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="acccb45b-e7f2-4343-b52b-1f1a0dfff882" containerName="extract" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799629 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acccb45b-e7f2-4343-b52b-1f1a0dfff882" containerName="util" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799637 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="acccb45b-e7f2-4343-b52b-1f1a0dfff882" containerName="util" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799646 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f69fd8b-7e99-404b-82ed-f72d09034747" containerName="extract" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799654 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f69fd8b-7e99-404b-82ed-f72d09034747" containerName="extract" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799679 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20c75f19-58d6-4c91-9a0c-2b328578a77a" containerName="pull" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799687 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="20c75f19-58d6-4c91-9a0c-2b328578a77a" containerName="pull" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799702 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e5960cf-1e65-48f6-aaf5-8d277e963839" containerName="pull" Jun 09 08:09:37.799884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.799710 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e5960cf-1e65-48f6-aaf5-8d277e963839" containerName="pull" Jun 09 08:09:37.800665 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.800164 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="acccb45b-e7f2-4343-b52b-1f1a0dfff882" containerName="extract" Jun 09 08:09:37.800665 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.800186 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e5960cf-1e65-48f6-aaf5-8d277e963839" containerName="extract" Jun 09 08:09:37.800665 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.800205 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f69fd8b-7e99-404b-82ed-f72d09034747" containerName="extract" Jun 09 08:09:37.800665 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.800225 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="20c75f19-58d6-4c91-9a0c-2b328578a77a" containerName="extract" Jun 09 08:09:37.807100 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.806924 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" Jun 09 08:09:37.809714 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.809696 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7x4qx\"" Jun 09 08:09:37.810478 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.810450 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v"] Jun 09 08:09:37.904257 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:37.904217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzsg5\" (UniqueName: \"kubernetes.io/projected/f93bff93-5624-4d54-909d-7248d805b146-kube-api-access-xzsg5\") pod \"limitador-operator-controller-manager-859d7b78bd-jnn2v\" (UID: \"f93bff93-5624-4d54-909d-7248d805b146\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" Jun 09 08:09:38.004683 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:38.004650 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzsg5\" (UniqueName: \"kubernetes.io/projected/f93bff93-5624-4d54-909d-7248d805b146-kube-api-access-xzsg5\") pod \"limitador-operator-controller-manager-859d7b78bd-jnn2v\" (UID: \"f93bff93-5624-4d54-909d-7248d805b146\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" Jun 09 08:09:38.018846 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:38.018812 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzsg5\" (UniqueName: \"kubernetes.io/projected/f93bff93-5624-4d54-909d-7248d805b146-kube-api-access-xzsg5\") pod \"limitador-operator-controller-manager-859d7b78bd-jnn2v\" (UID: \"f93bff93-5624-4d54-909d-7248d805b146\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" Jun 09 08:09:38.118857 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:38.118795 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" Jun 09 08:09:38.259594 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:38.259565 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v"] Jun 09 08:09:38.260349 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:09:38.260321 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93bff93_5624_4d54_909d_7248d805b146.slice/crio-b1d23074bf4a7b36afe9b91e771b6c01783922f00352bcdcd62a87117dd031f9 WatchSource:0}: Error finding container b1d23074bf4a7b36afe9b91e771b6c01783922f00352bcdcd62a87117dd031f9: Status 404 returned error can't find the container with id b1d23074bf4a7b36afe9b91e771b6c01783922f00352bcdcd62a87117dd031f9 Jun 09 08:09:38.816087 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:38.816056 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" event={"ID":"f93bff93-5624-4d54-909d-7248d805b146","Type":"ContainerStarted","Data":"b1d23074bf4a7b36afe9b91e771b6c01783922f00352bcdcd62a87117dd031f9"} Jun 09 08:09:40.829263 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:40.829170 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" event={"ID":"f93bff93-5624-4d54-909d-7248d805b146","Type":"ContainerStarted","Data":"f1343ec11a83811bc1dfd35efd18b0d9a07b2389233748b666c765adb954e556"} Jun 09 08:09:40.829630 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:40.829279 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" Jun 09 08:09:40.860873 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:40.860825 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" podStartSLOduration=1.627913406 podStartE2EDuration="3.860809397s" totalImagesPullingTime="2.232895991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:09:40.858564888 +0000 UTC m=+708.528410908" watchObservedRunningTime="2026-06-09 08:09:40.860809397 +0000 UTC m=+708.530655412" Jun 09 08:09:45.786506 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:45.786462 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7fc98bf97d-rsbq4" podUID="51a13358-02db-4abc-a339-7734b84f11f0" containerName="console" containerID="cri-o://f05da067080d5a214150cbe67c989147d605c78f9275c15b47a248e7d80c6839" gracePeriod=15 Jun 09 08:09:46.044677 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.044622 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:09:46.173889 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.173862 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-oauth-serving-cert\") pod \"51a13358-02db-4abc-a339-7734b84f11f0\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " Jun 09 08:09:46.174194 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.173911 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-service-ca\") pod \"51a13358-02db-4abc-a339-7734b84f11f0\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " Jun 09 08:09:46.174194 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.173962 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51a13358-02db-4abc-a339-7734b84f11f0-console-oauth-config\") pod \"51a13358-02db-4abc-a339-7734b84f11f0\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " Jun 09 08:09:46.174194 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.173983 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpcvj\" (UniqueName: \"kubernetes.io/projected/51a13358-02db-4abc-a339-7734b84f11f0-kube-api-access-tpcvj\") pod \"51a13358-02db-4abc-a339-7734b84f11f0\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " Jun 09 08:09:46.174194 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.174015 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51a13358-02db-4abc-a339-7734b84f11f0-console-serving-cert\") pod \"51a13358-02db-4abc-a339-7734b84f11f0\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " Jun 09 08:09:46.174194 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.174032 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-console-config\") pod \"51a13358-02db-4abc-a339-7734b84f11f0\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " Jun 09 08:09:46.174194 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.174081 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-trusted-ca-bundle\") pod \"51a13358-02db-4abc-a339-7734b84f11f0\" (UID: \"51a13358-02db-4abc-a339-7734b84f11f0\") " Jun 09 08:09:46.174550 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.174367 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "51a13358-02db-4abc-a339-7734b84f11f0" (UID: "51a13358-02db-4abc-a339-7734b84f11f0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:09:46.174550 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.174420 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-service-ca" (OuterVolumeSpecName: "service-ca") pod "51a13358-02db-4abc-a339-7734b84f11f0" (UID: "51a13358-02db-4abc-a339-7734b84f11f0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:09:46.174550 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.174476 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-console-config" (OuterVolumeSpecName: "console-config") pod "51a13358-02db-4abc-a339-7734b84f11f0" (UID: "51a13358-02db-4abc-a339-7734b84f11f0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:09:46.174887 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.174861 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "51a13358-02db-4abc-a339-7734b84f11f0" (UID: "51a13358-02db-4abc-a339-7734b84f11f0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 08:09:46.176286 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.176259 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a13358-02db-4abc-a339-7734b84f11f0-kube-api-access-tpcvj" (OuterVolumeSpecName: "kube-api-access-tpcvj") pod "51a13358-02db-4abc-a339-7734b84f11f0" (UID: "51a13358-02db-4abc-a339-7734b84f11f0"). InnerVolumeSpecName "kube-api-access-tpcvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:09:46.176286 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.176269 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51a13358-02db-4abc-a339-7734b84f11f0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "51a13358-02db-4abc-a339-7734b84f11f0" (UID: "51a13358-02db-4abc-a339-7734b84f11f0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:09:46.176286 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.176281 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51a13358-02db-4abc-a339-7734b84f11f0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "51a13358-02db-4abc-a339-7734b84f11f0" (UID: "51a13358-02db-4abc-a339-7734b84f11f0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 08:09:46.274765 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.274743 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-oauth-serving-cert\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:46.274765 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.274763 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-service-ca\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:46.274923 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.274772 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51a13358-02db-4abc-a339-7734b84f11f0-console-oauth-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:46.274923 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.274781 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpcvj\" (UniqueName: \"kubernetes.io/projected/51a13358-02db-4abc-a339-7734b84f11f0-kube-api-access-tpcvj\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:46.274923 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.274789 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51a13358-02db-4abc-a339-7734b84f11f0-console-serving-cert\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:46.274923 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.274797 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-console-config\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:46.274923 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.274805 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51a13358-02db-4abc-a339-7734b84f11f0-trusted-ca-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:09:46.871827 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.871795 2577 generic.go:356] "Generic (PLEG): container finished" podID="51a13358-02db-4abc-a339-7734b84f11f0" containerID="f05da067080d5a214150cbe67c989147d605c78f9275c15b47a248e7d80c6839" exitCode=0 Jun 09 08:09:46.872260 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.871850 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fc98bf97d-rsbq4" Jun 09 08:09:46.872260 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.871883 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fc98bf97d-rsbq4" event={"ID":"51a13358-02db-4abc-a339-7734b84f11f0","Type":"ContainerDied","Data":"f05da067080d5a214150cbe67c989147d605c78f9275c15b47a248e7d80c6839"} Jun 09 08:09:46.872260 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.871987 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fc98bf97d-rsbq4" event={"ID":"51a13358-02db-4abc-a339-7734b84f11f0","Type":"ContainerDied","Data":"651474e8c8beb75ceee54278bcfc3954cf92629c0a6b57f3d51d7ec0f665bbad"} Jun 09 08:09:46.872260 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.872011 2577 scope.go:117] "RemoveContainer" containerID="f05da067080d5a214150cbe67c989147d605c78f9275c15b47a248e7d80c6839" Jun 09 08:09:46.881233 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.881213 2577 scope.go:117] "RemoveContainer" containerID="f05da067080d5a214150cbe67c989147d605c78f9275c15b47a248e7d80c6839" Jun 09 08:09:46.881581 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:09:46.881561 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f05da067080d5a214150cbe67c989147d605c78f9275c15b47a248e7d80c6839\": container with ID starting with f05da067080d5a214150cbe67c989147d605c78f9275c15b47a248e7d80c6839 not found: ID does not exist" containerID="f05da067080d5a214150cbe67c989147d605c78f9275c15b47a248e7d80c6839" Jun 09 08:09:46.881656 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.881588 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f05da067080d5a214150cbe67c989147d605c78f9275c15b47a248e7d80c6839"} err="failed to get container status \"f05da067080d5a214150cbe67c989147d605c78f9275c15b47a248e7d80c6839\": rpc error: code = NotFound desc = could not find container \"f05da067080d5a214150cbe67c989147d605c78f9275c15b47a248e7d80c6839\": container with ID starting with f05da067080d5a214150cbe67c989147d605c78f9275c15b47a248e7d80c6839 not found: ID does not exist" Jun 09 08:09:46.903714 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.903688 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fc98bf97d-rsbq4"] Jun 09 08:09:46.912366 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:46.912345 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fc98bf97d-rsbq4"] Jun 09 08:09:48.791135 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:48.791104 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51a13358-02db-4abc-a339-7734b84f11f0" path="/var/lib/kubelet/pods/51a13358-02db-4abc-a339-7734b84f11f0/volumes" Jun 09 08:09:51.838489 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:09:51.838456 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" Jun 09 08:10:04.299532 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.299498 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v"] Jun 09 08:10:04.300300 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.300262 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" podUID="f93bff93-5624-4d54-909d-7248d805b146" containerName="manager" containerID="cri-o://f1343ec11a83811bc1dfd35efd18b0d9a07b2389233748b666c765adb954e556" gracePeriod=2 Jun 09 08:10:04.307870 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.307843 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v"] Jun 09 08:10:04.330065 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.330040 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg8mk"] Jun 09 08:10:04.330488 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.330471 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51a13358-02db-4abc-a339-7734b84f11f0" containerName="console" Jun 09 08:10:04.330488 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.330489 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="51a13358-02db-4abc-a339-7734b84f11f0" containerName="console" Jun 09 08:10:04.330628 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.330501 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f93bff93-5624-4d54-909d-7248d805b146" containerName="manager" Jun 09 08:10:04.330628 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.330507 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f93bff93-5624-4d54-909d-7248d805b146" containerName="manager" Jun 09 08:10:04.330628 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.330565 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="51a13358-02db-4abc-a339-7734b84f11f0" containerName="console" Jun 09 08:10:04.330628 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.330576 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f93bff93-5624-4d54-909d-7248d805b146" containerName="manager" Jun 09 08:10:04.332520 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.332502 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg8mk" Jun 09 08:10:04.345305 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.345278 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg8mk"] Jun 09 08:10:04.359366 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:10:04.359331 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jnn2v\" is forbidden: User \"system:node:ip-10-0-139-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-124.ec2.internal' and this object" podUID="f93bff93-5624-4d54-909d-7248d805b146" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" Jun 09 08:10:04.417697 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.417669 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4qcr\" (UniqueName: \"kubernetes.io/projected/db641dc3-da1e-42a9-bc67-e49f3c0ef189-kube-api-access-k4qcr\") pod \"limitador-operator-controller-manager-859d7b78bd-vg8mk\" (UID: \"db641dc3-da1e-42a9-bc67-e49f3c0ef189\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg8mk" Jun 09 08:10:04.518436 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.518361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4qcr\" (UniqueName: \"kubernetes.io/projected/db641dc3-da1e-42a9-bc67-e49f3c0ef189-kube-api-access-k4qcr\") pod \"limitador-operator-controller-manager-859d7b78bd-vg8mk\" (UID: \"db641dc3-da1e-42a9-bc67-e49f3c0ef189\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg8mk" Jun 09 08:10:04.532656 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.532634 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4qcr\" (UniqueName: \"kubernetes.io/projected/db641dc3-da1e-42a9-bc67-e49f3c0ef189-kube-api-access-k4qcr\") pod \"limitador-operator-controller-manager-859d7b78bd-vg8mk\" (UID: \"db641dc3-da1e-42a9-bc67-e49f3c0ef189\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg8mk" Jun 09 08:10:04.550168 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.550148 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" Jun 09 08:10:04.553321 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:10:04.553297 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jnn2v\" is forbidden: User \"system:node:ip-10-0-139-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-124.ec2.internal' and this object" podUID="f93bff93-5624-4d54-909d-7248d805b146" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" Jun 09 08:10:04.618987 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.618966 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzsg5\" (UniqueName: \"kubernetes.io/projected/f93bff93-5624-4d54-909d-7248d805b146-kube-api-access-xzsg5\") pod \"f93bff93-5624-4d54-909d-7248d805b146\" (UID: \"f93bff93-5624-4d54-909d-7248d805b146\") " Jun 09 08:10:04.620908 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.620882 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f93bff93-5624-4d54-909d-7248d805b146-kube-api-access-xzsg5" (OuterVolumeSpecName: "kube-api-access-xzsg5") pod "f93bff93-5624-4d54-909d-7248d805b146" (UID: "f93bff93-5624-4d54-909d-7248d805b146"). InnerVolumeSpecName "kube-api-access-xzsg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:10:04.679152 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.679131 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg8mk" Jun 09 08:10:04.720196 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.720166 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzsg5\" (UniqueName: \"kubernetes.io/projected/f93bff93-5624-4d54-909d-7248d805b146-kube-api-access-xzsg5\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:10:04.792952 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.792865 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f93bff93-5624-4d54-909d-7248d805b146" path="/var/lib/kubelet/pods/f93bff93-5624-4d54-909d-7248d805b146/volumes" Jun 09 08:10:04.822611 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.822591 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg8mk"] Jun 09 08:10:04.824151 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:10:04.824127 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb641dc3_da1e_42a9_bc67_e49f3c0ef189.slice/crio-5c524f8a0c15d24dac143874f00b68e928980486fab6571d154c305f560c01be WatchSource:0}: Error finding container 5c524f8a0c15d24dac143874f00b68e928980486fab6571d154c305f560c01be: Status 404 returned error can't find the container with id 5c524f8a0c15d24dac143874f00b68e928980486fab6571d154c305f560c01be Jun 09 08:10:04.981909 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.981878 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg8mk" event={"ID":"db641dc3-da1e-42a9-bc67-e49f3c0ef189","Type":"ContainerStarted","Data":"2e60baa856480e5ab051ec70cdda9ba4833025298c6a659b9ab2fbc5ec67a090"} Jun 09 08:10:04.982081 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.981923 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg8mk" event={"ID":"db641dc3-da1e-42a9-bc67-e49f3c0ef189","Type":"ContainerStarted","Data":"5c524f8a0c15d24dac143874f00b68e928980486fab6571d154c305f560c01be"} Jun 09 08:10:04.982081 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.982039 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg8mk" Jun 09 08:10:04.983244 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.983223 2577 generic.go:356] "Generic (PLEG): container finished" podID="f93bff93-5624-4d54-909d-7248d805b146" containerID="f1343ec11a83811bc1dfd35efd18b0d9a07b2389233748b666c765adb954e556" exitCode=0 Jun 09 08:10:04.983355 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.983261 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnn2v" Jun 09 08:10:04.983415 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.983263 2577 scope.go:117] "RemoveContainer" containerID="f1343ec11a83811bc1dfd35efd18b0d9a07b2389233748b666c765adb954e556" Jun 09 08:10:04.991856 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.991841 2577 scope.go:117] "RemoveContainer" containerID="f1343ec11a83811bc1dfd35efd18b0d9a07b2389233748b666c765adb954e556" Jun 09 08:10:04.992100 ip-10-0-139-124 kubenswrapper[2577]: E0609 08:10:04.992083 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1343ec11a83811bc1dfd35efd18b0d9a07b2389233748b666c765adb954e556\": container with ID starting with f1343ec11a83811bc1dfd35efd18b0d9a07b2389233748b666c765adb954e556 not found: ID does not exist" containerID="f1343ec11a83811bc1dfd35efd18b0d9a07b2389233748b666c765adb954e556" Jun 09 08:10:04.992153 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:04.992111 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1343ec11a83811bc1dfd35efd18b0d9a07b2389233748b666c765adb954e556"} err="failed to get container status \"f1343ec11a83811bc1dfd35efd18b0d9a07b2389233748b666c765adb954e556\": rpc error: code = NotFound desc = could not find container \"f1343ec11a83811bc1dfd35efd18b0d9a07b2389233748b666c765adb954e556\": container with ID starting with f1343ec11a83811bc1dfd35efd18b0d9a07b2389233748b666c765adb954e556 not found: ID does not exist" Jun 09 08:10:05.031546 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:05.031505 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg8mk" podStartSLOduration=1.031492975 podStartE2EDuration="1.031492975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:10:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:10:05.027558301 +0000 UTC m=+732.697404317" watchObservedRunningTime="2026-06-09 08:10:05.031492975 +0000 UTC m=+732.701338989" Jun 09 08:10:15.993124 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:15.993096 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg8mk" Jun 09 08:10:47.628754 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:47.628706 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:10:47.632446 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:47.632429 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bgzmc" Jun 09 08:10:47.636885 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:47.636866 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7vhhw\"" Jun 09 08:10:47.637381 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:47.637338 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 08:10:47.642231 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:47.642207 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:10:47.674312 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:47.674290 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:10:47.774410 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:47.774379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snb9z\" (UniqueName: \"kubernetes.io/projected/a0579d85-3a01-4fc7-8683-bb0ada8a2256-kube-api-access-snb9z\") pod \"limitador-limitador-54d6d988d5-bgzmc\" (UID: \"a0579d85-3a01-4fc7-8683-bb0ada8a2256\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bgzmc" Jun 09 08:10:47.774526 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:47.774457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a0579d85-3a01-4fc7-8683-bb0ada8a2256-config-file\") pod \"limitador-limitador-54d6d988d5-bgzmc\" (UID: \"a0579d85-3a01-4fc7-8683-bb0ada8a2256\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bgzmc" Jun 09 08:10:47.875719 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:47.875699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snb9z\" (UniqueName: \"kubernetes.io/projected/a0579d85-3a01-4fc7-8683-bb0ada8a2256-kube-api-access-snb9z\") pod \"limitador-limitador-54d6d988d5-bgzmc\" (UID: \"a0579d85-3a01-4fc7-8683-bb0ada8a2256\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bgzmc" Jun 09 08:10:47.875827 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:47.875771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a0579d85-3a01-4fc7-8683-bb0ada8a2256-config-file\") pod \"limitador-limitador-54d6d988d5-bgzmc\" (UID: \"a0579d85-3a01-4fc7-8683-bb0ada8a2256\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bgzmc" Jun 09 08:10:47.876440 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:47.876420 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a0579d85-3a01-4fc7-8683-bb0ada8a2256-config-file\") pod \"limitador-limitador-54d6d988d5-bgzmc\" (UID: \"a0579d85-3a01-4fc7-8683-bb0ada8a2256\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bgzmc" Jun 09 08:10:47.884054 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:47.884004 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snb9z\" (UniqueName: \"kubernetes.io/projected/a0579d85-3a01-4fc7-8683-bb0ada8a2256-kube-api-access-snb9z\") pod \"limitador-limitador-54d6d988d5-bgzmc\" (UID: \"a0579d85-3a01-4fc7-8683-bb0ada8a2256\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bgzmc" Jun 09 08:10:47.944559 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:47.944535 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bgzmc" Jun 09 08:10:48.078365 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:48.078335 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:10:48.080124 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:10:48.080090 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0579d85_3a01_4fc7_8683_bb0ada8a2256.slice/crio-317809af0527a105df655e641db629ece73bc65b5c1970c001c30ee21750a57a WatchSource:0}: Error finding container 317809af0527a105df655e641db629ece73bc65b5c1970c001c30ee21750a57a: Status 404 returned error can't find the container with id 317809af0527a105df655e641db629ece73bc65b5c1970c001c30ee21750a57a Jun 09 08:10:48.228727 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:48.228698 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bgzmc" event={"ID":"a0579d85-3a01-4fc7-8683-bb0ada8a2256","Type":"ContainerStarted","Data":"317809af0527a105df655e641db629ece73bc65b5c1970c001c30ee21750a57a"} Jun 09 08:10:51.250310 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:51.250279 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bgzmc" event={"ID":"a0579d85-3a01-4fc7-8683-bb0ada8a2256","Type":"ContainerStarted","Data":"f8bb196ffc552c2000e23c01d829e81caa184a93b6458d1ff1ec67e0606245b6"} Jun 09 08:10:51.250687 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:51.250349 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bgzmc" Jun 09 08:10:51.269437 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:10:51.269389 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-bgzmc" podStartSLOduration=1.8845012460000001 podStartE2EDuration="4.269374966s" totalImagesPullingTime="2.38487372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:10:51.26700777 +0000 UTC m=+778.936853784" watchObservedRunningTime="2026-06-09 08:10:51.269374966 +0000 UTC m=+778.939221017" Jun 09 08:11:02.257590 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:02.257561 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bgzmc" Jun 09 08:11:14.408723 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.408637 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc"] Jun 09 08:11:14.412393 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.412371 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" Jun 09 08:11:14.415311 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.415287 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 08:11:14.415311 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.415306 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 08:11:14.416267 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.416251 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gmtrs\"" Jun 09 08:11:14.422106 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.422084 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc"] Jun 09 08:11:14.491719 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.491697 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c9be19d-31a5-45b1-940e-7ab53519a377-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc\" (UID: \"5c9be19d-31a5-45b1-940e-7ab53519a377\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" Jun 09 08:11:14.491835 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.491735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn28l\" (UniqueName: \"kubernetes.io/projected/5c9be19d-31a5-45b1-940e-7ab53519a377-kube-api-access-qn28l\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc\" (UID: \"5c9be19d-31a5-45b1-940e-7ab53519a377\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" Jun 09 08:11:14.491835 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.491776 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c9be19d-31a5-45b1-940e-7ab53519a377-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc\" (UID: \"5c9be19d-31a5-45b1-940e-7ab53519a377\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" Jun 09 08:11:14.592979 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.592957 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c9be19d-31a5-45b1-940e-7ab53519a377-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc\" (UID: \"5c9be19d-31a5-45b1-940e-7ab53519a377\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" Jun 09 08:11:14.593088 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.592994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn28l\" (UniqueName: \"kubernetes.io/projected/5c9be19d-31a5-45b1-940e-7ab53519a377-kube-api-access-qn28l\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc\" (UID: \"5c9be19d-31a5-45b1-940e-7ab53519a377\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" Jun 09 08:11:14.593188 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.593175 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c9be19d-31a5-45b1-940e-7ab53519a377-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc\" (UID: \"5c9be19d-31a5-45b1-940e-7ab53519a377\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" Jun 09 08:11:14.593305 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.593286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c9be19d-31a5-45b1-940e-7ab53519a377-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc\" (UID: \"5c9be19d-31a5-45b1-940e-7ab53519a377\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" Jun 09 08:11:14.593440 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.593426 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c9be19d-31a5-45b1-940e-7ab53519a377-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc\" (UID: \"5c9be19d-31a5-45b1-940e-7ab53519a377\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" Jun 09 08:11:14.605199 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.605174 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn28l\" (UniqueName: \"kubernetes.io/projected/5c9be19d-31a5-45b1-940e-7ab53519a377-kube-api-access-qn28l\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc\" (UID: \"5c9be19d-31a5-45b1-940e-7ab53519a377\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" Jun 09 08:11:14.722884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.722863 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" Jun 09 08:11:14.857710 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:14.857687 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc"] Jun 09 08:11:14.859283 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:11:14.859258 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9be19d_31a5_45b1_940e_7ab53519a377.slice/crio-b19501cec1541e86099a7c0a6633ce9d8ca47c8e800ec16700b5922bc696b616 WatchSource:0}: Error finding container b19501cec1541e86099a7c0a6633ce9d8ca47c8e800ec16700b5922bc696b616: Status 404 returned error can't find the container with id b19501cec1541e86099a7c0a6633ce9d8ca47c8e800ec16700b5922bc696b616 Jun 09 08:11:15.393315 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:15.393282 2577 generic.go:356] "Generic (PLEG): container finished" podID="5c9be19d-31a5-45b1-940e-7ab53519a377" containerID="48cbe83a8e0132ddb1b1fc5dc2678bc2283b4b76e2f20d7fb47522cfa7318219" exitCode=0 Jun 09 08:11:15.393480 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:15.393364 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" event={"ID":"5c9be19d-31a5-45b1-940e-7ab53519a377","Type":"ContainerDied","Data":"48cbe83a8e0132ddb1b1fc5dc2678bc2283b4b76e2f20d7fb47522cfa7318219"} Jun 09 08:11:15.393480 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:15.393412 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" event={"ID":"5c9be19d-31a5-45b1-940e-7ab53519a377","Type":"ContainerStarted","Data":"b19501cec1541e86099a7c0a6633ce9d8ca47c8e800ec16700b5922bc696b616"} Jun 09 08:11:16.401322 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:16.401235 2577 generic.go:356] "Generic (PLEG): container finished" podID="5c9be19d-31a5-45b1-940e-7ab53519a377" containerID="3af483c31e8c550f3e453787e3bbbffdea7425059897c0a7ebdbc5951a5e5cf0" exitCode=0 Jun 09 08:11:16.401322 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:16.401275 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" event={"ID":"5c9be19d-31a5-45b1-940e-7ab53519a377","Type":"ContainerDied","Data":"3af483c31e8c550f3e453787e3bbbffdea7425059897c0a7ebdbc5951a5e5cf0"} Jun 09 08:11:17.409447 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:17.409413 2577 generic.go:356] "Generic (PLEG): container finished" podID="5c9be19d-31a5-45b1-940e-7ab53519a377" containerID="59cf167e3ccb7a9312757e42a12237ebbb7eab7266628b950acf9dfcd42aa9d3" exitCode=0 Jun 09 08:11:17.409815 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:17.409466 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" event={"ID":"5c9be19d-31a5-45b1-940e-7ab53519a377","Type":"ContainerDied","Data":"59cf167e3ccb7a9312757e42a12237ebbb7eab7266628b950acf9dfcd42aa9d3"} Jun 09 08:11:18.549283 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:18.549262 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" Jun 09 08:11:18.624428 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:18.624404 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c9be19d-31a5-45b1-940e-7ab53519a377-bundle\") pod \"5c9be19d-31a5-45b1-940e-7ab53519a377\" (UID: \"5c9be19d-31a5-45b1-940e-7ab53519a377\") " Jun 09 08:11:18.624543 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:18.624459 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c9be19d-31a5-45b1-940e-7ab53519a377-util\") pod \"5c9be19d-31a5-45b1-940e-7ab53519a377\" (UID: \"5c9be19d-31a5-45b1-940e-7ab53519a377\") " Jun 09 08:11:18.624543 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:18.624524 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn28l\" (UniqueName: \"kubernetes.io/projected/5c9be19d-31a5-45b1-940e-7ab53519a377-kube-api-access-qn28l\") pod \"5c9be19d-31a5-45b1-940e-7ab53519a377\" (UID: \"5c9be19d-31a5-45b1-940e-7ab53519a377\") " Jun 09 08:11:18.624963 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:18.624920 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c9be19d-31a5-45b1-940e-7ab53519a377-bundle" (OuterVolumeSpecName: "bundle") pod "5c9be19d-31a5-45b1-940e-7ab53519a377" (UID: "5c9be19d-31a5-45b1-940e-7ab53519a377"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:11:18.626493 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:18.626464 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c9be19d-31a5-45b1-940e-7ab53519a377-kube-api-access-qn28l" (OuterVolumeSpecName: "kube-api-access-qn28l") pod "5c9be19d-31a5-45b1-940e-7ab53519a377" (UID: "5c9be19d-31a5-45b1-940e-7ab53519a377"). InnerVolumeSpecName "kube-api-access-qn28l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:11:18.630577 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:18.630553 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c9be19d-31a5-45b1-940e-7ab53519a377-util" (OuterVolumeSpecName: "util") pod "5c9be19d-31a5-45b1-940e-7ab53519a377" (UID: "5c9be19d-31a5-45b1-940e-7ab53519a377"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 08:11:18.725692 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:18.725673 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c9be19d-31a5-45b1-940e-7ab53519a377-util\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:11:18.725782 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:18.725694 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn28l\" (UniqueName: \"kubernetes.io/projected/5c9be19d-31a5-45b1-940e-7ab53519a377-kube-api-access-qn28l\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:11:18.725782 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:18.725705 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c9be19d-31a5-45b1-940e-7ab53519a377-bundle\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:11:19.423205 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:19.423178 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" Jun 09 08:11:19.423371 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:19.423205 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74867zjc" event={"ID":"5c9be19d-31a5-45b1-940e-7ab53519a377","Type":"ContainerDied","Data":"b19501cec1541e86099a7c0a6633ce9d8ca47c8e800ec16700b5922bc696b616"} Jun 09 08:11:19.423371 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:11:19.423252 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b19501cec1541e86099a7c0a6633ce9d8ca47c8e800ec16700b5922bc696b616" Jun 09 08:12:52.821884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:52.821811 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/2.log" Jun 09 08:12:52.822514 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:52.822237 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/2.log" Jun 09 08:12:53.012629 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.012600 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:12:53.119523 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.119456 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-v899w"] Jun 09 08:12:53.119849 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.119837 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c9be19d-31a5-45b1-940e-7ab53519a377" containerName="util" Jun 09 08:12:53.119894 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.119850 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c9be19d-31a5-45b1-940e-7ab53519a377" containerName="util" Jun 09 08:12:53.119894 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.119864 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c9be19d-31a5-45b1-940e-7ab53519a377" containerName="extract" Jun 09 08:12:53.119894 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.119869 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c9be19d-31a5-45b1-940e-7ab53519a377" containerName="extract" Jun 09 08:12:53.119894 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.119887 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c9be19d-31a5-45b1-940e-7ab53519a377" containerName="pull" Jun 09 08:12:53.119894 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.119893 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c9be19d-31a5-45b1-940e-7ab53519a377" containerName="pull" Jun 09 08:12:53.120067 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.119979 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c9be19d-31a5-45b1-940e-7ab53519a377" containerName="extract" Jun 09 08:12:53.123226 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.123210 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-v899w" Jun 09 08:12:53.125970 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.125923 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 08:12:53.126096 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.125992 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sb5wq\"" Jun 09 08:12:53.133714 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.133692 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-v899w"] Jun 09 08:12:53.183404 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.183375 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjgl8\" (UniqueName: \"kubernetes.io/projected/d24a8276-3fc3-40a4-a7b5-6045b95e8ed7-kube-api-access-fjgl8\") pod \"payload-pre-processing-67d7689b65-v899w\" (UID: \"d24a8276-3fc3-40a4-a7b5-6045b95e8ed7\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-v899w" Jun 09 08:12:53.283864 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.283839 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjgl8\" (UniqueName: \"kubernetes.io/projected/d24a8276-3fc3-40a4-a7b5-6045b95e8ed7-kube-api-access-fjgl8\") pod \"payload-pre-processing-67d7689b65-v899w\" (UID: \"d24a8276-3fc3-40a4-a7b5-6045b95e8ed7\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-v899w" Jun 09 08:12:53.292688 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.292665 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjgl8\" (UniqueName: \"kubernetes.io/projected/d24a8276-3fc3-40a4-a7b5-6045b95e8ed7-kube-api-access-fjgl8\") pod \"payload-pre-processing-67d7689b65-v899w\" (UID: \"d24a8276-3fc3-40a4-a7b5-6045b95e8ed7\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-v899w" Jun 09 08:12:53.434673 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.434652 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-v899w" Jun 09 08:12:53.563109 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.563076 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-v899w"] Jun 09 08:12:53.564660 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:12:53.564634 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd24a8276_3fc3_40a4_a7b5_6045b95e8ed7.slice/crio-034049a7a6a54665e9718cb5b640fc7392dc185b8faf43a1803e95544e0372bf WatchSource:0}: Error finding container 034049a7a6a54665e9718cb5b640fc7392dc185b8faf43a1803e95544e0372bf: Status 404 returned error can't find the container with id 034049a7a6a54665e9718cb5b640fc7392dc185b8faf43a1803e95544e0372bf Jun 09 08:12:53.987559 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:53.987529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-v899w" event={"ID":"d24a8276-3fc3-40a4-a7b5-6045b95e8ed7","Type":"ContainerStarted","Data":"034049a7a6a54665e9718cb5b640fc7392dc185b8faf43a1803e95544e0372bf"} Jun 09 08:12:56.003001 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:56.002969 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-v899w" event={"ID":"d24a8276-3fc3-40a4-a7b5-6045b95e8ed7","Type":"ContainerStarted","Data":"2f84df64c66be64551b84d0bd83e9e48ef2b89cacaaaf00e779fb2d2cd487e92"} Jun 09 08:12:56.003515 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:56.003159 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-v899w" Jun 09 08:12:56.032430 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:12:56.032352 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-v899w" podStartSLOduration=0.731500235 podStartE2EDuration="3.03233038s" totalImagesPullingTime="2.300830145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:12:56.022075805 +0000 UTC m=+903.691921844" watchObservedRunningTime="2026-06-09 08:12:56.03233038 +0000 UTC m=+903.702176397" Jun 09 08:13:07.011548 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:07.011519 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-v899w" Jun 09 08:13:56.702327 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:56.702293 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:13:59.280376 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.280346 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6"] Jun 09 08:13:59.285335 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.285309 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.289658 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.289609 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qgdvr\"" Jun 09 08:13:59.289848 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.289639 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 09 08:13:59.290104 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.290082 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 08:13:59.290253 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.289674 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 08:13:59.292725 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.292702 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6"] Jun 09 08:13:59.320406 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.320386 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.320522 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.320436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.320522 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.320503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.320640 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.320536 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.320640 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.320569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlldg\" (UniqueName: \"kubernetes.io/projected/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-kube-api-access-zlldg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.320715 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.320686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.422054 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.422028 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.422199 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.422061 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.422199 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.422078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.422199 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.422098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlldg\" (UniqueName: \"kubernetes.io/projected/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-kube-api-access-zlldg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.422199 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.422154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.422199 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.422179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.422511 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.422483 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.422511 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.422499 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.422669 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.422653 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.424625 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.424595 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.424729 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.424665 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.430863 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.430838 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlldg\" (UniqueName: \"kubernetes.io/projected/711f8c26-8e4b-4823-b64e-2f7ca51a3dae-kube-api-access-zlldg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-swmz6\" (UID: \"711f8c26-8e4b-4823-b64e-2f7ca51a3dae\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.597141 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.597067 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:13:59.733128 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.733103 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6"] Jun 09 08:13:59.733801 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:13:59.733778 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711f8c26_8e4b_4823_b64e_2f7ca51a3dae.slice/crio-c579cfcd0d46e3d997cf350c8cd9b4fe28739af5f725be77fd956907f7906a55 WatchSource:0}: Error finding container c579cfcd0d46e3d997cf350c8cd9b4fe28739af5f725be77fd956907f7906a55: Status 404 returned error can't find the container with id c579cfcd0d46e3d997cf350c8cd9b4fe28739af5f725be77fd956907f7906a55 Jun 09 08:13:59.791723 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:13:59.791694 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:14:00.389539 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:00.389499 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" event={"ID":"711f8c26-8e4b-4823-b64e-2f7ca51a3dae","Type":"ContainerStarted","Data":"c579cfcd0d46e3d997cf350c8cd9b4fe28739af5f725be77fd956907f7906a55"} Jun 09 08:14:03.413173 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:03.413137 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" event={"ID":"711f8c26-8e4b-4823-b64e-2f7ca51a3dae","Type":"ContainerStarted","Data":"572564faf31c2693b4c052a0c7025d3ea9398704a95231847eaaf5b7dd859ea3"} Jun 09 08:14:04.421097 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:04.421066 2577 generic.go:356] "Generic (PLEG): container finished" podID="711f8c26-8e4b-4823-b64e-2f7ca51a3dae" containerID="572564faf31c2693b4c052a0c7025d3ea9398704a95231847eaaf5b7dd859ea3" exitCode=0 Jun 09 08:14:04.421482 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:04.421135 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" event={"ID":"711f8c26-8e4b-4823-b64e-2f7ca51a3dae","Type":"ContainerDied","Data":"572564faf31c2693b4c052a0c7025d3ea9398704a95231847eaaf5b7dd859ea3"} Jun 09 08:14:04.421634 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:04.421618 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 08:14:06.436153 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:06.436121 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" event={"ID":"711f8c26-8e4b-4823-b64e-2f7ca51a3dae","Type":"ContainerStarted","Data":"96f6a93a15441043a6f5767599fd1af3194abbb0002471ef4f1546647650b928"} Jun 09 08:14:06.455351 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:06.455307 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" podStartSLOduration=1.939943436 podStartE2EDuration="7.455294008s" totalImagesPullingTime="4.191858866s" totalInitContainerRuntime="1.323491706s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:13:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:14:06.453651718 +0000 UTC m=+974.123497760" watchObservedRunningTime="2026-06-09 08:14:06.455294008 +0000 UTC m=+974.125140023" Jun 09 08:14:09.288312 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:09.288232 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:14:09.598041 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:09.597951 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:14:09.598041 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:09.598010 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:14:09.610354 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:09.610330 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:14:10.471171 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:10.471143 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-swmz6" Jun 09 08:14:11.380485 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.380451 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng"] Jun 09 08:14:11.385942 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.385908 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.388664 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.388645 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 08:14:11.396111 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.396084 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng"] Jun 09 08:14:11.536063 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.536033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.536437 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.536069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.536437 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.536093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.536437 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.536144 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.536437 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.536191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x9n5\" (UniqueName: \"kubernetes.io/projected/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-kube-api-access-9x9n5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.536437 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.536301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.636827 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.636765 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.636827 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.636803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.637035 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.636830 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x9n5\" (UniqueName: \"kubernetes.io/projected/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-kube-api-access-9x9n5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.637035 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.636921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.637035 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.636965 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.637035 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.636996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.637249 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.637234 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.637312 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.637267 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.637382 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.637368 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.639005 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.638985 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.639385 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.639358 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.646242 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.646222 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x9n5\" (UniqueName: \"kubernetes.io/projected/a61ad0a9-e40b-4ed2-883a-41c3f60368ce-kube-api-access-9x9n5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng\" (UID: \"a61ad0a9-e40b-4ed2-883a-41c3f60368ce\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:11.697049 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:11.697029 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:12.046159 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:12.046132 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng"] Jun 09 08:14:12.047164 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:14:12.047130 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61ad0a9_e40b_4ed2_883a_41c3f60368ce.slice/crio-e7aaeb6b5c148b3073bf052db02035fd4009948c0147d887dc415466aafaf2ff WatchSource:0}: Error finding container e7aaeb6b5c148b3073bf052db02035fd4009948c0147d887dc415466aafaf2ff: Status 404 returned error can't find the container with id e7aaeb6b5c148b3073bf052db02035fd4009948c0147d887dc415466aafaf2ff Jun 09 08:14:12.192518 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:12.192488 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:14:12.474490 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:12.474451 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" event={"ID":"a61ad0a9-e40b-4ed2-883a-41c3f60368ce","Type":"ContainerStarted","Data":"c0c4fdb55f95ac2b50f2bfc37433443ced59cdba8733ba2cad23483f2f33b073"} Jun 09 08:14:12.474643 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:12.474526 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" event={"ID":"a61ad0a9-e40b-4ed2-883a-41c3f60368ce","Type":"ContainerStarted","Data":"e7aaeb6b5c148b3073bf052db02035fd4009948c0147d887dc415466aafaf2ff"} Jun 09 08:14:13.482338 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:13.482298 2577 generic.go:356] "Generic (PLEG): container finished" podID="a61ad0a9-e40b-4ed2-883a-41c3f60368ce" containerID="c0c4fdb55f95ac2b50f2bfc37433443ced59cdba8733ba2cad23483f2f33b073" exitCode=0 Jun 09 08:14:13.482713 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:13.482382 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" event={"ID":"a61ad0a9-e40b-4ed2-883a-41c3f60368ce","Type":"ContainerDied","Data":"c0c4fdb55f95ac2b50f2bfc37433443ced59cdba8733ba2cad23483f2f33b073"} Jun 09 08:14:14.490490 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:14.490454 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" event={"ID":"a61ad0a9-e40b-4ed2-883a-41c3f60368ce","Type":"ContainerStarted","Data":"4766f39a51e8a34d989a0ba44781298e0a63b3306ed23bd80fcff63999d91f19"} Jun 09 08:14:14.509677 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:14.509608 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" podStartSLOduration=1.9584119169999998 podStartE2EDuration="3.509594192s" totalImagesPullingTime="353.856102ms" totalInitContainerRuntime="1.197326173s" isStatefulPod=false podCreationTimestamp="2026-06-09 08:14:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:14:14.507494701 +0000 UTC m=+982.177340716" watchObservedRunningTime="2026-06-09 08:14:14.509594192 +0000 UTC m=+982.179440207" Jun 09 08:14:20.712777 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:20.712748 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:14:21.698011 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:21.697978 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:21.698200 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:21.698047 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:21.710263 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:21.710240 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:22.550288 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:22.550261 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng" Jun 09 08:14:29.209571 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:14:29.209536 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:15:00.146566 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:00.146531 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29683215-sbg8h"] Jun 09 08:15:00.150251 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:00.150234 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683215-sbg8h" Jun 09 08:15:00.153229 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:00.153202 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-24qj5\"" Jun 09 08:15:00.158781 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:00.158676 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683215-sbg8h"] Jun 09 08:15:00.223477 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:00.223451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4xqw\" (UniqueName: \"kubernetes.io/projected/caa6d0fc-34e0-42c3-aa87-6ee3777a8d75-kube-api-access-j4xqw\") pod \"maas-api-key-cleanup-29683215-sbg8h\" (UID: \"caa6d0fc-34e0-42c3-aa87-6ee3777a8d75\") " pod="opendatahub/maas-api-key-cleanup-29683215-sbg8h" Jun 09 08:15:00.324337 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:00.324314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4xqw\" (UniqueName: \"kubernetes.io/projected/caa6d0fc-34e0-42c3-aa87-6ee3777a8d75-kube-api-access-j4xqw\") pod \"maas-api-key-cleanup-29683215-sbg8h\" (UID: \"caa6d0fc-34e0-42c3-aa87-6ee3777a8d75\") " pod="opendatahub/maas-api-key-cleanup-29683215-sbg8h" Jun 09 08:15:00.334041 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:00.334016 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4xqw\" (UniqueName: \"kubernetes.io/projected/caa6d0fc-34e0-42c3-aa87-6ee3777a8d75-kube-api-access-j4xqw\") pod \"maas-api-key-cleanup-29683215-sbg8h\" (UID: \"caa6d0fc-34e0-42c3-aa87-6ee3777a8d75\") " pod="opendatahub/maas-api-key-cleanup-29683215-sbg8h" Jun 09 08:15:00.463399 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:00.463371 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683215-sbg8h" Jun 09 08:15:00.598065 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:00.598040 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683215-sbg8h"] Jun 09 08:15:00.599565 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:15:00.599539 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa6d0fc_34e0_42c3_aa87_6ee3777a8d75.slice/crio-264c6188c21779a7b0acda861b149c4702803b2c8ff4d59cd2da0ac884ac1437 WatchSource:0}: Error finding container 264c6188c21779a7b0acda861b149c4702803b2c8ff4d59cd2da0ac884ac1437: Status 404 returned error can't find the container with id 264c6188c21779a7b0acda861b149c4702803b2c8ff4d59cd2da0ac884ac1437 Jun 09 08:15:00.772762 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:00.772687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683215-sbg8h" event={"ID":"caa6d0fc-34e0-42c3-aa87-6ee3777a8d75","Type":"ContainerStarted","Data":"264c6188c21779a7b0acda861b149c4702803b2c8ff4d59cd2da0ac884ac1437"} Jun 09 08:15:03.795284 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:03.795255 2577 generic.go:356] "Generic (PLEG): container finished" podID="caa6d0fc-34e0-42c3-aa87-6ee3777a8d75" containerID="61eb66480fb4cbc9f9ec0d92f03c2551f8a1e871332c5facafc77f05094f26d4" exitCode=0 Jun 09 08:15:03.795643 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:03.795323 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683215-sbg8h" event={"ID":"caa6d0fc-34e0-42c3-aa87-6ee3777a8d75","Type":"ContainerDied","Data":"61eb66480fb4cbc9f9ec0d92f03c2551f8a1e871332c5facafc77f05094f26d4"} Jun 09 08:15:04.940646 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:04.940622 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683215-sbg8h" Jun 09 08:15:05.074849 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:05.074771 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4xqw\" (UniqueName: \"kubernetes.io/projected/caa6d0fc-34e0-42c3-aa87-6ee3777a8d75-kube-api-access-j4xqw\") pod \"caa6d0fc-34e0-42c3-aa87-6ee3777a8d75\" (UID: \"caa6d0fc-34e0-42c3-aa87-6ee3777a8d75\") " Jun 09 08:15:05.076866 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:05.076843 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caa6d0fc-34e0-42c3-aa87-6ee3777a8d75-kube-api-access-j4xqw" (OuterVolumeSpecName: "kube-api-access-j4xqw") pod "caa6d0fc-34e0-42c3-aa87-6ee3777a8d75" (UID: "caa6d0fc-34e0-42c3-aa87-6ee3777a8d75"). InnerVolumeSpecName "kube-api-access-j4xqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 08:15:05.175803 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:05.175777 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4xqw\" (UniqueName: \"kubernetes.io/projected/caa6d0fc-34e0-42c3-aa87-6ee3777a8d75-kube-api-access-j4xqw\") on node \"ip-10-0-139-124.ec2.internal\" DevicePath \"\"" Jun 09 08:15:05.808103 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:05.808076 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683215-sbg8h" Jun 09 08:15:05.808260 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:05.808116 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683215-sbg8h" event={"ID":"caa6d0fc-34e0-42c3-aa87-6ee3777a8d75","Type":"ContainerDied","Data":"264c6188c21779a7b0acda861b149c4702803b2c8ff4d59cd2da0ac884ac1437"} Jun 09 08:15:05.808260 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:05.808161 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="264c6188c21779a7b0acda861b149c4702803b2c8ff4d59cd2da0ac884ac1437" Jun 09 08:15:56.199329 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:15:56.199301 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:16:06.389781 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:16:06.389745 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:16:15.689776 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:16:15.689742 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:16:25.289372 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:16:25.289337 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:16:34.794398 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:16:34.794368 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:16:44.795536 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:16:44.795504 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:17:16.995185 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:17:16.995111 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:17:19.797162 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:17:19.797130 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:17:27.899563 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:17:27.899526 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:17:30.502408 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:17:30.502376 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:17:52.867583 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:17:52.867557 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/2.log" Jun 09 08:17:52.869506 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:17:52.869480 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/2.log" Jun 09 08:17:59.491611 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:17:59.491577 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:18:15.990208 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:18:15.990173 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:18:54.294494 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:18:54.294402 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:19:11.389138 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:19:11.389105 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:19:25.593128 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:19:25.593090 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:19:40.992373 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:19:40.992336 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:19:43.988373 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:19:43.988340 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:20:20.994777 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:20:20.994699 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:20:23.994197 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:20:23.994162 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:20:46.003509 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:20:46.003474 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:20:55.396118 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:20:55.396084 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:21:11.792575 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:21:11.792542 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:21:20.991510 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:21:20.991479 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:21:37.696925 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:21:37.696880 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:21:46.190363 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:21:46.190285 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:22:41.291302 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:22:41.291264 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:22:50.392915 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:22:50.392871 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:22:52.911863 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:22:52.911835 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/2.log" Jun 09 08:22:52.916214 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:22:52.916190 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/2.log" Jun 09 08:22:58.296804 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:22:58.296764 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:23:06.688357 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:23:06.688325 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:23:14.898344 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:23:14.898259 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:23:23.500981 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:23:23.500946 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:23:26.589579 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:23:26.589541 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:23:32.087675 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:23:32.087643 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:23:43.689829 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:23:43.689795 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:24:21.797884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:24:21.797849 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:24:23.993824 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:24:23.993784 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:24:52.299358 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:24:52.299321 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:25:00.197480 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:00.197443 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bgzmc"] Jun 09 08:25:14.025919 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:14.025888 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-75fff5c4cd-xggqr_a9eba66f-4e48-4aee-a3ad-4327f747ae14/nginx/0.log" Jun 09 08:25:14.151855 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:14.151829 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-dqv5t_846f55b3-19c5-447a-903f-8b67d43ceee5/manager/0.log" Jun 09 08:25:14.284755 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:14.284696 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-q954d_7a60aabf-c648-4efa-9ac3-f7b2010cd32c/manager/0.log" Jun 09 08:25:14.559113 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:14.559040 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683215-sbg8h_caa6d0fc-34e0-42c3-aa87-6ee3777a8d75/cleanup/0.log" Jun 09 08:25:14.838328 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:14.838239 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-cg7kp_f7e4a91d-61c6-4593-8c17-a1e6256a4af9/server/0.log" Jun 09 08:25:14.987448 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:14.987407 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-7fzgx_4bcb29f7-8693-49b6-82fe-2980579a5411/manager/0.log" Jun 09 08:25:15.427004 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:15.426977 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c6b94fd7b-xdm4n_733bd9e4-e1ca-4bab-89c4-b8c64dcb2208/manager/0.log" Jun 09 08:25:15.439452 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:15.439433 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c6b94fd7b-xdm4n_733bd9e4-e1ca-4bab-89c4-b8c64dcb2208/copy-manifests/0.log" Jun 09 08:25:16.497755 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:16.497723 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf_8e5960cf-1e65-48f6-aaf5-8d277e963839/util/0.log" Jun 09 08:25:16.516819 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:16.516792 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf_8e5960cf-1e65-48f6-aaf5-8d277e963839/pull/0.log" Jun 09 08:25:16.529833 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:16.529808 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf_8e5960cf-1e65-48f6-aaf5-8d277e963839/extract/0.log" Jun 09 08:25:16.647747 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:16.647723 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct_1f69fd8b-7e99-404b-82ed-f72d09034747/util/0.log" Jun 09 08:25:16.653633 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:16.653616 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct_1f69fd8b-7e99-404b-82ed-f72d09034747/pull/0.log" Jun 09 08:25:16.659407 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:16.659391 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct_1f69fd8b-7e99-404b-82ed-f72d09034747/extract/0.log" Jun 09 08:25:16.775625 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:16.775567 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b_acccb45b-e7f2-4343-b52b-1f1a0dfff882/util/0.log" Jun 09 08:25:16.781657 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:16.781636 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b_acccb45b-e7f2-4343-b52b-1f1a0dfff882/pull/0.log" Jun 09 08:25:16.787665 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:16.787641 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b_acccb45b-e7f2-4343-b52b-1f1a0dfff882/extract/0.log" Jun 09 08:25:16.895382 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:16.895363 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr_20c75f19-58d6-4c91-9a0c-2b328578a77a/extract/0.log" Jun 09 08:25:16.900646 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:16.900631 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr_20c75f19-58d6-4c91-9a0c-2b328578a77a/util/0.log" Jun 09 08:25:16.905854 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:16.905839 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr_20c75f19-58d6-4c91-9a0c-2b328578a77a/pull/0.log" Jun 09 08:25:17.518825 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:17.518797 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-88v9w_30dc06e1-26de-480f-ae9e-b5b9f5b44d2d/registry-server/0.log" Jun 09 08:25:17.745446 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:17.745424 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bgzmc_a0579d85-3a01-4fc7-8683-bb0ada8a2256/limitador/0.log" Jun 09 08:25:17.864160 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:17.864095 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vg8mk_db641dc3-da1e-42a9-bc67-e49f3c0ef189/manager/0.log" Jun 09 08:25:18.327593 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:18.327554 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-shvk6_5ec9720b-5ee1-4a07-b7cb-41e47d10e128/discovery/0.log" Jun 09 08:25:18.442115 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:18.442089 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69895d85c6-gp96q_af33d4bf-5969-4d16-8feb-b72b325fc6d4/kube-auth-proxy/0.log" Jun 09 08:25:18.792574 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:18.792547 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-v899w_d24a8276-3fc3-40a4-a7b5-6045b95e8ed7/payload-pre-processing/0.log" Jun 09 08:25:19.497565 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:19.497532 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-swmz6_711f8c26-8e4b-4823-b64e-2f7ca51a3dae/main/0.log" Jun 09 08:25:19.503138 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:19.503117 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-swmz6_711f8c26-8e4b-4823-b64e-2f7ca51a3dae/storage-initializer/0.log" Jun 09 08:25:19.729899 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:19.729875 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng_a61ad0a9-e40b-4ed2-883a-41c3f60368ce/storage-initializer/0.log" Jun 09 08:25:19.736305 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:19.736270 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf2gng_a61ad0a9-e40b-4ed2-883a-41c3f60368ce/main/0.log" Jun 09 08:25:27.514473 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:27.514430 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5smvf_9674b1fa-6e16-4821-b450-05f74c391b47/global-pull-secret-syncer/0.log" Jun 09 08:25:27.666725 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:27.666700 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ks6l6_7ce57525-7be1-4244-9584-1b2e5bb5d1a1/konnectivity-agent/0.log" Jun 09 08:25:27.732410 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:27.732388 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-124.ec2.internal_be5b5bfec53750cccc5fe667c2f32c1d/haproxy/0.log" Jun 09 08:25:31.763038 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:31.763008 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-lqs82_19206145-d714-457d-a309-72cd49869e57/sail-operator/0.log" Jun 09 08:25:32.560245 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:32.560218 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf_8e5960cf-1e65-48f6-aaf5-8d277e963839/extract/0.log" Jun 09 08:25:32.578087 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:32.578062 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf_8e5960cf-1e65-48f6-aaf5-8d277e963839/util/0.log" Jun 09 08:25:32.595613 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:32.595592 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qvxsf_8e5960cf-1e65-48f6-aaf5-8d277e963839/pull/0.log" Jun 09 08:25:32.618541 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:32.618521 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct_1f69fd8b-7e99-404b-82ed-f72d09034747/extract/0.log" Jun 09 08:25:32.639584 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:32.639565 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct_1f69fd8b-7e99-404b-82ed-f72d09034747/util/0.log" Jun 09 08:25:32.660073 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:32.660052 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lqhct_1f69fd8b-7e99-404b-82ed-f72d09034747/pull/0.log" Jun 09 08:25:32.690118 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:32.690088 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b_acccb45b-e7f2-4343-b52b-1f1a0dfff882/extract/0.log" Jun 09 08:25:32.702775 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:32.702757 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b_acccb45b-e7f2-4343-b52b-1f1a0dfff882/util/0.log" Jun 09 08:25:32.719673 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:32.719657 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736sd4b_acccb45b-e7f2-4343-b52b-1f1a0dfff882/pull/0.log" Jun 09 08:25:32.743510 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:32.743482 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr_20c75f19-58d6-4c91-9a0c-2b328578a77a/extract/0.log" Jun 09 08:25:32.761703 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:32.761685 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr_20c75f19-58d6-4c91-9a0c-2b328578a77a/util/0.log" Jun 09 08:25:32.785774 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:32.785754 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hrjzr_20c75f19-58d6-4c91-9a0c-2b328578a77a/pull/0.log" Jun 09 08:25:33.004865 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:33.004832 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-88v9w_30dc06e1-26de-480f-ae9e-b5b9f5b44d2d/registry-server/0.log" Jun 09 08:25:33.099391 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:33.099371 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bgzmc_a0579d85-3a01-4fc7-8683-bb0ada8a2256/limitador/0.log" Jun 09 08:25:33.143576 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:33.143554 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vg8mk_db641dc3-da1e-42a9-bc67-e49f3c0ef189/manager/0.log" Jun 09 08:25:34.708691 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:34.708652 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bbff46be-bf42-4cb0-83a8-e34171a6c72c/alertmanager/0.log" Jun 09 08:25:34.727795 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:34.727773 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bbff46be-bf42-4cb0-83a8-e34171a6c72c/config-reloader/0.log" Jun 09 08:25:34.753676 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:34.753644 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bbff46be-bf42-4cb0-83a8-e34171a6c72c/kube-rbac-proxy-web/0.log" Jun 09 08:25:34.770655 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:34.770636 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bbff46be-bf42-4cb0-83a8-e34171a6c72c/kube-rbac-proxy/0.log" Jun 09 08:25:34.790046 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:34.790028 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bbff46be-bf42-4cb0-83a8-e34171a6c72c/kube-rbac-proxy-metric/0.log" Jun 09 08:25:34.807349 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:34.807333 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bbff46be-bf42-4cb0-83a8-e34171a6c72c/prom-label-proxy/0.log" Jun 09 08:25:34.825130 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:34.825115 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bbff46be-bf42-4cb0-83a8-e34171a6c72c/init-config-reloader/0.log" Jun 09 08:25:35.018423 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.018359 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5v9k8_4bc3d505-dd6f-4f36-9325-81449ad3a0f7/node-exporter/0.log" Jun 09 08:25:35.038440 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.038413 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5v9k8_4bc3d505-dd6f-4f36-9325-81449ad3a0f7/kube-rbac-proxy/0.log" Jun 09 08:25:35.056305 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.056290 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5v9k8_4bc3d505-dd6f-4f36-9325-81449ad3a0f7/init-textfile/0.log" Jun 09 08:25:35.237298 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.237283 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hk9lx_12fde6ca-bc61-49e7-8f2b-3243e5b72a3a/kube-rbac-proxy-main/0.log" Jun 09 08:25:35.260057 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.260034 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hk9lx_12fde6ca-bc61-49e7-8f2b-3243e5b72a3a/kube-rbac-proxy-self/0.log" Jun 09 08:25:35.285293 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.285244 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-hk9lx_12fde6ca-bc61-49e7-8f2b-3243e5b72a3a/openshift-state-metrics/0.log" Jun 09 08:25:35.498646 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.498623 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-5zpqn_526e27b4-30dc-47f9-bfb2-0139f4974555/prometheus-operator/0.log" Jun 09 08:25:35.520187 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.520165 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-5zpqn_526e27b4-30dc-47f9-bfb2-0139f4974555/kube-rbac-proxy/0.log" Jun 09 08:25:35.549032 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.548972 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-gq49l_996df65c-a59f-49b8-ad35-ae9876339bcf/prometheus-operator-admission-webhook/0.log" Jun 09 08:25:35.579875 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.579857 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7699c84f46-cxjl2_ae33783a-d875-442b-aead-1c8a8cae8f7c/telemeter-client/0.log" Jun 09 08:25:35.600054 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.600038 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7699c84f46-cxjl2_ae33783a-d875-442b-aead-1c8a8cae8f7c/reload/0.log" Jun 09 08:25:35.621527 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.621502 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7699c84f46-cxjl2_ae33783a-d875-442b-aead-1c8a8cae8f7c/kube-rbac-proxy/0.log" Jun 09 08:25:35.649563 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.649547 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcd7cbb6d-t2pmx_b727d01f-18d9-4aff-852f-19038efab900/thanos-query/0.log" Jun 09 08:25:35.674752 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.674731 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcd7cbb6d-t2pmx_b727d01f-18d9-4aff-852f-19038efab900/kube-rbac-proxy-web/0.log" Jun 09 08:25:35.690613 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.690596 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcd7cbb6d-t2pmx_b727d01f-18d9-4aff-852f-19038efab900/kube-rbac-proxy/0.log" Jun 09 08:25:35.717854 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.717833 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcd7cbb6d-t2pmx_b727d01f-18d9-4aff-852f-19038efab900/prom-label-proxy/0.log" Jun 09 08:25:35.736257 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.736235 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcd7cbb6d-t2pmx_b727d01f-18d9-4aff-852f-19038efab900/kube-rbac-proxy-rules/0.log" Jun 09 08:25:35.759812 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:35.759795 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5bcd7cbb6d-t2pmx_b727d01f-18d9-4aff-852f-19038efab900/kube-rbac-proxy-metrics/0.log" Jun 09 08:25:37.751754 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:37.751693 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/2.log" Jun 09 08:25:37.755564 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:37.755547 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bp56k_7c531d4b-fba1-4fb5-8be5-26442f258c5e/console-operator/3.log" Jun 09 08:25:38.305744 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:38.305716 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-748dbb7b45-96msb_7eb6c6dc-1d3f-496f-8cc5-0723620c59ad/console/0.log" Jun 09 08:25:38.334234 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:38.334209 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-st79n_6a7a59eb-54f5-4652-9500-18250ac5fe62/download-server/0.log" Jun 09 08:25:38.916401 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:38.916375 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq"] Jun 09 08:25:38.916874 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:38.916858 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caa6d0fc-34e0-42c3-aa87-6ee3777a8d75" containerName="cleanup" Jun 09 08:25:38.916925 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:38.916878 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="caa6d0fc-34e0-42c3-aa87-6ee3777a8d75" containerName="cleanup" Jun 09 08:25:38.917027 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:38.917013 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="caa6d0fc-34e0-42c3-aa87-6ee3777a8d75" containerName="cleanup" Jun 09 08:25:38.920128 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:38.920114 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:38.922764 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:38.922741 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qzrcm\"/\"kube-root-ca.crt\"" Jun 09 08:25:38.923853 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:38.923832 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qzrcm\"/\"openshift-service-ca.crt\"" Jun 09 08:25:38.924141 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:38.923980 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qzrcm\"/\"default-dockercfg-7fn9v\"" Jun 09 08:25:38.928208 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:38.928167 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq"] Jun 09 08:25:39.014309 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.014286 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/48f22c20-28a6-4abd-a905-6960cfae4c8b-proc\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.014454 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.014324 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48f22c20-28a6-4abd-a905-6960cfae4c8b-lib-modules\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.014454 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.014349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwf9n\" (UniqueName: \"kubernetes.io/projected/48f22c20-28a6-4abd-a905-6960cfae4c8b-kube-api-access-gwf9n\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.014533 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.014491 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48f22c20-28a6-4abd-a905-6960cfae4c8b-sys\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.014533 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.014524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/48f22c20-28a6-4abd-a905-6960cfae4c8b-podres\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.115876 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.115854 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48f22c20-28a6-4abd-a905-6960cfae4c8b-sys\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.116005 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.115885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/48f22c20-28a6-4abd-a905-6960cfae4c8b-podres\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.116005 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.115907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/48f22c20-28a6-4abd-a905-6960cfae4c8b-proc\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.116005 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.115956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48f22c20-28a6-4abd-a905-6960cfae4c8b-lib-modules\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.116005 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.115980 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48f22c20-28a6-4abd-a905-6960cfae4c8b-sys\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.116005 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.115987 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwf9n\" (UniqueName: \"kubernetes.io/projected/48f22c20-28a6-4abd-a905-6960cfae4c8b-kube-api-access-gwf9n\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.116178 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.116019 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/48f22c20-28a6-4abd-a905-6960cfae4c8b-proc\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.116178 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.116047 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/48f22c20-28a6-4abd-a905-6960cfae4c8b-podres\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.116178 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.116115 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48f22c20-28a6-4abd-a905-6960cfae4c8b-lib-modules\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.124000 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.123983 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwf9n\" (UniqueName: \"kubernetes.io/projected/48f22c20-28a6-4abd-a905-6960cfae4c8b-kube-api-access-gwf9n\") pod \"perf-node-gather-daemonset-2j4pq\" (UID: \"48f22c20-28a6-4abd-a905-6960cfae4c8b\") " pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.231762 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.231739 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.370029 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.369999 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq"] Jun 09 08:25:39.371058 ip-10-0-139-124 kubenswrapper[2577]: W0609 08:25:39.371030 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod48f22c20_28a6_4abd_a905_6960cfae4c8b.slice/crio-b7380b5da1d03bc9a74108045be7912f8a9458f4bb713e17fc8b95011319a274 WatchSource:0}: Error finding container b7380b5da1d03bc9a74108045be7912f8a9458f4bb713e17fc8b95011319a274: Status 404 returned error can't find the container with id b7380b5da1d03bc9a74108045be7912f8a9458f4bb713e17fc8b95011319a274 Jun 09 08:25:39.654820 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.654736 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" event={"ID":"48f22c20-28a6-4abd-a905-6960cfae4c8b","Type":"ContainerStarted","Data":"ff0391efc4cea756d069fe14173818359dfe689f3e755babd192573e2afa2e6c"} Jun 09 08:25:39.654965 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.654822 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" event={"ID":"48f22c20-28a6-4abd-a905-6960cfae4c8b","Type":"ContainerStarted","Data":"b7380b5da1d03bc9a74108045be7912f8a9458f4bb713e17fc8b95011319a274"} Jun 09 08:25:39.654965 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.654846 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:39.673816 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:39.673771 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" podStartSLOduration=1.673758947 podStartE2EDuration="1.673758947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 08:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 08:25:39.67297373 +0000 UTC m=+1667.342819743" watchObservedRunningTime="2026-06-09 08:25:39.673758947 +0000 UTC m=+1667.343604962" Jun 09 08:25:40.211360 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:40.211337 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jtkj4_5822a48b-2f65-4848-9f7e-fdaaaaf881f7/dns/0.log" Jun 09 08:25:40.228965 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:40.228921 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jtkj4_5822a48b-2f65-4848-9f7e-fdaaaaf881f7/kube-rbac-proxy/0.log" Jun 09 08:25:40.272380 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:40.272361 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-psxf9_fee7c818-f667-4a20-8e2d-8d42ca5fa868/dns-node-resolver/0.log" Jun 09 08:25:40.864625 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:40.864596 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5gcm_5259c534-0a4b-4145-a3c9-18db9b83a062/node-ca/0.log" Jun 09 08:25:41.840983 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:41.840954 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-shvk6_5ec9720b-5ee1-4a07-b7cb-41e47d10e128/discovery/0.log" Jun 09 08:25:41.856557 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:41.856532 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69895d85c6-gp96q_af33d4bf-5969-4d16-8feb-b72b325fc6d4/kube-auth-proxy/0.log" Jun 09 08:25:41.950270 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:41.950246 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-v899w_d24a8276-3fc3-40a4-a7b5-6045b95e8ed7/payload-pre-processing/0.log" Jun 09 08:25:42.627903 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:42.627876 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-llcp2_3614ebbe-a959-4a99-8803-6da8f1585af5/serve-healthcheck-canary/0.log" Jun 09 08:25:43.104884 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:43.104860 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-x84lc_13f660d9-a165-4477-9110-10608939625b/insights-operator/0.log" Jun 09 08:25:43.105331 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:43.105143 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-x84lc_13f660d9-a165-4477-9110-10608939625b/insights-operator/1.log" Jun 09 08:25:43.237837 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:43.237814 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tts9n_50f566f7-c877-4f61-b441-792e7b335676/kube-rbac-proxy/0.log" Jun 09 08:25:43.261107 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:43.261081 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tts9n_50f566f7-c877-4f61-b441-792e7b335676/exporter/0.log" Jun 09 08:25:43.278530 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:43.278503 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tts9n_50f566f7-c877-4f61-b441-792e7b335676/extractor/0.log" Jun 09 08:25:45.549670 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:45.549644 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-75fff5c4cd-xggqr_a9eba66f-4e48-4aee-a3ad-4327f747ae14/nginx/0.log" Jun 09 08:25:45.576288 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:45.576260 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-dqv5t_846f55b3-19c5-447a-903f-8b67d43ceee5/manager/0.log" Jun 09 08:25:45.630922 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:45.630893 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-q954d_7a60aabf-c648-4efa-9ac3-f7b2010cd32c/manager/0.log" Jun 09 08:25:45.671396 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:45.671371 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qzrcm/perf-node-gather-daemonset-2j4pq" Jun 09 08:25:45.689020 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:45.688991 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683215-sbg8h_caa6d0fc-34e0-42c3-aa87-6ee3777a8d75/cleanup/0.log" Jun 09 08:25:45.767739 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:45.767716 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-cg7kp_f7e4a91d-61c6-4593-8c17-a1e6256a4af9/server/0.log" Jun 09 08:25:45.811374 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:45.811312 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-7fzgx_4bcb29f7-8693-49b6-82fe-2980579a5411/manager/0.log" Jun 09 08:25:45.971367 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:45.971347 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c6b94fd7b-xdm4n_733bd9e4-e1ca-4bab-89c4-b8c64dcb2208/manager/0.log" Jun 09 08:25:45.987707 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:45.987685 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c6b94fd7b-xdm4n_733bd9e4-e1ca-4bab-89c4-b8c64dcb2208/copy-manifests/0.log" Jun 09 08:25:47.657399 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:47.657373 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-62mgh_05dd2060-e7dc-4125-aba0-6a83ad021efc/openshift-lws-operator/0.log" Jun 09 08:25:52.339102 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:52.339068 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-shvk6_5ec9720b-5ee1-4a07-b7cb-41e47d10e128/discovery/0.log" Jun 09 08:25:52.348746 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:52.348723 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69895d85c6-gp96q_af33d4bf-5969-4d16-8feb-b72b325fc6d4/kube-auth-proxy/0.log" Jun 09 08:25:52.431475 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:52.431454 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-v899w_d24a8276-3fc3-40a4-a7b5-6045b95e8ed7/payload-pre-processing/0.log" Jun 09 08:25:53.405782 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:53.405745 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-xmzf8_be1b591a-a82d-44a8-a26d-a01e439851c2/kube-storage-version-migrator-operator/1.log" Jun 09 08:25:53.406580 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:53.406556 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-xmzf8_be1b591a-a82d-44a8-a26d-a01e439851c2/kube-storage-version-migrator-operator/0.log" Jun 09 08:25:53.569951 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:53.569908 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-shvk6_5ec9720b-5ee1-4a07-b7cb-41e47d10e128/discovery/0.log" Jun 09 08:25:53.578773 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:53.578755 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69895d85c6-gp96q_af33d4bf-5969-4d16-8feb-b72b325fc6d4/kube-auth-proxy/0.log" Jun 09 08:25:53.662590 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:53.662518 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-v899w_d24a8276-3fc3-40a4-a7b5-6045b95e8ed7/payload-pre-processing/0.log" Jun 09 08:25:54.665235 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:54.665171 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptm8p_0ad0b6d9-c782-474b-a61f-d5b525e99aae/kube-multus-additional-cni-plugins/0.log" Jun 09 08:25:54.681890 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:54.681869 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptm8p_0ad0b6d9-c782-474b-a61f-d5b525e99aae/egress-router-binary-copy/0.log" Jun 09 08:25:54.698225 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:54.698208 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptm8p_0ad0b6d9-c782-474b-a61f-d5b525e99aae/cni-plugins/0.log" Jun 09 08:25:54.715533 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:54.715513 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptm8p_0ad0b6d9-c782-474b-a61f-d5b525e99aae/bond-cni-plugin/0.log" Jun 09 08:25:54.731577 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:54.731559 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptm8p_0ad0b6d9-c782-474b-a61f-d5b525e99aae/routeoverride-cni/0.log" Jun 09 08:25:54.746718 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:54.746701 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptm8p_0ad0b6d9-c782-474b-a61f-d5b525e99aae/whereabouts-cni-bincopy/0.log" Jun 09 08:25:54.764519 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:54.764500 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptm8p_0ad0b6d9-c782-474b-a61f-d5b525e99aae/whereabouts-cni/0.log" Jun 09 08:25:54.948476 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:54.948448 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hhcmt_7315667c-1546-4683-9858-e6c94fd8ca5d/kube-multus/0.log" Jun 09 08:25:55.042258 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:55.042228 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fpbq7_2cc82d46-ff16-4d56-a54a-4d8283ab6d5a/network-metrics-daemon/0.log" Jun 09 08:25:55.060168 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:55.060144 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fpbq7_2cc82d46-ff16-4d56-a54a-4d8283ab6d5a/kube-rbac-proxy/0.log" Jun 09 08:25:55.260030 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:55.259973 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-shvk6_5ec9720b-5ee1-4a07-b7cb-41e47d10e128/discovery/0.log" Jun 09 08:25:55.271180 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:55.271158 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69895d85c6-gp96q_af33d4bf-5969-4d16-8feb-b72b325fc6d4/kube-auth-proxy/0.log" Jun 09 08:25:55.337865 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:55.337844 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-v899w_d24a8276-3fc3-40a4-a7b5-6045b95e8ed7/payload-pre-processing/0.log" Jun 09 08:25:56.440456 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:56.440430 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7cxx_c7195ac3-0b33-4ddc-aa73-25d213a05382/ovn-controller/0.log" Jun 09 08:25:56.454270 ip-10-0-139-124 kubenswrapper[2577]: I0609 08:25:56.454231 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z7cxx_c7195ac3-0b33-4ddc-aa73-25d213a05382/ovn-acl-logging/0.log"