Jul 15 12:06:02.296895 ip-10-0-141-123 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 15 12:06:02.296905 ip-10-0-141-123 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 15 12:06:02.296912 ip-10-0-141-123 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 15 12:06:02.297134 ip-10-0-141-123 systemd[1]: Failed to start Kubernetes Kubelet. Jul 15 12:06:12.348797 ip-10-0-141-123 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 15 12:06:12.348814 ip-10-0-141-123 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8847f32a508e4458997338fe69bb0bb6 -- Jul 15 12:07:52.278943 ip-10-0-141-123 systemd[1]: Starting Kubernetes Kubelet... Jul 15 12:07:52.745521 ip-10-0-141-123 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 12:07:52.745521 ip-10-0-141-123 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 12:07:52.745521 ip-10-0-141-123 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 12:07:52.745521 ip-10-0-141-123 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 12:07:52.745521 ip-10-0-141-123 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 12:07:52.745521 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.731507 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 12:07:52.745521 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739136 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 12:07:52.745521 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739150 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 12:07:52.745521 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739154 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 12:07:52.745521 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739157 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 12:07:52.745521 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739160 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 12:07:52.745521 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739163 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 12:07:52.745521 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739168 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739173 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739176 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739179 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739182 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739185 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739187 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739190 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739192 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739195 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739198 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739202 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739204 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739207 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739210 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739212 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739215 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739218 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739220 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739223 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 12:07:52.760184 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739226 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739229 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739231 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739234 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739236 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739239 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739242 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739244 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739247 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739249 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739252 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739254 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739257 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739260 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739262 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739265 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739268 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739271 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739274 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739276 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 12:07:52.762011 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739279 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739282 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739284 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739287 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739289 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739292 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739294 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739297 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739301 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739303 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739307 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739311 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739314 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739317 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739320 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739323 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739326 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739329 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739332 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739335 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 12:07:52.764700 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739338 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739340 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739343 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739346 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739350 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739354 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739357 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739360 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739363 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739367 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739369 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739372 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739375 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739377 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739380 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739382 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739385 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739387 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739390 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739393 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 15 12:07:52.766499 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739396 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739398 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739402 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739405 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739407 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739410 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739412 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739415 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739418 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739421 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739423 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739427 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.739429 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740320 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740328 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740331 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740334 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740337 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740340 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740343 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 12:07:52.780183 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740346 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740348 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740351 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740353 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740356 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740359 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740361 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740364 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740366 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740369 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740371 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740374 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740376 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740379 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740382 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740385 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740388 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740390 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740393 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740395 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 12:07:52.781994 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740398 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740401 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740403 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740408 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740412 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740416 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740420 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740423 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740426 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740429 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740432 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740435 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740438 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740440 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740443 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740445 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740448 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740450 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740453 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740455 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 12:07:52.784403 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740457 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740460 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740464 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740466 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740470 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740474 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740477 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740479 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740483 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740485 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740488 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740491 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740493 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740497 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740500 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740503 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740506 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740509 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 12:07:52.791789 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740511 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740514 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740517 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740520 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740523 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740526 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740529 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740532 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740534 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740537 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740539 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740542 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740544 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740549 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740551 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740554 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740557 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740559 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740562 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740564 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 12:07:52.793919 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740567 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740570 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740575 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740578 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740580 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740583 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740585 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740588 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740591 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740593 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740596 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740598 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740600 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740603 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.740998 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741003 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741006 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741008 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741011 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741014 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 12:07:52.795682 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741017 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741019 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741022 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741025 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741029 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741033 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741036 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741040 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741043 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741046 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741049 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741052 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741054 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741056 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741060 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741063 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741066 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741068 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741070 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 12:07:52.797979 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741073 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741075 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741078 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741080 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741083 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741085 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741088 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741092 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741095 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741097 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741100 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741103 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741106 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741109 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741111 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741113 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741116 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741118 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741121 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741123 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 12:07:52.876292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741126 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 12:07:52.811194 ip-10-0-141-123 systemd[1]: Started Kubernetes Kubelet. Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741128 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741131 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741133 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741136 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741138 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741141 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741144 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741147 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741149 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741152 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741154 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741157 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741159 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741161 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741164 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741166 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741169 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741172 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741176 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 12:07:52.899816 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741179 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741181 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741183 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741186 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741188 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741191 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741194 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741196 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741199 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741201 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741204 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741206 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741209 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741212 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741214 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741217 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741219 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741221 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741224 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741228 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 12:07:53.039225 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741232 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741236 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741238 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741241 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741244 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741246 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741249 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741251 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741254 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741256 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741259 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741262 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741265 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741267 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741343 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741351 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741357 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741364 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741371 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741377 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741383 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 12:07:53.039969 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741390 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741394 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741397 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741400 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741403 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741407 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741410 2582 flags.go:64] FLAG: --cgroup-root="" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741413 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741416 2582 flags.go:64] FLAG: --client-ca-file="" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741418 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741423 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741428 2582 flags.go:64] FLAG: --cluster-domain="" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741430 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741433 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741436 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741440 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741444 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741447 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741450 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741454 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741457 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741460 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741464 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741467 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 12:07:53.040625 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741470 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741474 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741477 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741480 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741483 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741486 2582 flags.go:64] FLAG: --enable-server="true" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741490 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741495 2582 flags.go:64] FLAG: --event-burst="100" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741498 2582 flags.go:64] FLAG: --event-qps="50" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741501 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741504 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741507 2582 flags.go:64] FLAG: --eviction-hard="" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741511 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741514 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741517 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741519 2582 flags.go:64] FLAG: --eviction-soft="" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741522 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741526 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741530 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741533 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741535 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741538 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741541 2582 flags.go:64] FLAG: --feature-gates="" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741545 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741548 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 12:07:53.041400 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741551 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741554 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741557 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741560 2582 flags.go:64] FLAG: --help="false" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741563 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741567 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741570 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741573 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741577 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741580 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741583 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741586 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741588 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741592 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741595 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741598 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741601 2582 flags.go:64] FLAG: --kube-reserved="" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741604 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741607 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741610 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741613 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741616 2582 flags.go:64] FLAG: --lock-file="" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741618 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741622 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 12:07:53.042146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741625 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741632 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741652 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741655 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741658 2582 flags.go:64] FLAG: --logging-format="text" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741661 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741665 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741668 2582 flags.go:64] FLAG: --manifest-url="" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741670 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741675 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741678 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741682 2582 flags.go:64] FLAG: --max-pods="110" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741685 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741690 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741693 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741696 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741699 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741702 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741705 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741712 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741715 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741718 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741721 2582 flags.go:64] FLAG: --pod-cidr="" Jul 15 12:07:53.043068 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741724 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741731 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741733 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741737 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741740 2582 flags.go:64] FLAG: --port="10250" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741743 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741746 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0957403eb02483426" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741749 2582 flags.go:64] FLAG: --qos-reserved="" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741752 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741754 2582 flags.go:64] FLAG: --register-node="true" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741759 2582 flags.go:64] FLAG: --register-with-taints="" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741763 2582 flags.go:64] FLAG: --registry-burst="10" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741766 2582 flags.go:64] FLAG: --registry-qps="5" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741768 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741771 2582 flags.go:64] FLAG: --reserved-memory="" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741776 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741779 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741782 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741785 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741788 2582 flags.go:64] FLAG: --runonce="false" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741790 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741793 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741796 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741801 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741803 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741806 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 12:07:53.044265 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741810 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741813 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741816 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741818 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741821 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741824 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741827 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741830 2582 flags.go:64] FLAG: --system-cgroups="" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741833 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741839 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741842 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741844 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741848 2582 flags.go:64] FLAG: --tls-min-version="" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741851 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741854 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741857 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741861 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741864 2582 flags.go:64] FLAG: --v="2" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741868 2582 flags.go:64] FLAG: --version="false" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741872 2582 flags.go:64] FLAG: --vmodule="" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741875 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.741879 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741994 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.741997 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 12:07:53.045071 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742001 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742003 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742006 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742009 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742011 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742015 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742018 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742021 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742023 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742026 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742029 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742031 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742034 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742036 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742039 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742041 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742045 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742047 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742050 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742052 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 12:07:53.045899 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742055 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742057 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742060 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742062 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742067 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742069 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742072 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742075 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742077 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742080 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742082 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742085 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742087 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742090 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742092 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742095 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742097 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742102 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742104 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742107 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 12:07:53.046524 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742109 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742112 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742115 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742117 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742120 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742122 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742125 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742127 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742130 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742133 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742136 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742138 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742141 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742143 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742146 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742149 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742154 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742158 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742161 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 12:07:53.047187 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742163 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742166 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742168 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742171 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742173 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742175 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742178 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742180 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742183 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742185 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742189 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742193 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742197 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742199 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742204 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742207 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742210 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742213 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742216 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 12:07:53.047805 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742218 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742221 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742224 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742227 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742230 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742233 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742236 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742239 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742242 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742245 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742248 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742251 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742253 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742255 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742258 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742260 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742263 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742265 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 12:07:53.048319 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.742268 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.742968 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.750127 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.750147 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.750976 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.750983 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751045 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751051 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751054 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751057 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751060 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751063 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751066 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751069 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751071 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 15 12:07:53.048843 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751074 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751077 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751079 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751083 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751086 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751089 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751091 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751094 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751097 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751099 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751102 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751104 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751107 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751111 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751116 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751119 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751122 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751124 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751127 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751130 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 12:07:53.049271 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751133 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751135 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751138 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751141 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751143 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751146 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751149 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751153 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751155 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751158 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751161 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751163 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751166 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751169 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751172 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751175 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751178 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751181 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751184 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751186 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 12:07:53.049880 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751192 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751194 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751197 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751200 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751202 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751205 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751207 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751210 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751213 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751215 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751218 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751221 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751224 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751227 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751232 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751236 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751239 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751242 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751245 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751247 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 12:07:53.050423 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751250 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751253 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751256 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751258 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751260 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751263 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751266 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751268 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751271 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751274 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751276 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751279 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751283 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751285 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751288 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751291 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751293 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751296 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 12:07:53.051017 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751298 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751303 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751308 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751312 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751315 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751318 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751320 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751323 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751326 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751328 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751331 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751333 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.751339 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751455 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751460 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 12:07:53.051510 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751463 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751466 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751469 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751471 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751475 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751477 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751480 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751482 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751485 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751488 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751491 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751496 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751498 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751501 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751503 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751506 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751508 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751510 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751513 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751515 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 12:07:53.052073 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751519 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751522 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751524 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751527 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751529 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751532 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751535 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751537 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751540 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751542 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751545 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751547 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751549 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751552 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751554 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751557 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751559 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751562 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751564 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 12:07:53.190326 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751567 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751570 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751573 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751578 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751583 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751586 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751589 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751592 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751595 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751598 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751600 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751603 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751606 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751610 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751613 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751615 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751618 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751621 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751623 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 12:07:53.191018 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751626 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751628 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751631 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751647 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751651 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751654 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751656 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751659 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751662 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751664 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751666 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751669 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751671 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751675 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751677 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751680 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751682 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751687 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751690 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751693 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 12:07:53.192385 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751695 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751698 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751700 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751703 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751706 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751709 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751712 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751715 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751717 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751720 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751723 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751725 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751728 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751732 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751735 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751738 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751741 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751743 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 12:07:53.192980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:52.751746 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 12:07:53.193461 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.751751 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 12:07:53.193461 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.751881 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 12:07:53.193461 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.754114 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 12:07:53.193461 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.755656 2582 server.go:1019] "Starting client certificate rotation" Jul 15 12:07:53.193461 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.755756 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 12:07:53.193461 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.755798 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 12:07:53.193461 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.758525 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 12:07:53.193461 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.767123 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 12:07:53.193461 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.777488 2582 log.go:25] "Validated CRI v1 runtime API" Jul 15 12:07:53.193461 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.779876 2582 log.go:25] "Validated CRI v1 image API" Jul 15 12:07:53.193461 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.783111 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 12:07:53.193461 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.785685 2582 fs.go:135] Filesystem UUIDs: map[201d4162-0c34-4390-835a-dd6a0ddf287d:/dev/nvme0n1p4 30f706d4-e3f4-41d4-8970-5c347994e6c8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 15 12:07:53.193911 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.785704 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 12:07:53.193911 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.786214 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.790283 2582 manager.go:216] Machine: {Timestamp:2026-07-15 12:07:52.789806155 +0000 UTC m=+0.382211983 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098850 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec228daac889569343a49ebb6f110945 SystemUUID:ec228daa-c889-5693-43a4-9ebb6f110945 BootID:8847f32a-508e-4458-9973-38fe69bb0bb6 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a4:29:ac:39:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a4:29:ac:39:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:81:70:dd:96:7f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.790386 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.790468 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.794753 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.794782 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-123.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.795606 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.795616 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.795628 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.795657 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.797413 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.800677 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.800806 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.800833 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.800844 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.800859 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.800869 2582 kubelet.go:398] "Adding apiserver pod source" Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.800885 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 12:07:53.349905 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.801226 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.801240 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.803425 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.806128 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.806156 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.806324 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.806338 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.806343 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.806348 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.806357 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.806362 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.807085 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.807092 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.807099 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.807105 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.807114 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.807129 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.807157 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.807165 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.810337 2582 server.go:1268] "Started kubelet" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.810412 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.810423 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.810491 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.816567 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.818083 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:52.818863 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.820392 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-123.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:52.820391 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:52.820527 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:52.822753 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-123.ec2.internal.18c27534fb7f325d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-123.ec2.internal,UID:ip-10-0-141-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-123.ec2.internal,},FirstTimestamp:2026-07-15 12:07:52.810304093 +0000 UTC m=+0.402709923,LastTimestamp:2026-07-15 12:07:52.810304093 +0000 UTC m=+0.402709923,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-123.ec2.internal,}" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.824245 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tpskp" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.825414 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:52.825486 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.825489 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.826161 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.826177 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.826163 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.826280 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.826288 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.826321 2582 factory.go:55] Registering systemd factory Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.826336 2582 factory.go:223] Registration of the systemd container factory successfully Jul 15 12:07:53.350480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.826564 2582 factory.go:153] Registering CRI-O factory Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.826579 2582 factory.go:223] Registration of the crio container factory successfully Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.826632 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.826675 2582 factory.go:103] Registering Raw factory Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.826689 2582 manager.go:1196] Started watching for new ooms in manager Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.827064 2582 manager.go:349] Starting recovery of all containers Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.834213 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tpskp" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:52.834290 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:52.834366 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.836546 2582 manager.go:354] Recovery completed Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.841050 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.842868 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientMemory" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.842892 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.842902 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientPID" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.845539 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.845540 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.845620 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.845690 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:52.845533 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-123.ec2.internal.18c27534fd704095 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-123.ec2.internal,UID:ip-10-0-141-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-123.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-123.ec2.internal,},FirstTimestamp:2026-07-15 12:07:52.842879125 +0000 UTC m=+0.435284954,LastTimestamp:2026-07-15 12:07:52.842879125 +0000 UTC m=+0.435284954,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-123.ec2.internal,}" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.846797 2582 policy_none.go:49] "None policy: Start" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.846818 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.846831 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.847150 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientMemory" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.847177 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.847189 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientPID" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.847708 2582 policy_none.go:47] "Start" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.902335 2582 manager.go:337] "Starting Device Plugin manager" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:52.902629 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.902660 2582 server.go:87] "Starting device plugin registration server" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.902932 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.902943 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.903050 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.903146 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.903153 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:52.903707 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:52.903763 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.954720 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.955967 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.956013 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.956049 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 12:07:53.351667 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:52.956093 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:52.959081 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.003341 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.005666 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientMemory" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.005699 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.005710 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientPID" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.005735 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.021803 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:53.021826 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-123.ec2.internal\": node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:53.042490 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.056894 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal"] Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.056969 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.057996 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientMemory" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.058029 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.058043 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientPID" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.059318 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.059564 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.059593 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.060265 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientMemory" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.060285 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.060294 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientPID" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.060663 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientMemory" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.060685 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.060697 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientPID" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.061407 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.061433 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.062166 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientMemory" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.062185 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.062195 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeHasSufficientPID" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:53.109515 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-123.ec2.internal\" not found" node="ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:53.114085 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-123.ec2.internal\" not found" node="ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.127799 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3fc06b25f52ae8628a56f24a8ff34a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal\" (UID: \"a3fc06b25f52ae8628a56f24a8ff34a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.127832 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3fc06b25f52ae8628a56f24a8ff34a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal\" (UID: \"a3fc06b25f52ae8628a56f24a8ff34a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.352709 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.127850 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b288c0263dd3bd9ee0a8c0f7dd2e8f04-config\") pod \"kube-apiserver-proxy-ip-10-0-141-123.ec2.internal\" (UID: \"b288c0263dd3bd9ee0a8c0f7dd2e8f04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.353596 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:53.142937 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:53.353596 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.228746 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3fc06b25f52ae8628a56f24a8ff34a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal\" (UID: \"a3fc06b25f52ae8628a56f24a8ff34a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.353596 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.228783 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3fc06b25f52ae8628a56f24a8ff34a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal\" (UID: \"a3fc06b25f52ae8628a56f24a8ff34a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.353596 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.228800 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b288c0263dd3bd9ee0a8c0f7dd2e8f04-config\") pod \"kube-apiserver-proxy-ip-10-0-141-123.ec2.internal\" (UID: \"b288c0263dd3bd9ee0a8c0f7dd2e8f04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.353596 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.228842 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b288c0263dd3bd9ee0a8c0f7dd2e8f04-config\") pod \"kube-apiserver-proxy-ip-10-0-141-123.ec2.internal\" (UID: \"b288c0263dd3bd9ee0a8c0f7dd2e8f04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.353596 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.228854 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3fc06b25f52ae8628a56f24a8ff34a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal\" (UID: \"a3fc06b25f52ae8628a56f24a8ff34a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.353596 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.228854 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3fc06b25f52ae8628a56f24a8ff34a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal\" (UID: \"a3fc06b25f52ae8628a56f24a8ff34a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.353596 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:53.243922 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:53.353596 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:53.344138 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:53.579220 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.411339 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.579220 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.417332 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" Jul 15 12:07:53.579220 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:53.444475 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:53.579220 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:53.544991 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:53.826447 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:53.645666 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:53.826447 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.668708 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 12:07:53.826447 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:53.746508 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:53.826447 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.755325 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 12:07:53.826447 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.755486 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 12:07:53.826447 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.755506 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 12:07:54.060980 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.838284 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 12:02:53 +0000 UTC" deadline="2028-04-08 16:46:10.905453906 +0000 UTC" Jul 15 12:07:54.060980 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:53.838319 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15196h38m17.06713891s" Jul 15 12:07:54.060980 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:53.847579 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:54.060980 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:53.947940 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:54.060980 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:54.003884 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb288c0263dd3bd9ee0a8c0f7dd2e8f04.slice/crio-b8046ca3d56e88494c2f5a44dbc9f909ca0fe47b032b89983e7b59835a43380a WatchSource:0}: Error finding container b8046ca3d56e88494c2f5a44dbc9f909ca0fe47b032b89983e7b59835a43380a: Status 404 returned error can't find the container with id b8046ca3d56e88494c2f5a44dbc9f909ca0fe47b032b89983e7b59835a43380a Jul 15 12:07:54.060980 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.009381 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 12:07:54.060980 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:54.049065 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:54.286628 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:54.149540 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:54.286628 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:54.249872 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-123.ec2.internal\" not found" Jul 15 12:07:54.286628 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.283317 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 12:07:54.527928 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.327591 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" Jul 15 12:07:54.527928 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.340105 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 12:07:54.527928 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.341438 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" Jul 15 12:07:54.527928 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.346170 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 12:07:54.527928 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.354437 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.760832 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.823662 2582 apiserver.go:52] "Watching apiserver" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.826923 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.837364 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.837819 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bxd5k","kube-system/konnectivity-agent-6m59g","openshift-cluster-node-tuning-operator/tuned-czfww","openshift-image-registry/node-ca-qztnm","openshift-multus/multus-additional-cni-plugins-mvjdv","openshift-multus/network-metrics-daemon-svjhf","openshift-network-diagnostics/network-check-target-2jc9g","openshift-network-operator/iptables-alerter-ndg9c","kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q","openshift-dns/node-resolver-kcflq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal","openshift-multus/multus-2bpnv","openshift-ovn-kubernetes/ovnkube-node-wt84c"] Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.839939 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.840971 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.841725 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.843141 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.843864 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.843890 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.844013 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.844041 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xrjfp\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.844090 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.844184 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.844518 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:54.844586 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.845243 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.845355 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.845398 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d7xbs\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.846081 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.846083 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.846184 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g7hgb\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.846471 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qztnm" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.846612 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.848291 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:54.848350 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.848784 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.849717 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l85fd\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.849783 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 12:07:54.850161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.849805 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 12:07:54.851752 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.849886 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:07:54.851752 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:54.850000 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:07:54.851752 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.851350 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ndg9c" Jul 15 12:07:54.853334 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.853025 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6m59g" Jul 15 12:07:54.855007 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.854880 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kcflq" Jul 15 12:07:54.856087 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.855586 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 12:07:54.856087 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.855593 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 12:07:54.856319 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.856084 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 12:07:54.856996 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.856498 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-754sv\"" Jul 15 12:07:54.856996 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.856806 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.858405 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.857116 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9nqnj\"" Jul 15 12:07:54.858405 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.857789 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 12:07:54.858405 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.857815 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 12:07:54.858634 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.858448 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.860168 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.859185 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 12:07:54.860168 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.859379 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kz78l\"" Jul 15 12:07:54.860168 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.859949 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 12:07:54.860168 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.860068 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7kvpd\"" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.861065 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.862130 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8q86g\"" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.862177 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.862713 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.862761 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.863591 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.863874 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.865395 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.908427 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pmzmt" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.916373 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pmzmt" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.928438 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940109 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-kubernetes\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940148 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03f084d1-05e4-486c-9220-9d855c890f80-konnectivity-ca\") pod \"konnectivity-agent-6m59g\" (UID: \"03f084d1-05e4-486c-9220-9d855c890f80\") " pod="kube-system/konnectivity-agent-6m59g" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940178 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-hostroot\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940204 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-cni-bin\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940232 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11a027a9-d26f-4a2d-9a64-678ae697c38c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940300 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-sysconfig\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940325 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-var-lib-kubelet\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940351 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b700d12b-d185-4399-8f57-3e8bc852eff2-host-slash\") pod \"iptables-alerter-ndg9c\" (UID: \"b700d12b-d185-4399-8f57-3e8bc852eff2\") " pod="openshift-network-operator/iptables-alerter-ndg9c" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940379 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-system-cni-dir\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940404 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-run-k8s-cni-cncf-io\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940431 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-etc-kubernetes\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.961135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940461 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbgkz\" (UniqueName: \"kubernetes.io/projected/29baf1ab-c0ed-4625-9a27-c00f9e281038-kube-api-access-rbgkz\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940486 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-etc-openvswitch\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940512 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hcrg\" (UniqueName: \"kubernetes.io/projected/c3804496-d17a-4f8b-8193-76e79cfb59fd-kube-api-access-4hcrg\") pod \"node-ca-qztnm\" (UID: \"c3804496-d17a-4f8b-8193-76e79cfb59fd\") " pod="openshift-image-registry/node-ca-qztnm" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940537 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krgt9\" (UniqueName: \"kubernetes.io/projected/b700d12b-d185-4399-8f57-3e8bc852eff2-kube-api-access-krgt9\") pod \"iptables-alerter-ndg9c\" (UID: \"b700d12b-d185-4399-8f57-3e8bc852eff2\") " pod="openshift-network-operator/iptables-alerter-ndg9c" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940564 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11a027a9-d26f-4a2d-9a64-678ae697c38c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940591 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-registration-dir\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940618 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9196c019-2ba1-4bd8-8d5a-f579b619f4eb-hosts-file\") pod \"node-resolver-kcflq\" (UID: \"9196c019-2ba1-4bd8-8d5a-f579b619f4eb\") " pod="openshift-dns/node-resolver-kcflq" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940648 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-node-log\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940682 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-log-socket\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940733 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr2f2\" (UniqueName: \"kubernetes.io/projected/060bfdcc-ad52-4390-8054-d63a9b024e9c-kube-api-access-pr2f2\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940810 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-sys-fs\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940849 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-sysctl-d\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940868 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42e44198-430d-4a24-ac72-001f7fc4a7b1-kubelet-config\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940913 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-multus-socket-dir-parent\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.940993 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-var-lib-cni-multus\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941037 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-run-netns\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.962488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941068 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-sysctl-conf\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941094 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-lib-modules\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941117 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs\") pod \"network-metrics-daemon-svjhf\" (UID: \"1ce43433-1205-4257-a355-91da9321806c\") " pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941152 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9196c019-2ba1-4bd8-8d5a-f579b619f4eb-tmp-dir\") pod \"node-resolver-kcflq\" (UID: \"9196c019-2ba1-4bd8-8d5a-f579b619f4eb\") " pod="openshift-dns/node-resolver-kcflq" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941178 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-os-release\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941210 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-run-multus-certs\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941263 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-kubelet\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941288 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-run-openvswitch\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941305 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xb9z\" (UniqueName: \"kubernetes.io/projected/500e596f-f9fe-4f18-8f18-72d71b2e68f1-kube-api-access-8xb9z\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941331 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-var-lib-openvswitch\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941350 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941368 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/060bfdcc-ad52-4390-8054-d63a9b024e9c-ovn-node-metrics-cert\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11a027a9-d26f-4a2d-9a64-678ae697c38c-os-release\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941416 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-sys\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941433 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42e44198-430d-4a24-ac72-001f7fc4a7b1-dbus\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.941469 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-multus-conf-dir\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.964061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.942143 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-run-systemd\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.942536 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6vqj\" (UniqueName: \"kubernetes.io/projected/11a027a9-d26f-4a2d-9a64-678ae697c38c-kube-api-access-r6vqj\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943039 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6gsd\" (UniqueName: \"kubernetes.io/projected/ed5152b9-b70b-4700-8845-415f3ea3a8a9-kube-api-access-h6gsd\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/500e596f-f9fe-4f18-8f18-72d71b2e68f1-tmp\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943502 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943517 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943533 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzzkv\" (UniqueName: \"kubernetes.io/projected/9196c019-2ba1-4bd8-8d5a-f579b619f4eb-kube-api-access-mzzkv\") pod \"node-resolver-kcflq\" (UID: \"9196c019-2ba1-4bd8-8d5a-f579b619f4eb\") " pod="openshift-dns/node-resolver-kcflq" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943549 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-device-dir\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943572 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-var-lib-kubelet\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943606 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/29baf1ab-c0ed-4625-9a27-c00f9e281038-multus-daemon-config\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943622 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-slash\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943638 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-cni-netd\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943657 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/060bfdcc-ad52-4390-8054-d63a9b024e9c-env-overrides\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943675 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11a027a9-d26f-4a2d-9a64-678ae697c38c-system-cni-dir\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943696 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-socket-dir\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943730 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c3804496-d17a-4f8b-8193-76e79cfb59fd-serviceca\") pod \"node-ca-qztnm\" (UID: \"c3804496-d17a-4f8b-8193-76e79cfb59fd\") " pod="openshift-image-registry/node-ca-qztnm" Jul 15 12:07:54.965195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943763 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsw2h\" (UniqueName: \"kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h\") pod \"network-check-target-2jc9g\" (UID: \"4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f\") " pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943787 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03f084d1-05e4-486c-9220-9d855c890f80-agent-certs\") pod \"konnectivity-agent-6m59g\" (UID: \"03f084d1-05e4-486c-9220-9d855c890f80\") " pod="kube-system/konnectivity-agent-6m59g" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943804 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/060bfdcc-ad52-4390-8054-d63a9b024e9c-ovnkube-script-lib\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943832 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-modprobe-d\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943856 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-systemd\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943873 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-tuned\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943886 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-cnibin\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943907 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-var-lib-cni-bin\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943933 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/060bfdcc-ad52-4390-8054-d63a9b024e9c-ovnkube-config\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943952 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3804496-d17a-4f8b-8193-76e79cfb59fd-host\") pod \"node-ca-qztnm\" (UID: \"c3804496-d17a-4f8b-8193-76e79cfb59fd\") " pod="openshift-image-registry/node-ca-qztnm" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943969 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.943985 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29baf1ab-c0ed-4625-9a27-c00f9e281038-cni-binary-copy\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.944029 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-systemd-units\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.944058 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-run-ovn\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.944085 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.944110 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11a027a9-d26f-4a2d-9a64-678ae697c38c-cnibin\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.944129 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-run\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.967053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.944154 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-host\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:54.967972 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.944174 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b700d12b-d185-4399-8f57-3e8bc852eff2-iptables-alerter-script\") pod \"iptables-alerter-ndg9c\" (UID: \"b700d12b-d185-4399-8f57-3e8bc852eff2\") " pod="openshift-network-operator/iptables-alerter-ndg9c" Jul 15 12:07:54.967972 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.944199 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11a027a9-d26f-4a2d-9a64-678ae697c38c-cni-binary-copy\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:54.967972 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.944216 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11a027a9-d26f-4a2d-9a64-678ae697c38c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:54.967972 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.944236 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z9xj\" (UniqueName: \"kubernetes.io/projected/1ce43433-1205-4257-a355-91da9321806c-kube-api-access-4z9xj\") pod \"network-metrics-daemon-svjhf\" (UID: \"1ce43433-1205-4257-a355-91da9321806c\") " pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:07:54.967972 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.944260 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-multus-cni-dir\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:54.967972 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.944278 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-run-netns\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:54.971435 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" event={"ID":"b288c0263dd3bd9ee0a8c0f7dd2e8f04","Type":"ContainerStarted","Data":"b8046ca3d56e88494c2f5a44dbc9f909ca0fe47b032b89983e7b59835a43380a"} Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.044530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11a027a9-d26f-4a2d-9a64-678ae697c38c-cni-binary-copy\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.044577 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11a027a9-d26f-4a2d-9a64-678ae697c38c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.044607 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z9xj\" (UniqueName: \"kubernetes.io/projected/1ce43433-1205-4257-a355-91da9321806c-kube-api-access-4z9xj\") pod \"network-metrics-daemon-svjhf\" (UID: \"1ce43433-1205-4257-a355-91da9321806c\") " pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.044757 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-multus-cni-dir\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.044799 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-run-netns\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.044828 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-kubernetes\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.044853 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03f084d1-05e4-486c-9220-9d855c890f80-konnectivity-ca\") pod \"konnectivity-agent-6m59g\" (UID: \"03f084d1-05e4-486c-9220-9d855c890f80\") " pod="kube-system/konnectivity-agent-6m59g" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.044874 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-hostroot\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.044974 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-kubernetes\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.045043 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-hostroot\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.045106 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-multus-cni-dir\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.045172 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-cni-bin\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.045301 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11a027a9-d26f-4a2d-9a64-678ae697c38c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.044922 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-run-netns\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.045576 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03f084d1-05e4-486c-9220-9d855c890f80-konnectivity-ca\") pod \"konnectivity-agent-6m59g\" (UID: \"03f084d1-05e4-486c-9220-9d855c890f80\") " pod="kube-system/konnectivity-agent-6m59g" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.044895 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-cni-bin\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.070591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.047642 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11a027a9-d26f-4a2d-9a64-678ae697c38c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.047673 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-sysconfig\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.047713 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-var-lib-kubelet\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.047742 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b700d12b-d185-4399-8f57-3e8bc852eff2-host-slash\") pod \"iptables-alerter-ndg9c\" (UID: \"b700d12b-d185-4399-8f57-3e8bc852eff2\") " pod="openshift-network-operator/iptables-alerter-ndg9c" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.047801 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b700d12b-d185-4399-8f57-3e8bc852eff2-host-slash\") pod \"iptables-alerter-ndg9c\" (UID: \"b700d12b-d185-4399-8f57-3e8bc852eff2\") " pod="openshift-network-operator/iptables-alerter-ndg9c" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.047814 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-sysconfig\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.047813 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-var-lib-kubelet\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.047839 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-system-cni-dir\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.047799 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11a027a9-d26f-4a2d-9a64-678ae697c38c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.047872 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-run-k8s-cni-cncf-io\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.047906 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-run-k8s-cni-cncf-io\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.047924 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-etc-kubernetes\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.047965 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-etc-kubernetes\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.047924 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-system-cni-dir\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.053546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgkz\" (UniqueName: \"kubernetes.io/projected/29baf1ab-c0ed-4625-9a27-c00f9e281038-kube-api-access-rbgkz\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.053555 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.053578 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-etc-openvswitch\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.053602 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hcrg\" (UniqueName: \"kubernetes.io/projected/c3804496-d17a-4f8b-8193-76e79cfb59fd-kube-api-access-4hcrg\") pod \"node-ca-qztnm\" (UID: \"c3804496-d17a-4f8b-8193-76e79cfb59fd\") " pod="openshift-image-registry/node-ca-qztnm" Jul 15 12:07:55.072002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.053796 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-etc-openvswitch\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.053849 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krgt9\" (UniqueName: \"kubernetes.io/projected/b700d12b-d185-4399-8f57-3e8bc852eff2-kube-api-access-krgt9\") pod \"iptables-alerter-ndg9c\" (UID: \"b700d12b-d185-4399-8f57-3e8bc852eff2\") " pod="openshift-network-operator/iptables-alerter-ndg9c" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.053881 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11a027a9-d26f-4a2d-9a64-678ae697c38c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.053921 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-registration-dir\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.053947 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9196c019-2ba1-4bd8-8d5a-f579b619f4eb-hosts-file\") pod \"node-resolver-kcflq\" (UID: \"9196c019-2ba1-4bd8-8d5a-f579b619f4eb\") " pod="openshift-dns/node-resolver-kcflq" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.054042 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-registration-dir\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.054107 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9196c019-2ba1-4bd8-8d5a-f579b619f4eb-hosts-file\") pod \"node-resolver-kcflq\" (UID: \"9196c019-2ba1-4bd8-8d5a-f579b619f4eb\") " pod="openshift-dns/node-resolver-kcflq" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.054351 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11a027a9-d26f-4a2d-9a64-678ae697c38c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.055861 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-node-log\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.055881 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-log-socket\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.055902 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr2f2\" (UniqueName: \"kubernetes.io/projected/060bfdcc-ad52-4390-8054-d63a9b024e9c-kube-api-access-pr2f2\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.055928 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-sys-fs\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.055955 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-sysctl-d\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.055983 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-log-socket\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056000 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42e44198-430d-4a24-ac72-001f7fc4a7b1-kubelet-config\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056006 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-node-log\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056026 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-multus-socket-dir-parent\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.073579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056052 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-var-lib-cni-multus\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056067 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-sys-fs\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-run-netns\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056112 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-sysctl-conf\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056136 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-lib-modules\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056156 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-sysctl-d\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056331 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-run-netns\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056179 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-var-lib-cni-multus\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056557 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-sysctl-conf\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056648 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-multus-socket-dir-parent\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056664 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11a027a9-d26f-4a2d-9a64-678ae697c38c-cni-binary-copy\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056729 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42e44198-430d-4a24-ac72-001f7fc4a7b1-kubelet-config\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056763 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs\") pod \"network-metrics-daemon-svjhf\" (UID: \"1ce43433-1205-4257-a355-91da9321806c\") " pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056803 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9196c019-2ba1-4bd8-8d5a-f579b619f4eb-tmp-dir\") pod \"node-resolver-kcflq\" (UID: \"9196c019-2ba1-4bd8-8d5a-f579b619f4eb\") " pod="openshift-dns/node-resolver-kcflq" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056860 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-os-release\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056945 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-os-release\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.056957 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.056985 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-run-multus-certs\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.074747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057015 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-kubelet\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.057036 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs podName:1ce43433-1205-4257-a355-91da9321806c nodeName:}" failed. No retries permitted until 2026-07-15 12:07:55.557014361 +0000 UTC m=+3.149420197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs") pod "network-metrics-daemon-svjhf" (UID: "1ce43433-1205-4257-a355-91da9321806c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057062 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-run-multus-certs\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057090 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-kubelet\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057128 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-run-openvswitch\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057166 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xb9z\" (UniqueName: \"kubernetes.io/projected/500e596f-f9fe-4f18-8f18-72d71b2e68f1-kube-api-access-8xb9z\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057194 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-var-lib-openvswitch\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057232 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057268 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/060bfdcc-ad52-4390-8054-d63a9b024e9c-ovn-node-metrics-cert\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057299 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-lib-modules\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057390 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-run-openvswitch\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057379 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057452 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-var-lib-openvswitch\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057458 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11a027a9-d26f-4a2d-9a64-678ae697c38c-os-release\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057493 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-sys\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057559 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-sys\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.078705 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057699 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11a027a9-d26f-4a2d-9a64-678ae697c38c-os-release\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057767 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42e44198-430d-4a24-ac72-001f7fc4a7b1-dbus\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057799 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-multus-conf-dir\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057837 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-run-systemd\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057873 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6vqj\" (UniqueName: \"kubernetes.io/projected/11a027a9-d26f-4a2d-9a64-678ae697c38c-kube-api-access-r6vqj\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057911 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6gsd\" (UniqueName: \"kubernetes.io/projected/ed5152b9-b70b-4700-8845-415f3ea3a8a9-kube-api-access-h6gsd\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057960 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/500e596f-f9fe-4f18-8f18-72d71b2e68f1-tmp\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057997 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058189 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42e44198-430d-4a24-ac72-001f7fc4a7b1-dbus\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058025 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058266 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058303 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzzkv\" (UniqueName: \"kubernetes.io/projected/9196c019-2ba1-4bd8-8d5a-f579b619f4eb-kube-api-access-mzzkv\") pod \"node-resolver-kcflq\" (UID: \"9196c019-2ba1-4bd8-8d5a-f579b619f4eb\") " pod="openshift-dns/node-resolver-kcflq" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058342 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-device-dir\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058374 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-var-lib-kubelet\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058481 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058522 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-run-systemd\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058532 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/29baf1ab-c0ed-4625-9a27-c00f9e281038-multus-daemon-config\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.080024 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058567 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-slash\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058605 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-cni-netd\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058639 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/060bfdcc-ad52-4390-8054-d63a9b024e9c-env-overrides\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058676 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11a027a9-d26f-4a2d-9a64-678ae697c38c-system-cni-dir\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058706 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-socket-dir\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058761 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c3804496-d17a-4f8b-8193-76e79cfb59fd-serviceca\") pod \"node-ca-qztnm\" (UID: \"c3804496-d17a-4f8b-8193-76e79cfb59fd\") " pod="openshift-image-registry/node-ca-qztnm" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058764 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-device-dir\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058800 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsw2h\" (UniqueName: \"kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h\") pod \"network-check-target-2jc9g\" (UID: \"4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f\") " pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058837 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03f084d1-05e4-486c-9220-9d855c890f80-agent-certs\") pod \"konnectivity-agent-6m59g\" (UID: \"03f084d1-05e4-486c-9220-9d855c890f80\") " pod="kube-system/konnectivity-agent-6m59g" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058842 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-var-lib-kubelet\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058872 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/060bfdcc-ad52-4390-8054-d63a9b024e9c-ovnkube-script-lib\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058896 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-cni-netd\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058901 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-modprobe-d\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.057995 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-multus-conf-dir\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058934 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-systemd\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058973 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-tuned\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059007 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-cnibin\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.081214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059043 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-var-lib-cni-bin\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059073 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/060bfdcc-ad52-4390-8054-d63a9b024e9c-ovnkube-config\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059105 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3804496-d17a-4f8b-8193-76e79cfb59fd-host\") pod \"node-ca-qztnm\" (UID: \"c3804496-d17a-4f8b-8193-76e79cfb59fd\") " pod="openshift-image-registry/node-ca-qztnm" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059138 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059172 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29baf1ab-c0ed-4625-9a27-c00f9e281038-cni-binary-copy\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-systemd-units\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059234 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-run-ovn\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059268 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059310 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11a027a9-d26f-4a2d-9a64-678ae697c38c-cnibin\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059345 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-run\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059377 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-host\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059394 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/060bfdcc-ad52-4390-8054-d63a9b024e9c-env-overrides\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059417 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b700d12b-d185-4399-8f57-3e8bc852eff2-iptables-alerter-script\") pod \"iptables-alerter-ndg9c\" (UID: \"b700d12b-d185-4399-8f57-3e8bc852eff2\") " pod="openshift-network-operator/iptables-alerter-ndg9c" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059424 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/29baf1ab-c0ed-4625-9a27-c00f9e281038-multus-daemon-config\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059488 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11a027a9-d26f-4a2d-9a64-678ae697c38c-system-cni-dir\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059629 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed5152b9-b70b-4700-8845-415f3ea3a8a9-socket-dir\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059700 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3804496-d17a-4f8b-8193-76e79cfb59fd-host\") pod \"node-ca-qztnm\" (UID: \"c3804496-d17a-4f8b-8193-76e79cfb59fd\") " pod="openshift-image-registry/node-ca-qztnm" Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.059823 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 12:07:55.082370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.059875 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c3804496-d17a-4f8b-8193-76e79cfb59fd-serviceca\") pod \"node-ca-qztnm\" (UID: \"c3804496-d17a-4f8b-8193-76e79cfb59fd\") " pod="openshift-image-registry/node-ca-qztnm" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.059892 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret podName:42e44198-430d-4a24-ac72-001f7fc4a7b1 nodeName:}" failed. No retries permitted until 2026-07-15 12:07:55.559871599 +0000 UTC m=+3.152277435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret") pod "global-pull-secret-syncer-bxd5k" (UID: "42e44198-430d-4a24-ac72-001f7fc4a7b1") : object "kube-system"/"original-pull-secret" not registered Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.060327 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11a027a9-d26f-4a2d-9a64-678ae697c38c-cnibin\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.060377 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/060bfdcc-ad52-4390-8054-d63a9b024e9c-ovn-node-metrics-cert\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.060390 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-systemd-units\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.060396 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/060bfdcc-ad52-4390-8054-d63a9b024e9c-ovnkube-config\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.060446 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-run-ovn\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.060461 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-run\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.060478 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.060514 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-systemd\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.060569 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-host\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.060585 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-modprobe-d\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.060644 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-cnibin\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.060691 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/29baf1ab-c0ed-4625-9a27-c00f9e281038-host-var-lib-cni-bin\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.060768 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/060bfdcc-ad52-4390-8054-d63a9b024e9c-host-slash\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.060938 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/500e596f-f9fe-4f18-8f18-72d71b2e68f1-tmp\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.058076 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z9xj\" (UniqueName: \"kubernetes.io/projected/1ce43433-1205-4257-a355-91da9321806c-kube-api-access-4z9xj\") pod \"network-metrics-daemon-svjhf\" (UID: \"1ce43433-1205-4257-a355-91da9321806c\") " pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:07:55.083295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.061174 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b700d12b-d185-4399-8f57-3e8bc852eff2-iptables-alerter-script\") pod \"iptables-alerter-ndg9c\" (UID: \"b700d12b-d185-4399-8f57-3e8bc852eff2\") " pod="openshift-network-operator/iptables-alerter-ndg9c" Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.061179 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29baf1ab-c0ed-4625-9a27-c00f9e281038-cni-binary-copy\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.062001 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/060bfdcc-ad52-4390-8054-d63a9b024e9c-ovnkube-script-lib\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.063199 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/500e596f-f9fe-4f18-8f18-72d71b2e68f1-etc-tuned\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.063775 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9196c019-2ba1-4bd8-8d5a-f579b619f4eb-tmp-dir\") pod \"node-resolver-kcflq\" (UID: \"9196c019-2ba1-4bd8-8d5a-f579b619f4eb\") " pod="openshift-dns/node-resolver-kcflq" Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.064044 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbgkz\" (UniqueName: \"kubernetes.io/projected/29baf1ab-c0ed-4625-9a27-c00f9e281038-kube-api-access-rbgkz\") pod \"multus-2bpnv\" (UID: \"29baf1ab-c0ed-4625-9a27-c00f9e281038\") " pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.064071 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03f084d1-05e4-486c-9220-9d855c890f80-agent-certs\") pod \"konnectivity-agent-6m59g\" (UID: \"03f084d1-05e4-486c-9220-9d855c890f80\") " pod="kube-system/konnectivity-agent-6m59g" Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.068933 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hcrg\" (UniqueName: \"kubernetes.io/projected/c3804496-d17a-4f8b-8193-76e79cfb59fd-kube-api-access-4hcrg\") pod \"node-ca-qztnm\" (UID: \"c3804496-d17a-4f8b-8193-76e79cfb59fd\") " pod="openshift-image-registry/node-ca-qztnm" Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.069392 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr2f2\" (UniqueName: \"kubernetes.io/projected/060bfdcc-ad52-4390-8054-d63a9b024e9c-kube-api-access-pr2f2\") pod \"ovnkube-node-wt84c\" (UID: \"060bfdcc-ad52-4390-8054-d63a9b024e9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.072773 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xb9z\" (UniqueName: \"kubernetes.io/projected/500e596f-f9fe-4f18-8f18-72d71b2e68f1-kube-api-access-8xb9z\") pod \"tuned-czfww\" (UID: \"500e596f-f9fe-4f18-8f18-72d71b2e68f1\") " pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.076529 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6gsd\" (UniqueName: \"kubernetes.io/projected/ed5152b9-b70b-4700-8845-415f3ea3a8a9-kube-api-access-h6gsd\") pod \"aws-ebs-csi-driver-node-lq58q\" (UID: \"ed5152b9-b70b-4700-8845-415f3ea3a8a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.077688 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.077728 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.077745 2582 projected.go:196] Error preparing data for projected volume kube-api-access-hsw2h for pod openshift-network-diagnostics/network-check-target-2jc9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.077830 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h podName:4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f nodeName:}" failed. No retries permitted until 2026-07-15 12:07:55.577809175 +0000 UTC m=+3.170215006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hsw2h" (UniqueName: "kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h") pod "network-check-target-2jc9g" (UID: "4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.081203 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6vqj\" (UniqueName: \"kubernetes.io/projected/11a027a9-d26f-4a2d-9a64-678ae697c38c-kube-api-access-r6vqj\") pod \"multus-additional-cni-plugins-mvjdv\" (UID: \"11a027a9-d26f-4a2d-9a64-678ae697c38c\") " pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.084475 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.081210 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzzkv\" (UniqueName: \"kubernetes.io/projected/9196c019-2ba1-4bd8-8d5a-f579b619f4eb-kube-api-access-mzzkv\") pod \"node-resolver-kcflq\" (UID: \"9196c019-2ba1-4bd8-8d5a-f579b619f4eb\") " pod="openshift-dns/node-resolver-kcflq" Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.087756 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krgt9\" (UniqueName: \"kubernetes.io/projected/b700d12b-d185-4399-8f57-3e8bc852eff2-kube-api-access-krgt9\") pod \"iptables-alerter-ndg9c\" (UID: \"b700d12b-d185-4399-8f57-3e8bc852eff2\") " pod="openshift-network-operator/iptables-alerter-ndg9c" Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.151489 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mvjdv" Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.160080 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:55.161261 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a027a9_d26f_4a2d_9a64_678ae697c38c.slice/crio-d8cf09c457d960b45de891bad717d0517a75bf748f3e54528979ab707ca0d5c9 WatchSource:0}: Error finding container d8cf09c457d960b45de891bad717d0517a75bf748f3e54528979ab707ca0d5c9: Status 404 returned error can't find the container with id d8cf09c457d960b45de891bad717d0517a75bf748f3e54528979ab707ca0d5c9 Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:55.170332 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded5152b9_b70b_4700_8845_415f3ea3a8a9.slice/crio-535bdc00092ce65ef5a94c2609196a511c5f530c605f0ccc3c84604ae617f9b4 WatchSource:0}: Error finding container 535bdc00092ce65ef5a94c2609196a511c5f530c605f0ccc3c84604ae617f9b4: Status 404 returned error can't find the container with id 535bdc00092ce65ef5a94c2609196a511c5f530c605f0ccc3c84604ae617f9b4 Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.177170 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-czfww" Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.180719 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qztnm" Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:55.184554 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500e596f_f9fe_4f18_8f18_72d71b2e68f1.slice/crio-489ccd3e1bacafa8709eb318f2a3025dc443ae6f06a553a37ede36adae573b9a WatchSource:0}: Error finding container 489ccd3e1bacafa8709eb318f2a3025dc443ae6f06a553a37ede36adae573b9a: Status 404 returned error can't find the container with id 489ccd3e1bacafa8709eb318f2a3025dc443ae6f06a553a37ede36adae573b9a Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.187885 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ndg9c" Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:55.191314 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3804496_d17a_4f8b_8193_76e79cfb59fd.slice/crio-5b9dfb6bb766c66a21d31cbadaaabe0e5830e8ec6ee8fcd52f5f89b9d12c4e84 WatchSource:0}: Error finding container 5b9dfb6bb766c66a21d31cbadaaabe0e5830e8ec6ee8fcd52f5f89b9d12c4e84: Status 404 returned error can't find the container with id 5b9dfb6bb766c66a21d31cbadaaabe0e5830e8ec6ee8fcd52f5f89b9d12c4e84 Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:55.197374 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb700d12b_d185_4399_8f57_3e8bc852eff2.slice/crio-bca48c0894c36cdaf9b21a3039d2ad2d02babce27cdd7b034954ec19f84de905 WatchSource:0}: Error finding container bca48c0894c36cdaf9b21a3039d2ad2d02babce27cdd7b034954ec19f84de905: Status 404 returned error can't find the container with id bca48c0894c36cdaf9b21a3039d2ad2d02babce27cdd7b034954ec19f84de905 Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.197981 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6m59g" Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.206698 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kcflq" Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:55.207384 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f084d1_05e4_486c_9220_9d855c890f80.slice/crio-15d31bcb6f0bf2ceb0b146a9f3bcace2eeec90fb0c507e10110865c5e7ec9104 WatchSource:0}: Error finding container 15d31bcb6f0bf2ceb0b146a9f3bcace2eeec90fb0c507e10110865c5e7ec9104: Status 404 returned error can't find the container with id 15d31bcb6f0bf2ceb0b146a9f3bcace2eeec90fb0c507e10110865c5e7ec9104 Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.213763 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bpnv" Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:55.216308 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9196c019_2ba1_4bd8_8d5a_f579b619f4eb.slice/crio-3585379ab01b547bb8c9d5ca5d3c841d51919eac00311ee3d5a9d67f416ce02f WatchSource:0}: Error finding container 3585379ab01b547bb8c9d5ca5d3c841d51919eac00311ee3d5a9d67f416ce02f: Status 404 returned error can't find the container with id 3585379ab01b547bb8c9d5ca5d3c841d51919eac00311ee3d5a9d67f416ce02f Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.219657 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:07:55.273513 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:55.223317 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29baf1ab_c0ed_4625_9a27_c00f9e281038.slice/crio-e23ff73c82f958216e2ccc8ce7afd8a99af6e8df5aad038a43e7f58ff80414d5 WatchSource:0}: Error finding container e23ff73c82f958216e2ccc8ce7afd8a99af6e8df5aad038a43e7f58ff80414d5: Status 404 returned error can't find the container with id e23ff73c82f958216e2ccc8ce7afd8a99af6e8df5aad038a43e7f58ff80414d5 Jul 15 12:07:55.276413 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:55.228102 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060bfdcc_ad52_4390_8054_d63a9b024e9c.slice/crio-ea1a0fad9394b2080d355a60e277ba770c55e36a17cd97cbf2ff33c178ed031e WatchSource:0}: Error finding container ea1a0fad9394b2080d355a60e277ba770c55e36a17cd97cbf2ff33c178ed031e: Status 404 returned error can't find the container with id ea1a0fad9394b2080d355a60e277ba770c55e36a17cd97cbf2ff33c178ed031e Jul 15 12:07:55.614221 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.564013 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:07:55.614221 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.564079 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs\") pod \"network-metrics-daemon-svjhf\" (UID: \"1ce43433-1205-4257-a355-91da9321806c\") " pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:07:55.614221 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.564169 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 12:07:55.614221 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.564213 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 12:07:55.614221 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.564239 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret podName:42e44198-430d-4a24-ac72-001f7fc4a7b1 nodeName:}" failed. No retries permitted until 2026-07-15 12:07:56.564223183 +0000 UTC m=+4.156629002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret") pod "global-pull-secret-syncer-bxd5k" (UID: "42e44198-430d-4a24-ac72-001f7fc4a7b1") : object "kube-system"/"original-pull-secret" not registered Jul 15 12:07:55.614221 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.564265 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs podName:1ce43433-1205-4257-a355-91da9321806c nodeName:}" failed. No retries permitted until 2026-07-15 12:07:56.564248036 +0000 UTC m=+4.156653854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs") pod "network-metrics-daemon-svjhf" (UID: "1ce43433-1205-4257-a355-91da9321806c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 12:07:55.774578 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.664938 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsw2h\" (UniqueName: \"kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h\") pod \"network-check-target-2jc9g\" (UID: \"4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f\") " pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:07:55.774578 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.665129 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 12:07:55.774578 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.665155 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 12:07:55.774578 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.665166 2582 projected.go:196] Error preparing data for projected volume kube-api-access-hsw2h for pod openshift-network-diagnostics/network-check-target-2jc9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 12:07:55.774578 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.665226 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h podName:4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f nodeName:}" failed. No retries permitted until 2026-07-15 12:07:56.665210615 +0000 UTC m=+4.257616454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hsw2h" (UniqueName: "kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h") pod "network-check-target-2jc9g" (UID: "4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 12:07:55.896002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.808345 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 12:07:56.007672 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.919560 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 12:02:55 +0000 UTC" deadline="2028-02-11 11:02:46.232868953 +0000 UTC" Jul 15 12:07:56.007672 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.919595 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13822h54m50.313277888s" Jul 15 12:07:56.007672 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.957100 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:07:56.007672 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:55.957216 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:07:56.007672 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.976356 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bpnv" event={"ID":"29baf1ab-c0ed-4625-9a27-c00f9e281038","Type":"ContainerStarted","Data":"e23ff73c82f958216e2ccc8ce7afd8a99af6e8df5aad038a43e7f58ff80414d5"} Jul 15 12:07:56.007672 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.977328 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kcflq" event={"ID":"9196c019-2ba1-4bd8-8d5a-f579b619f4eb","Type":"ContainerStarted","Data":"3585379ab01b547bb8c9d5ca5d3c841d51919eac00311ee3d5a9d67f416ce02f"} Jul 15 12:07:56.007672 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.978401 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6m59g" event={"ID":"03f084d1-05e4-486c-9220-9d855c890f80","Type":"ContainerStarted","Data":"15d31bcb6f0bf2ceb0b146a9f3bcace2eeec90fb0c507e10110865c5e7ec9104"} Jul 15 12:07:56.007672 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.979352 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ndg9c" event={"ID":"b700d12b-d185-4399-8f57-3e8bc852eff2","Type":"ContainerStarted","Data":"bca48c0894c36cdaf9b21a3039d2ad2d02babce27cdd7b034954ec19f84de905"} Jul 15 12:07:56.007672 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.980705 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-czfww" event={"ID":"500e596f-f9fe-4f18-8f18-72d71b2e68f1","Type":"ContainerStarted","Data":"489ccd3e1bacafa8709eb318f2a3025dc443ae6f06a553a37ede36adae573b9a"} Jul 15 12:07:56.007672 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.981958 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" event={"ID":"060bfdcc-ad52-4390-8054-d63a9b024e9c","Type":"ContainerStarted","Data":"ea1a0fad9394b2080d355a60e277ba770c55e36a17cd97cbf2ff33c178ed031e"} Jul 15 12:07:56.007672 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.983139 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qztnm" event={"ID":"c3804496-d17a-4f8b-8193-76e79cfb59fd","Type":"ContainerStarted","Data":"5b9dfb6bb766c66a21d31cbadaaabe0e5830e8ec6ee8fcd52f5f89b9d12c4e84"} Jul 15 12:07:56.007672 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.984223 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" event={"ID":"ed5152b9-b70b-4700-8845-415f3ea3a8a9","Type":"ContainerStarted","Data":"535bdc00092ce65ef5a94c2609196a511c5f530c605f0ccc3c84604ae617f9b4"} Jul 15 12:07:56.007672 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:55.985339 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvjdv" event={"ID":"11a027a9-d26f-4a2d-9a64-678ae697c38c","Type":"ContainerStarted","Data":"d8cf09c457d960b45de891bad717d0517a75bf748f3e54528979ab707ca0d5c9"} Jul 15 12:07:56.115399 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:07:56.115360 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3fc06b25f52ae8628a56f24a8ff34a0.slice/crio-46dec49a8b70b936095df5d66c29fe8cc1026181982d7c01d554eeba3524b620 WatchSource:0}: Error finding container 46dec49a8b70b936095df5d66c29fe8cc1026181982d7c01d554eeba3524b620: Status 404 returned error can't find the container with id 46dec49a8b70b936095df5d66c29fe8cc1026181982d7c01d554eeba3524b620 Jul 15 12:07:56.572637 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:56.572299 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:07:56.572637 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:56.572600 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 12:07:56.572901 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:56.572637 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs\") pod \"network-metrics-daemon-svjhf\" (UID: \"1ce43433-1205-4257-a355-91da9321806c\") " pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:07:56.572901 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:56.572697 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret podName:42e44198-430d-4a24-ac72-001f7fc4a7b1 nodeName:}" failed. No retries permitted until 2026-07-15 12:07:58.572675125 +0000 UTC m=+6.165080960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret") pod "global-pull-secret-syncer-bxd5k" (UID: "42e44198-430d-4a24-ac72-001f7fc4a7b1") : object "kube-system"/"original-pull-secret" not registered Jul 15 12:07:56.572901 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:56.572784 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 12:07:56.572901 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:56.572841 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs podName:1ce43433-1205-4257-a355-91da9321806c nodeName:}" failed. No retries permitted until 2026-07-15 12:07:58.572823373 +0000 UTC m=+6.165229194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs") pod "network-metrics-daemon-svjhf" (UID: "1ce43433-1205-4257-a355-91da9321806c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 12:07:56.673501 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:56.673458 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsw2h\" (UniqueName: \"kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h\") pod \"network-check-target-2jc9g\" (UID: \"4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f\") " pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:07:56.673738 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:56.673720 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 12:07:56.673807 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:56.673745 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 12:07:56.673807 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:56.673759 2582 projected.go:196] Error preparing data for projected volume kube-api-access-hsw2h for pod openshift-network-diagnostics/network-check-target-2jc9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 12:07:56.673923 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:56.673824 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h podName:4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f nodeName:}" failed. No retries permitted until 2026-07-15 12:07:58.673804641 +0000 UTC m=+6.266210461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hsw2h" (UniqueName: "kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h") pod "network-check-target-2jc9g" (UID: "4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 12:07:56.920120 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:56.920019 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 12:02:55 +0000 UTC" deadline="2028-01-18 14:31:13.148805979 +0000 UTC" Jul 15 12:07:56.920120 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:56.920063 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13250h23m16.228748965s" Jul 15 12:07:56.959856 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:56.959492 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:07:56.959856 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:56.959630 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:07:56.959856 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:56.959726 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:07:56.959856 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:56.959818 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:07:56.994229 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:56.994181 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" event={"ID":"b288c0263dd3bd9ee0a8c0f7dd2e8f04","Type":"ContainerStarted","Data":"7cc8b5b587dc40ccfe97a9e6c35912212b27551b3272091e5700897654340b2a"} Jul 15 12:07:57.006368 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:57.006328 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" event={"ID":"a3fc06b25f52ae8628a56f24a8ff34a0","Type":"ContainerStarted","Data":"46dec49a8b70b936095df5d66c29fe8cc1026181982d7c01d554eeba3524b620"} Jul 15 12:07:57.956985 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:57.956940 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:07:57.957437 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:57.957098 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:07:58.595407 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:58.595364 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs\") pod \"network-metrics-daemon-svjhf\" (UID: \"1ce43433-1205-4257-a355-91da9321806c\") " pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:07:58.595605 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:58.595460 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:07:58.595716 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:58.595610 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 12:07:58.595716 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:58.595694 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret podName:42e44198-430d-4a24-ac72-001f7fc4a7b1 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:02.59565789 +0000 UTC m=+10.188063710 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret") pod "global-pull-secret-syncer-bxd5k" (UID: "42e44198-430d-4a24-ac72-001f7fc4a7b1") : object "kube-system"/"original-pull-secret" not registered Jul 15 12:07:58.596143 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:58.596112 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 12:07:58.596249 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:58.596176 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs podName:1ce43433-1205-4257-a355-91da9321806c nodeName:}" failed. No retries permitted until 2026-07-15 12:08:02.596159684 +0000 UTC m=+10.188565501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs") pod "network-metrics-daemon-svjhf" (UID: "1ce43433-1205-4257-a355-91da9321806c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 12:07:58.696170 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:58.696126 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsw2h\" (UniqueName: \"kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h\") pod \"network-check-target-2jc9g\" (UID: \"4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f\") " pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:07:58.696387 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:58.696369 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 12:07:58.696457 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:58.696396 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 12:07:58.696457 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:58.696410 2582 projected.go:196] Error preparing data for projected volume kube-api-access-hsw2h for pod openshift-network-diagnostics/network-check-target-2jc9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 12:07:58.696582 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:58.696510 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h podName:4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f nodeName:}" failed. No retries permitted until 2026-07-15 12:08:02.6964891 +0000 UTC m=+10.288894923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hsw2h" (UniqueName: "kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h") pod "network-check-target-2jc9g" (UID: "4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 12:07:58.960295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:58.959387 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:07:58.960295 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:58.959530 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:07:58.960295 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:58.959975 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:07:58.960295 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:58.960072 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:07:59.957054 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:07:59.957019 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:07:59.957258 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:07:59.957163 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:00.957746 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:00.957289 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:00.957746 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:00.957431 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:00.958188 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:00.957927 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:00.958188 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:00.958039 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:01.957389 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:01.957281 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:01.957598 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:01.957439 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:02.632999 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:02.632956 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs\") pod \"network-metrics-daemon-svjhf\" (UID: \"1ce43433-1205-4257-a355-91da9321806c\") " pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:02.633572 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:02.633045 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:02.633572 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:02.633185 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 12:08:02.633572 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:02.633247 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret podName:42e44198-430d-4a24-ac72-001f7fc4a7b1 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:10.633228458 +0000 UTC m=+18.225634283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret") pod "global-pull-secret-syncer-bxd5k" (UID: "42e44198-430d-4a24-ac72-001f7fc4a7b1") : object "kube-system"/"original-pull-secret" not registered Jul 15 12:08:02.633572 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:02.633398 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 12:08:02.633572 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:02.633447 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs podName:1ce43433-1205-4257-a355-91da9321806c nodeName:}" failed. No retries permitted until 2026-07-15 12:08:10.63343265 +0000 UTC m=+18.225838473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs") pod "network-metrics-daemon-svjhf" (UID: "1ce43433-1205-4257-a355-91da9321806c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 12:08:02.734227 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:02.734186 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsw2h\" (UniqueName: \"kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h\") pod \"network-check-target-2jc9g\" (UID: \"4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f\") " pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:02.734404 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:02.734344 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 12:08:02.734404 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:02.734367 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 12:08:02.734404 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:02.734382 2582 projected.go:196] Error preparing data for projected volume kube-api-access-hsw2h for pod openshift-network-diagnostics/network-check-target-2jc9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 12:08:02.734587 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:02.734446 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h podName:4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f nodeName:}" failed. No retries permitted until 2026-07-15 12:08:10.734423425 +0000 UTC m=+18.326829245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hsw2h" (UniqueName: "kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h") pod "network-check-target-2jc9g" (UID: "4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 12:08:02.958033 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:02.957943 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:02.959239 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:02.959195 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:02.959373 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:02.959253 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:02.959416 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:02.959390 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:03.956621 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:03.956584 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:03.957129 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:03.956781 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:04.957087 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:04.957058 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:04.957600 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:04.957199 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:04.957600 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:04.957242 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:04.957600 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:04.957364 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:05.957239 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:05.957157 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:05.957694 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:05.957289 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:06.957263 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:06.957223 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:06.957690 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:06.957331 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:06.957690 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:06.957397 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:06.957690 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:06.957508 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:07.956753 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:07.956721 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:07.956915 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:07.956825 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:08.956864 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:08.956834 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:08.957252 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:08.956959 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:08.957252 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:08.956985 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:08.957252 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:08.957093 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:09.956517 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:09.956478 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:09.956744 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:09.956615 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:10.692760 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:10.692728 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:10.693175 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:10.692783 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs\") pod \"network-metrics-daemon-svjhf\" (UID: \"1ce43433-1205-4257-a355-91da9321806c\") " pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:10.693175 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:10.692905 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 12:08:10.693175 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:10.692943 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 12:08:10.693175 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:10.692972 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret podName:42e44198-430d-4a24-ac72-001f7fc4a7b1 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:26.69295329 +0000 UTC m=+34.285359106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret") pod "global-pull-secret-syncer-bxd5k" (UID: "42e44198-430d-4a24-ac72-001f7fc4a7b1") : object "kube-system"/"original-pull-secret" not registered Jul 15 12:08:10.693175 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:10.692996 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs podName:1ce43433-1205-4257-a355-91da9321806c nodeName:}" failed. No retries permitted until 2026-07-15 12:08:26.692981611 +0000 UTC m=+34.285387436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs") pod "network-metrics-daemon-svjhf" (UID: "1ce43433-1205-4257-a355-91da9321806c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 12:08:10.793350 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:10.793300 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsw2h\" (UniqueName: \"kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h\") pod \"network-check-target-2jc9g\" (UID: \"4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f\") " pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:10.793531 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:10.793494 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 12:08:10.793531 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:10.793524 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 12:08:10.793649 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:10.793540 2582 projected.go:196] Error preparing data for projected volume kube-api-access-hsw2h for pod openshift-network-diagnostics/network-check-target-2jc9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 12:08:10.793649 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:10.793598 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h podName:4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f nodeName:}" failed. No retries permitted until 2026-07-15 12:08:26.793581256 +0000 UTC m=+34.385987071 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hsw2h" (UniqueName: "kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h") pod "network-check-target-2jc9g" (UID: "4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 12:08:10.957204 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:10.957121 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:10.957351 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:10.957253 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:10.957351 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:10.957294 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:10.957470 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:10.957403 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:11.956533 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:11.956446 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:11.956960 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:11.956584 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:12.957623 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:12.957590 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:12.958058 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:12.957724 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:12.958058 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:12.957807 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:12.958058 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:12.957895 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:13.956286 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:13.956241 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:13.956487 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:13.956383 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:14.956727 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:14.956692 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:14.957243 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:14.956692 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:14.957243 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:14.956830 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:14.957243 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:14.956863 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:15.956266 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:15.956232 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:15.956430 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:15.956338 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:16.956834 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:16.956374 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:16.957484 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:16.956423 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:16.957484 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:16.956945 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:16.957484 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:16.956971 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:17.053403 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.053330 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bpnv" event={"ID":"29baf1ab-c0ed-4625-9a27-c00f9e281038","Type":"ContainerStarted","Data":"e85ee41387537dbedc92046da935e481fa4c9f8afe72daeac4fc44ad700cc8fe"} Jul 15 12:08:17.054722 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.054696 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kcflq" event={"ID":"9196c019-2ba1-4bd8-8d5a-f579b619f4eb","Type":"ContainerStarted","Data":"c844078468d1a94fd36ba18201e449da03637c592536a4773bf2cbfcf5ad6ca7"} Jul 15 12:08:17.056860 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.056377 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6m59g" event={"ID":"03f084d1-05e4-486c-9220-9d855c890f80","Type":"ContainerStarted","Data":"2b852b37111f9c694823fd6d8a1830f311875d8d829dda471a204aec0f3d79c6"} Jul 15 12:08:17.058736 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.058705 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-czfww" event={"ID":"500e596f-f9fe-4f18-8f18-72d71b2e68f1","Type":"ContainerStarted","Data":"ae86ed3583bd2045c2231ae7768336f2e4d39d69c15edc221afb23a77cc39326"} Jul 15 12:08:17.059974 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.059951 2582 generic.go:356] "Generic (PLEG): container finished" podID="a3fc06b25f52ae8628a56f24a8ff34a0" containerID="9229a7d722ecebff8940a4934f7be9de9e66add6ac06343be25236e680769f54" exitCode=0 Jul 15 12:08:17.060056 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.060024 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" event={"ID":"a3fc06b25f52ae8628a56f24a8ff34a0","Type":"ContainerDied","Data":"9229a7d722ecebff8940a4934f7be9de9e66add6ac06343be25236e680769f54"} Jul 15 12:08:17.062733 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.062717 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:08:17.063046 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.063026 2582 generic.go:356] "Generic (PLEG): container finished" podID="060bfdcc-ad52-4390-8054-d63a9b024e9c" containerID="8b0141d602e9a304b16a62c849520ed2e6db6dc75bfa4e778decc6849a44a0ca" exitCode=1 Jul 15 12:08:17.063116 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.063082 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" event={"ID":"060bfdcc-ad52-4390-8054-d63a9b024e9c","Type":"ContainerStarted","Data":"ef492dc6ce4d0491ceac7af142a9e268f63d83db87c8cf56f548f2fafc8b2170"} Jul 15 12:08:17.063161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.063136 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" event={"ID":"060bfdcc-ad52-4390-8054-d63a9b024e9c","Type":"ContainerStarted","Data":"2e4ab6f65a636c4f141db22703d4c237bb8df8a1d5aba0c784fc918e34447693"} Jul 15 12:08:17.063211 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.063174 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" event={"ID":"060bfdcc-ad52-4390-8054-d63a9b024e9c","Type":"ContainerStarted","Data":"a53fa6e4a3a6b85949ad35b9cd3c967adc31e506b85ced1d1e1a480cf98b16fc"} Jul 15 12:08:17.063249 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.063211 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" event={"ID":"060bfdcc-ad52-4390-8054-d63a9b024e9c","Type":"ContainerStarted","Data":"82a37e1e7dd5de066bbf0aaecf1e563963c33385e36d74b0c4b58ea40603276b"} Jul 15 12:08:17.063249 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.063241 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" event={"ID":"060bfdcc-ad52-4390-8054-d63a9b024e9c","Type":"ContainerDied","Data":"8b0141d602e9a304b16a62c849520ed2e6db6dc75bfa4e778decc6849a44a0ca"} Jul 15 12:08:17.063332 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.063274 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" event={"ID":"060bfdcc-ad52-4390-8054-d63a9b024e9c","Type":"ContainerStarted","Data":"5513f2757b1526dbb3260aeb8982a20a0ba48cf721d9cc6be8ef844a87930ebd"} Jul 15 12:08:17.064351 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.064334 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qztnm" event={"ID":"c3804496-d17a-4f8b-8193-76e79cfb59fd","Type":"ContainerStarted","Data":"537b5f940a20b9144f44fa334f49e13949b5582706d0387dc143a27eb1a80b81"} Jul 15 12:08:17.065813 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.065793 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" event={"ID":"ed5152b9-b70b-4700-8845-415f3ea3a8a9","Type":"ContainerStarted","Data":"d2c3499467b2fbd931b29f2cc0a4fbefe4d7ec7cf9bc24ed095961ee897adc2e"} Jul 15 12:08:17.067123 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.067104 2582 generic.go:356] "Generic (PLEG): container finished" podID="11a027a9-d26f-4a2d-9a64-678ae697c38c" containerID="d0494031e86d7c3e42456eb837769138e24f568b1e74c431e8cea02f178ff241" exitCode=0 Jul 15 12:08:17.067217 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.067128 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvjdv" event={"ID":"11a027a9-d26f-4a2d-9a64-678ae697c38c","Type":"ContainerDied","Data":"d0494031e86d7c3e42456eb837769138e24f568b1e74c431e8cea02f178ff241"} Jul 15 12:08:17.084936 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.084901 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-123.ec2.internal" podStartSLOduration=22.084872888 podStartE2EDuration="22.084872888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:07:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:07:57.020513681 +0000 UTC m=+4.612919523" watchObservedRunningTime="2026-07-15 12:08:17.084872888 +0000 UTC m=+24.677278709" Jul 15 12:08:17.117339 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.117296 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2bpnv" podStartSLOduration=2.286609006 podStartE2EDuration="23.117280518s" totalImagesPullingTime="20.830671512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:17.085428262 +0000 UTC m=+24.677834099" watchObservedRunningTime="2026-07-15 12:08:17.117280518 +0000 UTC m=+24.709686356" Jul 15 12:08:17.225391 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.225329 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qztnm" podStartSLOduration=2.414438012 podStartE2EDuration="23.225313259s" totalImagesPullingTime="20.810875247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:17.147732078 +0000 UTC m=+24.740137916" watchObservedRunningTime="2026-07-15 12:08:17.225313259 +0000 UTC m=+24.817719097" Jul 15 12:08:17.264993 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.264948 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6m59g" podStartSLOduration=6.792474704 podStartE2EDuration="23.264933094s" totalImagesPullingTime="16.47245839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:17.226283259 +0000 UTC m=+24.818689097" watchObservedRunningTime="2026-07-15 12:08:17.264933094 +0000 UTC m=+24.857338943" Jul 15 12:08:17.265356 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.265334 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kcflq" podStartSLOduration=2.478167904 podStartE2EDuration="23.265329015s" totalImagesPullingTime="20.787161111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:17.265071471 +0000 UTC m=+24.857477292" watchObservedRunningTime="2026-07-15 12:08:17.265329015 +0000 UTC m=+24.857734852" Jul 15 12:08:17.326932 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.326847 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-czfww" podStartSLOduration=3.506530354 podStartE2EDuration="24.326832452s" totalImagesPullingTime="20.820302098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:17.325484003 +0000 UTC m=+24.917889854" watchObservedRunningTime="2026-07-15 12:08:17.326832452 +0000 UTC m=+24.919238311" Jul 15 12:08:17.956893 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:17.956865 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:17.957416 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:17.957008 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:18.070597 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:18.070560 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ndg9c" event={"ID":"b700d12b-d185-4399-8f57-3e8bc852eff2","Type":"ContainerStarted","Data":"27a0f5a1c43e7e41ae66ba206ee329550162d954aa781abbab3577189b468691"} Jul 15 12:08:18.072760 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:18.072732 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" event={"ID":"a3fc06b25f52ae8628a56f24a8ff34a0","Type":"ContainerStarted","Data":"b754bdd69192eaf7cb56ca6d5ddab95cd0af8dd3af4b27520ef371ee24615670"} Jul 15 12:08:18.095002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:18.094944 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ndg9c" podStartSLOduration=3.287456524 podStartE2EDuration="24.094924295s" totalImagesPullingTime="20.807467771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:18.094355323 +0000 UTC m=+25.686761163" watchObservedRunningTime="2026-07-15 12:08:18.094924295 +0000 UTC m=+25.687330133" Jul 15 12:08:18.956835 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:18.956799 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:18.957029 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:18.956938 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:18.957029 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:18.956992 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:18.957489 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:18.957124 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:19.078946 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:19.078922 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:08:19.079480 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:19.079449 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" event={"ID":"060bfdcc-ad52-4390-8054-d63a9b024e9c","Type":"ContainerStarted","Data":"63a12948fc3a665043286289a7984e1507443b4628bb622e9aefb05f8abd2484"} Jul 15 12:08:19.334742 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:19.334717 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 12:08:19.924230 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:19.924111 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T12:08:19.334739991Z","UUID":"5f1d3167-9e14-4850-8730-344e10b676d0","Handler":null,"Name":"","Endpoint":""} Jul 15 12:08:19.925885 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:19.925864 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 12:08:19.926006 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:19.925905 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 12:08:19.956736 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:19.956553 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:19.956890 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:19.956839 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:20.084064 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:20.084022 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" event={"ID":"ed5152b9-b70b-4700-8845-415f3ea3a8a9","Type":"ContainerStarted","Data":"4bb4a457a518083663caac715d41dba9ee121a6d4e2572ac20de3823433d0508"} Jul 15 12:08:20.431751 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:20.431712 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6m59g" Jul 15 12:08:20.432489 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:20.432466 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6m59g" Jul 15 12:08:20.450647 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:20.450586 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-123.ec2.internal" podStartSLOduration=25.450571939 podStartE2EDuration="25.450571939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:07:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:18.138333309 +0000 UTC m=+25.730739149" watchObservedRunningTime="2026-07-15 12:08:20.450571939 +0000 UTC m=+28.042977780" Jul 15 12:08:20.957082 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:20.957052 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:20.957271 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:20.957175 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:20.957684 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:20.957663 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:20.957772 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:20.957749 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:21.956871 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:21.956657 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:21.957541 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:21.956919 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:22.091422 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:22.091406 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:08:22.091807 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:22.091783 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" event={"ID":"060bfdcc-ad52-4390-8054-d63a9b024e9c","Type":"ContainerStarted","Data":"19f40b4db30f42df2fdc8c23f9891a315859773974ea68c943ac881afb700c80"} Jul 15 12:08:22.093250 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:22.093230 2582 generic.go:356] "Generic (PLEG): container finished" podID="11a027a9-d26f-4a2d-9a64-678ae697c38c" containerID="b6c87571a7e88a7dffcb679217ba62ad6d67b479e83c8b4b653c0975fb936f36" exitCode=0 Jul 15 12:08:22.093342 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:22.093258 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvjdv" event={"ID":"11a027a9-d26f-4a2d-9a64-678ae697c38c","Type":"ContainerDied","Data":"b6c87571a7e88a7dffcb679217ba62ad6d67b479e83c8b4b653c0975fb936f36"} Jul 15 12:08:22.101970 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:22.101422 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:08:22.101970 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:22.101494 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:08:22.101970 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:22.101580 2582 scope.go:117] "RemoveContainer" containerID="8b0141d602e9a304b16a62c849520ed2e6db6dc75bfa4e778decc6849a44a0ca" Jul 15 12:08:22.118375 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:22.118342 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:08:22.958240 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:22.958206 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:22.958751 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:22.958366 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:22.958751 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:22.958505 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:22.958751 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:22.958588 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:23.099894 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.099865 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:08:23.100335 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.100308 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" event={"ID":"060bfdcc-ad52-4390-8054-d63a9b024e9c","Type":"ContainerStarted","Data":"bf6648414a0221329a53ccd9d9d61abcfe9d2938f2aa8ea4497b1a73f7cc1685"} Jul 15 12:08:23.100544 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.100509 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:08:23.105357 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.105332 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" event={"ID":"ed5152b9-b70b-4700-8845-415f3ea3a8a9","Type":"ContainerStarted","Data":"f9aa17e5b678181623c03c7968a470074ae6920ae18c9b7a80428c5d11ef39b7"} Jul 15 12:08:23.117681 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.117655 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:08:23.151841 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.151795 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" podStartSLOduration=8.306500429 podStartE2EDuration="29.151779402s" totalImagesPullingTime="20.845278973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:23.151346062 +0000 UTC m=+30.743751900" watchObservedRunningTime="2026-07-15 12:08:23.151779402 +0000 UTC m=+30.744185239" Jul 15 12:08:23.173262 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.173219 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lq58q" podStartSLOduration=3.720872622 podStartE2EDuration="30.173203889s" totalImagesPullingTime="26.452331267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:07:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:23.172998554 +0000 UTC m=+30.765404397" watchObservedRunningTime="2026-07-15 12:08:23.173203889 +0000 UTC m=+30.765609727" Jul 15 12:08:23.383166 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.383133 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6m59g" Jul 15 12:08:23.383320 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.383299 2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 15 12:08:23.383892 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.383868 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6m59g" Jul 15 12:08:23.637436 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.637363 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bxd5k"] Jul 15 12:08:23.637586 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.637485 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:23.637586 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:23.637571 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:23.639413 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.639390 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2jc9g"] Jul 15 12:08:23.639526 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.639489 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:23.639619 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:23.639587 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:23.640111 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.640087 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-svjhf"] Jul 15 12:08:23.640191 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:23.640184 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:23.640280 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:23.640258 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:24.110341 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:24.110256 2582 generic.go:356] "Generic (PLEG): container finished" podID="11a027a9-d26f-4a2d-9a64-678ae697c38c" containerID="ea0f142ad2c2f05f01d6e2197b3e48e5476c25d92cca9e50bef95480b635cf20" exitCode=0 Jul 15 12:08:24.110677 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:24.110347 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvjdv" event={"ID":"11a027a9-d26f-4a2d-9a64-678ae697c38c","Type":"ContainerDied","Data":"ea0f142ad2c2f05f01d6e2197b3e48e5476c25d92cca9e50bef95480b635cf20"} Jul 15 12:08:24.957343 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:24.957168 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:24.957513 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:24.957171 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:24.957513 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:24.957414 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:24.957513 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:24.957174 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:24.957513 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:24.957490 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:24.957727 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:24.957588 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:26.710926 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:26.710897 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:26.711414 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:26.710946 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs\") pod \"network-metrics-daemon-svjhf\" (UID: \"1ce43433-1205-4257-a355-91da9321806c\") " pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:26.711414 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:26.711044 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 12:08:26.711414 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:26.711101 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret podName:42e44198-430d-4a24-ac72-001f7fc4a7b1 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:58.711086929 +0000 UTC m=+66.303492748 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret") pod "global-pull-secret-syncer-bxd5k" (UID: "42e44198-430d-4a24-ac72-001f7fc4a7b1") : object "kube-system"/"original-pull-secret" not registered Jul 15 12:08:26.711414 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:26.711049 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 12:08:26.711414 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:26.711169 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs podName:1ce43433-1205-4257-a355-91da9321806c nodeName:}" failed. No retries permitted until 2026-07-15 12:08:58.71115804 +0000 UTC m=+66.303563855 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs") pod "network-metrics-daemon-svjhf" (UID: "1ce43433-1205-4257-a355-91da9321806c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 12:08:26.811530 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:26.811492 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsw2h\" (UniqueName: \"kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h\") pod \"network-check-target-2jc9g\" (UID: \"4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f\") " pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:26.811716 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:26.811670 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 12:08:26.811716 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:26.811696 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 12:08:26.811716 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:26.811705 2582 projected.go:196] Error preparing data for projected volume kube-api-access-hsw2h for pod openshift-network-diagnostics/network-check-target-2jc9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 12:08:26.811840 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:26.811756 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h podName:4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f nodeName:}" failed. No retries permitted until 2026-07-15 12:08:58.811743151 +0000 UTC m=+66.404148970 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hsw2h" (UniqueName: "kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h") pod "network-check-target-2jc9g" (UID: "4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 12:08:26.956254 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:26.956226 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:26.956430 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:26.956228 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:26.956430 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:26.956328 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svjhf" podUID="1ce43433-1205-4257-a355-91da9321806c" Jul 15 12:08:26.956430 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:26.956231 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:26.956430 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:26.956395 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxd5k" podUID="42e44198-430d-4a24-ac72-001f7fc4a7b1" Jul 15 12:08:26.956576 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:26.956453 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2jc9g" podUID="4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f" Jul 15 12:08:27.119303 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:27.119210 2582 generic.go:356] "Generic (PLEG): container finished" podID="11a027a9-d26f-4a2d-9a64-678ae697c38c" containerID="9b0f8b8f67e52832c4408115ee5bcdbba1e149b4e0a5de403656af87a53acb6b" exitCode=0 Jul 15 12:08:27.119303 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:27.119257 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvjdv" event={"ID":"11a027a9-d26f-4a2d-9a64-678ae697c38c","Type":"ContainerDied","Data":"9b0f8b8f67e52832c4408115ee5bcdbba1e149b4e0a5de403656af87a53acb6b"} Jul 15 12:08:28.682061 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.682030 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-123.ec2.internal" event="NodeReady" Jul 15 12:08:28.682448 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.682192 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 12:08:28.766615 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.766523 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v2dnj"] Jul 15 12:08:28.768588 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.768569 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:28.776758 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.776731 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hxm5v"] Jul 15 12:08:28.778528 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.778510 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hxm5v" Jul 15 12:08:28.787715 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.787691 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 12:08:28.792000 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.789183 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 12:08:28.792000 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.789267 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lwhrs\"" Jul 15 12:08:28.792000 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.789590 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 12:08:28.792000 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.789798 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cbvbt\"" Jul 15 12:08:28.792000 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.789818 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 12:08:28.792000 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.790464 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 12:08:28.797385 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.797363 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hxm5v"] Jul 15 12:08:28.799766 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.799747 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v2dnj"] Jul 15 12:08:28.926304 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.926270 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32167b6f-91e5-4e82-8d59-2384ae0fa7bf-cert\") pod \"ingress-canary-hxm5v\" (UID: \"32167b6f-91e5-4e82-8d59-2384ae0fa7bf\") " pod="openshift-ingress-canary/ingress-canary-hxm5v" Jul 15 12:08:28.926473 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.926344 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:28.926473 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.926411 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-tmp-dir\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:28.926473 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.926456 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5s69\" (UniqueName: \"kubernetes.io/projected/32167b6f-91e5-4e82-8d59-2384ae0fa7bf-kube-api-access-m5s69\") pod \"ingress-canary-hxm5v\" (UID: \"32167b6f-91e5-4e82-8d59-2384ae0fa7bf\") " pod="openshift-ingress-canary/ingress-canary-hxm5v" Jul 15 12:08:28.926679 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.926511 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-config-volume\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:28.926679 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.926562 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndn4n\" (UniqueName: \"kubernetes.io/projected/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-kube-api-access-ndn4n\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:28.956827 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.956798 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:28.957057 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.956798 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:28.957057 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.956797 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:28.961425 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.961402 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 12:08:28.961538 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.961455 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-674f4\"" Jul 15 12:08:28.961538 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.961489 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 12:08:28.961735 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.961718 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s8wbv\"" Jul 15 12:08:28.961842 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.961820 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 12:08:28.962470 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:28.962452 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 12:08:29.027955 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:29.027872 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32167b6f-91e5-4e82-8d59-2384ae0fa7bf-cert\") pod \"ingress-canary-hxm5v\" (UID: \"32167b6f-91e5-4e82-8d59-2384ae0fa7bf\") " pod="openshift-ingress-canary/ingress-canary-hxm5v" Jul 15 12:08:29.028111 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:29.027964 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:29.028111 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:29.027992 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-tmp-dir\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:29.028111 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:29.028016 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5s69\" (UniqueName: \"kubernetes.io/projected/32167b6f-91e5-4e82-8d59-2384ae0fa7bf-kube-api-access-m5s69\") pod \"ingress-canary-hxm5v\" (UID: \"32167b6f-91e5-4e82-8d59-2384ae0fa7bf\") " pod="openshift-ingress-canary/ingress-canary-hxm5v" Jul 15 12:08:29.028111 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:29.028089 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-config-volume\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:29.028294 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:29.028134 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndn4n\" (UniqueName: \"kubernetes.io/projected/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-kube-api-access-ndn4n\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:29.028347 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:29.028325 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 12:08:29.028397 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:29.028345 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-tmp-dir\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:29.028397 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:29.028389 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls podName:95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef nodeName:}" failed. No retries permitted until 2026-07-15 12:08:29.528369028 +0000 UTC m=+37.120774861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls") pod "dns-default-v2dnj" (UID: "95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef") : secret "dns-default-metrics-tls" not found Jul 15 12:08:29.028764 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:29.028744 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-config-volume\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:29.033326 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:29.033307 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32167b6f-91e5-4e82-8d59-2384ae0fa7bf-cert\") pod \"ingress-canary-hxm5v\" (UID: \"32167b6f-91e5-4e82-8d59-2384ae0fa7bf\") " pod="openshift-ingress-canary/ingress-canary-hxm5v" Jul 15 12:08:29.039667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:29.039620 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5s69\" (UniqueName: \"kubernetes.io/projected/32167b6f-91e5-4e82-8d59-2384ae0fa7bf-kube-api-access-m5s69\") pod \"ingress-canary-hxm5v\" (UID: \"32167b6f-91e5-4e82-8d59-2384ae0fa7bf\") " pod="openshift-ingress-canary/ingress-canary-hxm5v" Jul 15 12:08:29.039667 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:29.039625 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndn4n\" (UniqueName: \"kubernetes.io/projected/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-kube-api-access-ndn4n\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:29.087626 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:29.087595 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hxm5v" Jul 15 12:08:29.241536 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:29.241293 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hxm5v"] Jul 15 12:08:29.245040 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:08:29.245015 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32167b6f_91e5_4e82_8d59_2384ae0fa7bf.slice/crio-250b1e98e0ffd93c2f91708b2073079db98d1596cd1804350cfadf2acda5c6f3 WatchSource:0}: Error finding container 250b1e98e0ffd93c2f91708b2073079db98d1596cd1804350cfadf2acda5c6f3: Status 404 returned error can't find the container with id 250b1e98e0ffd93c2f91708b2073079db98d1596cd1804350cfadf2acda5c6f3 Jul 15 12:08:29.532601 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:29.532551 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:29.532795 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:29.532710 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 12:08:29.532795 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:29.532777 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls podName:95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef nodeName:}" failed. No retries permitted until 2026-07-15 12:08:30.532755905 +0000 UTC m=+38.125161741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls") pod "dns-default-v2dnj" (UID: "95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef") : secret "dns-default-metrics-tls" not found Jul 15 12:08:30.128126 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:30.128081 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hxm5v" event={"ID":"32167b6f-91e5-4e82-8d59-2384ae0fa7bf","Type":"ContainerStarted","Data":"250b1e98e0ffd93c2f91708b2073079db98d1596cd1804350cfadf2acda5c6f3"} Jul 15 12:08:30.539995 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:30.539954 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:30.540190 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:30.540118 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 12:08:30.540258 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:30.540195 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls podName:95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef nodeName:}" failed. No retries permitted until 2026-07-15 12:08:32.540177042 +0000 UTC m=+40.132582878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls") pod "dns-default-v2dnj" (UID: "95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef") : secret "dns-default-metrics-tls" not found Jul 15 12:08:31.134049 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:31.134013 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvjdv" event={"ID":"11a027a9-d26f-4a2d-9a64-678ae697c38c","Type":"ContainerStarted","Data":"21ff26c978eaba6d20addcb9c018fbdb28e3ce302720a955662669466532b552"} Jul 15 12:08:32.142257 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:32.142218 2582 generic.go:356] "Generic (PLEG): container finished" podID="11a027a9-d26f-4a2d-9a64-678ae697c38c" containerID="21ff26c978eaba6d20addcb9c018fbdb28e3ce302720a955662669466532b552" exitCode=0 Jul 15 12:08:32.142735 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:32.142270 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvjdv" event={"ID":"11a027a9-d26f-4a2d-9a64-678ae697c38c","Type":"ContainerDied","Data":"21ff26c978eaba6d20addcb9c018fbdb28e3ce302720a955662669466532b552"} Jul 15 12:08:32.554259 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:32.554220 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:32.554419 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:32.554388 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 12:08:32.554486 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:32.554465 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls podName:95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef nodeName:}" failed. No retries permitted until 2026-07-15 12:08:36.55444726 +0000 UTC m=+44.146853078 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls") pod "dns-default-v2dnj" (UID: "95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef") : secret "dns-default-metrics-tls" not found Jul 15 12:08:33.148244 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:33.148046 2582 generic.go:356] "Generic (PLEG): container finished" podID="11a027a9-d26f-4a2d-9a64-678ae697c38c" containerID="52207bbbc2160f184b9da2732473d82cb085655016092f35bb9c6961c4365531" exitCode=0 Jul 15 12:08:33.148677 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:33.148096 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvjdv" event={"ID":"11a027a9-d26f-4a2d-9a64-678ae697c38c","Type":"ContainerDied","Data":"52207bbbc2160f184b9da2732473d82cb085655016092f35bb9c6961c4365531"} Jul 15 12:08:34.153059 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:34.152988 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mvjdv" event={"ID":"11a027a9-d26f-4a2d-9a64-678ae697c38c","Type":"ContainerStarted","Data":"fb27aa9f5f4c52b178ba333b68f33223b6d607b96f0a70c1436795531d190b36"} Jul 15 12:08:34.184727 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:34.184681 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mvjdv" podStartSLOduration=8.890812884 podStartE2EDuration="41.184663146s" totalImagesPullingTime="32.293850262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:07:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:34.183261796 +0000 UTC m=+41.775667645" watchObservedRunningTime="2026-07-15 12:08:34.184663146 +0000 UTC m=+41.777068985" Jul 15 12:08:35.156390 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.156348 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hxm5v" event={"ID":"32167b6f-91e5-4e82-8d59-2384ae0fa7bf","Type":"ContainerStarted","Data":"2164b787f4603e5a765b8379cffe8d09520a1c1f8cd0139166a44b852301d34f"} Jul 15 12:08:35.193673 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.193583 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hxm5v" podStartSLOduration=2.093104106 podStartE2EDuration="7.193566786s" totalImagesPullingTime="5.10046268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:35.193201797 +0000 UTC m=+42.785607635" watchObservedRunningTime="2026-07-15 12:08:35.193566786 +0000 UTC m=+42.785972624" Jul 15 12:08:35.751794 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.751763 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j"] Jul 15 12:08:35.775578 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.775551 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-2gvf2"] Jul 15 12:08:35.775734 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.775686 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:08:35.778588 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.778563 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 12:08:35.778751 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.778728 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 12:08:35.780156 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.780142 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8l79x\"" Jul 15 12:08:35.780233 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.780159 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 12:08:35.780233 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.780180 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 12:08:35.789732 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.789712 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j"] Jul 15 12:08:35.789824 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.789746 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-2gvf2"] Jul 15 12:08:35.789862 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.789820 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:35.793092 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.793076 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 15 12:08:35.793498 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.793481 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 12:08:35.793748 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.793729 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fl77n\"" Jul 15 12:08:35.793813 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.793729 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 12:08:35.794087 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.794071 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 15 12:08:35.798929 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.798912 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 15 12:08:35.850092 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.850067 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56"] Jul 15 12:08:35.873876 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.873854 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:08:35.873994 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.873942 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:08:35.873994 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.873965 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6gjx\" (UniqueName: \"kubernetes.io/projected/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-kube-api-access-w6gjx\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:08:35.875664 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.875626 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526"] Jul 15 12:08:35.875770 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.875737 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" Jul 15 12:08:35.878756 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.878737 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 12:08:35.878869 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.878736 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 12:08:35.879344 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.879161 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 12:08:35.879444 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.879422 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 12:08:35.879725 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.879711 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nxkxl\"" Jul 15 12:08:35.891907 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.891890 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ksf4f"] Jul 15 12:08:35.892005 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.891991 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" Jul 15 12:08:35.896864 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.896403 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 12:08:35.896864 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.896429 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 12:08:35.896864 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.896684 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 12:08:35.896864 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.896733 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vssfn\"" Jul 15 12:08:35.908935 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.908917 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-5ksnl"] Jul 15 12:08:35.909031 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.909017 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ksf4f" Jul 15 12:08:35.911978 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.911962 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 12:08:35.912147 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.912130 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 12:08:35.912537 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.912524 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rz5bp\"" Jul 15 12:08:35.930987 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.930968 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56"] Jul 15 12:08:35.931062 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.930993 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ksf4f"] Jul 15 12:08:35.931062 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.931007 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526"] Jul 15 12:08:35.931062 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.931023 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-5ksnl"] Jul 15 12:08:35.931154 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.931086 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:35.933871 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.933851 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 12:08:35.934033 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.933851 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6scvr\"" Jul 15 12:08:35.934033 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.933853 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 12:08:35.934033 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.933966 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 12:08:35.934178 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.934052 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 12:08:35.939556 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.939540 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 12:08:35.974816 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.974797 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f420c45-dc1b-40f1-a7e0-cad33cc07830-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7xp56\" (UID: \"9f420c45-dc1b-40f1-a7e0-cad33cc07830\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" Jul 15 12:08:35.974908 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.974822 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc605393-5c17-4177-854e-d923b106ab9a-tmp\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:35.974908 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.974839 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f420c45-dc1b-40f1-a7e0-cad33cc07830-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7xp56\" (UID: \"9f420c45-dc1b-40f1-a7e0-cad33cc07830\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" Jul 15 12:08:35.974908 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.974858 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc605393-5c17-4177-854e-d923b106ab9a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:35.974908 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.974880 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:08:35.974908 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.974896 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc605393-5c17-4177-854e-d923b106ab9a-serving-cert\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:35.975105 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.974944 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6gjx\" (UniqueName: \"kubernetes.io/projected/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-kube-api-access-w6gjx\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:08:35.975105 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:35.974957 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 12:08:35.975105 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.974983 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:08:35.975105 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:35.975002 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls podName:ddd1a92b-63cc-4715-bb60-a75c45c5cb14 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:36.474989127 +0000 UTC m=+44.067394945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qhn9j" (UID: "ddd1a92b-63cc-4715-bb60-a75c45c5cb14") : secret "cluster-monitoring-operator-tls" not found Jul 15 12:08:35.975105 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.975023 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc605393-5c17-4177-854e-d923b106ab9a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:35.975328 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.975131 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjj2p\" (UniqueName: \"kubernetes.io/projected/dc605393-5c17-4177-854e-d923b106ab9a-kube-api-access-hjj2p\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:35.975328 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.975183 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dc605393-5c17-4177-854e-d923b106ab9a-snapshots\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:35.975328 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.975202 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbtcx\" (UniqueName: \"kubernetes.io/projected/9f420c45-dc1b-40f1-a7e0-cad33cc07830-kube-api-access-tbtcx\") pod \"kube-storage-version-migrator-operator-799cb7f958-7xp56\" (UID: \"9f420c45-dc1b-40f1-a7e0-cad33cc07830\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" Jul 15 12:08:35.975525 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.975510 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:08:35.987348 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:35.987325 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6gjx\" (UniqueName: \"kubernetes.io/projected/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-kube-api-access-w6gjx\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:08:36.076080 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076025 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc605393-5c17-4177-854e-d923b106ab9a-serving-cert\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:36.076080 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076059 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6e9881e-09a6-46b6-99c1-2a970d1d9d1d-config\") pod \"console-operator-7866497494-5ksnl\" (UID: \"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d\") " pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:36.076198 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076083 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e9881e-09a6-46b6-99c1-2a970d1d9d1d-serving-cert\") pod \"console-operator-7866497494-5ksnl\" (UID: \"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d\") " pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:36.076198 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076149 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc605393-5c17-4177-854e-d923b106ab9a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:36.076198 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076184 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wn526\" (UID: \"f3c0aa44-c433-4fcd-93d3-aaf364ff2494\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" Jul 15 12:08:36.076340 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076209 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjj2p\" (UniqueName: \"kubernetes.io/projected/dc605393-5c17-4177-854e-d923b106ab9a-kube-api-access-hjj2p\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:36.076340 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076226 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqw8z\" (UniqueName: \"kubernetes.io/projected/a6e9881e-09a6-46b6-99c1-2a970d1d9d1d-kube-api-access-kqw8z\") pod \"console-operator-7866497494-5ksnl\" (UID: \"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d\") " pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:36.076340 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076262 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwz52\" (UniqueName: \"kubernetes.io/projected/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-kube-api-access-jwz52\") pod \"cluster-samples-operator-65db858894-wn526\" (UID: \"f3c0aa44-c433-4fcd-93d3-aaf364ff2494\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" Jul 15 12:08:36.076340 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076319 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dc605393-5c17-4177-854e-d923b106ab9a-snapshots\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:36.076533 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076451 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbtcx\" (UniqueName: \"kubernetes.io/projected/9f420c45-dc1b-40f1-a7e0-cad33cc07830-kube-api-access-tbtcx\") pod \"kube-storage-version-migrator-operator-799cb7f958-7xp56\" (UID: \"9f420c45-dc1b-40f1-a7e0-cad33cc07830\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" Jul 15 12:08:36.076533 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076521 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f420c45-dc1b-40f1-a7e0-cad33cc07830-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7xp56\" (UID: \"9f420c45-dc1b-40f1-a7e0-cad33cc07830\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" Jul 15 12:08:36.076624 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076556 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc605393-5c17-4177-854e-d923b106ab9a-tmp\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:36.076624 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076585 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f420c45-dc1b-40f1-a7e0-cad33cc07830-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7xp56\" (UID: \"9f420c45-dc1b-40f1-a7e0-cad33cc07830\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" Jul 15 12:08:36.076624 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076618 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kffbb\" (UniqueName: \"kubernetes.io/projected/a93d7e61-ee61-402a-b5b3-c0ebae7f0699-kube-api-access-kffbb\") pod \"volume-data-source-validator-78495597f6-ksf4f\" (UID: \"a93d7e61-ee61-402a-b5b3-c0ebae7f0699\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ksf4f" Jul 15 12:08:36.076786 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076665 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6e9881e-09a6-46b6-99c1-2a970d1d9d1d-trusted-ca\") pod \"console-operator-7866497494-5ksnl\" (UID: \"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d\") " pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:36.076786 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.076699 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc605393-5c17-4177-854e-d923b106ab9a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:36.077096 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.077069 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc605393-5c17-4177-854e-d923b106ab9a-tmp\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:36.077096 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.077084 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dc605393-5c17-4177-854e-d923b106ab9a-snapshots\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:36.077220 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.077208 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc605393-5c17-4177-854e-d923b106ab9a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:36.077298 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.077276 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f420c45-dc1b-40f1-a7e0-cad33cc07830-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7xp56\" (UID: \"9f420c45-dc1b-40f1-a7e0-cad33cc07830\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" Jul 15 12:08:36.077702 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.077682 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc605393-5c17-4177-854e-d923b106ab9a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:36.078361 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.078341 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc605393-5c17-4177-854e-d923b106ab9a-serving-cert\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:36.078932 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.078913 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f420c45-dc1b-40f1-a7e0-cad33cc07830-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7xp56\" (UID: \"9f420c45-dc1b-40f1-a7e0-cad33cc07830\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" Jul 15 12:08:36.088684 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.088658 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjj2p\" (UniqueName: \"kubernetes.io/projected/dc605393-5c17-4177-854e-d923b106ab9a-kube-api-access-hjj2p\") pod \"insights-operator-68d9dd94cf-2gvf2\" (UID: \"dc605393-5c17-4177-854e-d923b106ab9a\") " pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:36.088802 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.088787 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbtcx\" (UniqueName: \"kubernetes.io/projected/9f420c45-dc1b-40f1-a7e0-cad33cc07830-kube-api-access-tbtcx\") pod \"kube-storage-version-migrator-operator-799cb7f958-7xp56\" (UID: \"9f420c45-dc1b-40f1-a7e0-cad33cc07830\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" Jul 15 12:08:36.097507 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.097490 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" Jul 15 12:08:36.177252 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.177221 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kffbb\" (UniqueName: \"kubernetes.io/projected/a93d7e61-ee61-402a-b5b3-c0ebae7f0699-kube-api-access-kffbb\") pod \"volume-data-source-validator-78495597f6-ksf4f\" (UID: \"a93d7e61-ee61-402a-b5b3-c0ebae7f0699\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ksf4f" Jul 15 12:08:36.177659 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.177255 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6e9881e-09a6-46b6-99c1-2a970d1d9d1d-trusted-ca\") pod \"console-operator-7866497494-5ksnl\" (UID: \"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d\") " pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:36.177659 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.177510 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6e9881e-09a6-46b6-99c1-2a970d1d9d1d-config\") pod \"console-operator-7866497494-5ksnl\" (UID: \"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d\") " pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:36.177659 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.177560 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e9881e-09a6-46b6-99c1-2a970d1d9d1d-serving-cert\") pod \"console-operator-7866497494-5ksnl\" (UID: \"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d\") " pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:36.177828 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.177688 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wn526\" (UID: \"f3c0aa44-c433-4fcd-93d3-aaf364ff2494\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" Jul 15 12:08:36.177828 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.177724 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqw8z\" (UniqueName: \"kubernetes.io/projected/a6e9881e-09a6-46b6-99c1-2a970d1d9d1d-kube-api-access-kqw8z\") pod \"console-operator-7866497494-5ksnl\" (UID: \"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d\") " pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:36.177828 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.177752 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwz52\" (UniqueName: \"kubernetes.io/projected/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-kube-api-access-jwz52\") pod \"cluster-samples-operator-65db858894-wn526\" (UID: \"f3c0aa44-c433-4fcd-93d3-aaf364ff2494\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" Jul 15 12:08:36.178412 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.178388 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6e9881e-09a6-46b6-99c1-2a970d1d9d1d-trusted-ca\") pod \"console-operator-7866497494-5ksnl\" (UID: \"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d\") " pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:36.178524 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:36.178500 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 12:08:36.178576 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:36.178566 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls podName:f3c0aa44-c433-4fcd-93d3-aaf364ff2494 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:36.678549514 +0000 UTC m=+44.270955347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls") pod "cluster-samples-operator-65db858894-wn526" (UID: "f3c0aa44-c433-4fcd-93d3-aaf364ff2494") : secret "samples-operator-tls" not found Jul 15 12:08:36.178743 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.178711 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6e9881e-09a6-46b6-99c1-2a970d1d9d1d-config\") pod \"console-operator-7866497494-5ksnl\" (UID: \"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d\") " pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:36.180897 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.180874 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6e9881e-09a6-46b6-99c1-2a970d1d9d1d-serving-cert\") pod \"console-operator-7866497494-5ksnl\" (UID: \"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d\") " pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:36.187716 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.187459 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwz52\" (UniqueName: \"kubernetes.io/projected/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-kube-api-access-jwz52\") pod \"cluster-samples-operator-65db858894-wn526\" (UID: \"f3c0aa44-c433-4fcd-93d3-aaf364ff2494\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" Jul 15 12:08:36.188164 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.188141 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" Jul 15 12:08:36.188864 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.188832 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kffbb\" (UniqueName: \"kubernetes.io/projected/a93d7e61-ee61-402a-b5b3-c0ebae7f0699-kube-api-access-kffbb\") pod \"volume-data-source-validator-78495597f6-ksf4f\" (UID: \"a93d7e61-ee61-402a-b5b3-c0ebae7f0699\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ksf4f" Jul 15 12:08:36.193190 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.193156 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqw8z\" (UniqueName: \"kubernetes.io/projected/a6e9881e-09a6-46b6-99c1-2a970d1d9d1d-kube-api-access-kqw8z\") pod \"console-operator-7866497494-5ksnl\" (UID: \"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d\") " pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:36.217288 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.217267 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ksf4f" Jul 15 12:08:36.238994 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.238968 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:36.254159 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.254131 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-2gvf2"] Jul 15 12:08:36.258244 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:08:36.258216 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc605393_5c17_4177_854e_d923b106ab9a.slice/crio-3e39a798bf29ff345035be4e36f610143672888331bf9d14b0cea3808ca5f3fe WatchSource:0}: Error finding container 3e39a798bf29ff345035be4e36f610143672888331bf9d14b0cea3808ca5f3fe: Status 404 returned error can't find the container with id 3e39a798bf29ff345035be4e36f610143672888331bf9d14b0cea3808ca5f3fe Jul 15 12:08:36.354998 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.350980 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56"] Jul 15 12:08:36.354998 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:08:36.354726 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f420c45_dc1b_40f1_a7e0_cad33cc07830.slice/crio-d7bff9bb9168df5dae3b387a880cf459980ce481777df6417cf9cb8257b811c8 WatchSource:0}: Error finding container d7bff9bb9168df5dae3b387a880cf459980ce481777df6417cf9cb8257b811c8: Status 404 returned error can't find the container with id d7bff9bb9168df5dae3b387a880cf459980ce481777df6417cf9cb8257b811c8 Jul 15 12:08:36.416315 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.416286 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ksf4f"] Jul 15 12:08:36.420306 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:08:36.420281 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93d7e61_ee61_402a_b5b3_c0ebae7f0699.slice/crio-c435f0454c4ce76410198e70dcc7d86647123e29cfa3f5619c4fbe5db190d1ff WatchSource:0}: Error finding container c435f0454c4ce76410198e70dcc7d86647123e29cfa3f5619c4fbe5db190d1ff: Status 404 returned error can't find the container with id c435f0454c4ce76410198e70dcc7d86647123e29cfa3f5619c4fbe5db190d1ff Jul 15 12:08:36.434126 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.434102 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-5ksnl"] Jul 15 12:08:36.450336 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:08:36.450311 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e9881e_09a6_46b6_99c1_2a970d1d9d1d.slice/crio-2d27266cebca38622138535f35158ce35aa2df3537f3a0b5314a5e555f653d73 WatchSource:0}: Error finding container 2d27266cebca38622138535f35158ce35aa2df3537f3a0b5314a5e555f653d73: Status 404 returned error can't find the container with id 2d27266cebca38622138535f35158ce35aa2df3537f3a0b5314a5e555f653d73 Jul 15 12:08:36.480503 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.480476 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:08:36.480607 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:36.480594 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 12:08:36.480665 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:36.480660 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls podName:ddd1a92b-63cc-4715-bb60-a75c45c5cb14 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:37.480627412 +0000 UTC m=+45.073033228 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qhn9j" (UID: "ddd1a92b-63cc-4715-bb60-a75c45c5cb14") : secret "cluster-monitoring-operator-tls" not found Jul 15 12:08:36.581055 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.581030 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:36.581157 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:36.581142 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 12:08:36.581193 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:36.581188 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls podName:95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef nodeName:}" failed. No retries permitted until 2026-07-15 12:08:44.581173775 +0000 UTC m=+52.173579590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls") pod "dns-default-v2dnj" (UID: "95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef") : secret "dns-default-metrics-tls" not found Jul 15 12:08:36.681376 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:36.681351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wn526\" (UID: \"f3c0aa44-c433-4fcd-93d3-aaf364ff2494\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" Jul 15 12:08:36.681517 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:36.681498 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 12:08:36.681595 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:36.681586 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls podName:f3c0aa44-c433-4fcd-93d3-aaf364ff2494 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:37.68157157 +0000 UTC m=+45.273977386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls") pod "cluster-samples-operator-65db858894-wn526" (UID: "f3c0aa44-c433-4fcd-93d3-aaf364ff2494") : secret "samples-operator-tls" not found Jul 15 12:08:37.161575 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.161497 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5ksnl" event={"ID":"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d","Type":"ContainerStarted","Data":"2d27266cebca38622138535f35158ce35aa2df3537f3a0b5314a5e555f653d73"} Jul 15 12:08:37.162604 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.162554 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ksf4f" event={"ID":"a93d7e61-ee61-402a-b5b3-c0ebae7f0699","Type":"ContainerStarted","Data":"c435f0454c4ce76410198e70dcc7d86647123e29cfa3f5619c4fbe5db190d1ff"} Jul 15 12:08:37.163544 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.163521 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" event={"ID":"dc605393-5c17-4177-854e-d923b106ab9a","Type":"ContainerStarted","Data":"3e39a798bf29ff345035be4e36f610143672888331bf9d14b0cea3808ca5f3fe"} Jul 15 12:08:37.164438 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.164422 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" event={"ID":"9f420c45-dc1b-40f1-a7e0-cad33cc07830","Type":"ContainerStarted","Data":"d7bff9bb9168df5dae3b387a880cf459980ce481777df6417cf9cb8257b811c8"} Jul 15 12:08:37.487594 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.487547 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:08:37.488078 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:37.487691 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 12:08:37.488078 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:37.487766 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls podName:ddd1a92b-63cc-4715-bb60-a75c45c5cb14 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:39.487747886 +0000 UTC m=+47.080153722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qhn9j" (UID: "ddd1a92b-63cc-4715-bb60-a75c45c5cb14") : secret "cluster-monitoring-operator-tls" not found Jul 15 12:08:37.689934 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.689899 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wn526\" (UID: \"f3c0aa44-c433-4fcd-93d3-aaf364ff2494\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" Jul 15 12:08:37.690092 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:37.690014 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 12:08:37.690092 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:37.690077 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls podName:f3c0aa44-c433-4fcd-93d3-aaf364ff2494 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:39.690061463 +0000 UTC m=+47.282467283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls") pod "cluster-samples-operator-65db858894-wn526" (UID: "f3c0aa44-c433-4fcd-93d3-aaf364ff2494") : secret "samples-operator-tls" not found Jul 15 12:08:37.746994 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.746914 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm"] Jul 15 12:08:37.765240 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.765214 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm"] Jul 15 12:08:37.765382 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.765317 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" Jul 15 12:08:37.768296 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.768273 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 12:08:37.769388 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.769368 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 12:08:37.769776 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.769760 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 12:08:37.769880 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.769818 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 12:08:37.769880 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.769827 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gbqn2\"" Jul 15 12:08:37.891470 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.891437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrrgz\" (UniqueName: \"kubernetes.io/projected/2692b058-3858-44dd-9b73-6ebfc1b32004-kube-api-access-xrrgz\") pod \"service-ca-operator-7695fc6c8c-wspwm\" (UID: \"2692b058-3858-44dd-9b73-6ebfc1b32004\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" Jul 15 12:08:37.891659 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.891493 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2692b058-3858-44dd-9b73-6ebfc1b32004-serving-cert\") pod \"service-ca-operator-7695fc6c8c-wspwm\" (UID: \"2692b058-3858-44dd-9b73-6ebfc1b32004\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" Jul 15 12:08:37.891659 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.891614 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2692b058-3858-44dd-9b73-6ebfc1b32004-config\") pod \"service-ca-operator-7695fc6c8c-wspwm\" (UID: \"2692b058-3858-44dd-9b73-6ebfc1b32004\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" Jul 15 12:08:37.992883 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.992847 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrrgz\" (UniqueName: \"kubernetes.io/projected/2692b058-3858-44dd-9b73-6ebfc1b32004-kube-api-access-xrrgz\") pod \"service-ca-operator-7695fc6c8c-wspwm\" (UID: \"2692b058-3858-44dd-9b73-6ebfc1b32004\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" Jul 15 12:08:37.993102 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.992893 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2692b058-3858-44dd-9b73-6ebfc1b32004-serving-cert\") pod \"service-ca-operator-7695fc6c8c-wspwm\" (UID: \"2692b058-3858-44dd-9b73-6ebfc1b32004\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" Jul 15 12:08:37.993102 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.993083 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2692b058-3858-44dd-9b73-6ebfc1b32004-config\") pod \"service-ca-operator-7695fc6c8c-wspwm\" (UID: \"2692b058-3858-44dd-9b73-6ebfc1b32004\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" Jul 15 12:08:37.993588 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.993566 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2692b058-3858-44dd-9b73-6ebfc1b32004-config\") pod \"service-ca-operator-7695fc6c8c-wspwm\" (UID: \"2692b058-3858-44dd-9b73-6ebfc1b32004\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" Jul 15 12:08:37.995038 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:37.995022 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2692b058-3858-44dd-9b73-6ebfc1b32004-serving-cert\") pod \"service-ca-operator-7695fc6c8c-wspwm\" (UID: \"2692b058-3858-44dd-9b73-6ebfc1b32004\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" Jul 15 12:08:38.003147 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:38.003100 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrrgz\" (UniqueName: \"kubernetes.io/projected/2692b058-3858-44dd-9b73-6ebfc1b32004-kube-api-access-xrrgz\") pod \"service-ca-operator-7695fc6c8c-wspwm\" (UID: \"2692b058-3858-44dd-9b73-6ebfc1b32004\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" Jul 15 12:08:38.076116 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:38.076081 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" Jul 15 12:08:38.239606 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:38.239530 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm"] Jul 15 12:08:38.243453 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:08:38.243425 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2692b058_3858_44dd_9b73_6ebfc1b32004.slice/crio-89ce5eba6938f147b575c34090238264db15ddd24629458cf015f865f4411bc7 WatchSource:0}: Error finding container 89ce5eba6938f147b575c34090238264db15ddd24629458cf015f865f4411bc7: Status 404 returned error can't find the container with id 89ce5eba6938f147b575c34090238264db15ddd24629458cf015f865f4411bc7 Jul 15 12:08:39.169991 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:39.169956 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" event={"ID":"2692b058-3858-44dd-9b73-6ebfc1b32004","Type":"ContainerStarted","Data":"89ce5eba6938f147b575c34090238264db15ddd24629458cf015f865f4411bc7"} Jul 15 12:08:39.503852 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:39.503815 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:08:39.504014 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:39.503973 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 12:08:39.504056 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:39.504037 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls podName:ddd1a92b-63cc-4715-bb60-a75c45c5cb14 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:43.504022272 +0000 UTC m=+51.096428087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qhn9j" (UID: "ddd1a92b-63cc-4715-bb60-a75c45c5cb14") : secret "cluster-monitoring-operator-tls" not found Jul 15 12:08:39.704918 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:39.704885 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wn526\" (UID: \"f3c0aa44-c433-4fcd-93d3-aaf364ff2494\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" Jul 15 12:08:39.705085 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:39.705029 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 12:08:39.705135 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:39.705086 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls podName:f3c0aa44-c433-4fcd-93d3-aaf364ff2494 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:43.705072453 +0000 UTC m=+51.297478269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls") pod "cluster-samples-operator-65db858894-wn526" (UID: "f3c0aa44-c433-4fcd-93d3-aaf364ff2494") : secret "samples-operator-tls" not found Jul 15 12:08:41.177797 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:41.177760 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ksf4f" event={"ID":"a93d7e61-ee61-402a-b5b3-c0ebae7f0699","Type":"ContainerStarted","Data":"1b0bcfeb3630ddd2f9db67db9e09bfb590ef0c24c2649691dac5dc411141060c"} Jul 15 12:08:41.181261 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:41.181229 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" event={"ID":"dc605393-5c17-4177-854e-d923b106ab9a","Type":"ContainerStarted","Data":"1ec3754d622a547db5315e5d812eb484e729d08c8edb4fdab7ba6285f2e28bff"} Jul 15 12:08:41.184022 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:41.183994 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" event={"ID":"9f420c45-dc1b-40f1-a7e0-cad33cc07830","Type":"ContainerStarted","Data":"6c11f3db872c1c6742348c12c28c3291d92bfa53193b385aafa25b6713fd9a73"} Jul 15 12:08:41.196140 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:41.196096 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ksf4f" podStartSLOduration=2.066281559 podStartE2EDuration="6.196076792s" totalImagesPullingTime="4.129795233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:41.195069337 +0000 UTC m=+48.787475188" watchObservedRunningTime="2026-07-15 12:08:41.196076792 +0000 UTC m=+48.788482632" Jul 15 12:08:41.218997 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:41.218946 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" podStartSLOduration=1.957012881 podStartE2EDuration="6.218927447s" totalImagesPullingTime="4.261914566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:41.215723847 +0000 UTC m=+48.808129687" watchObservedRunningTime="2026-07-15 12:08:41.218927447 +0000 UTC m=+48.811333286" Jul 15 12:08:41.239961 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:41.239063 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" podStartSLOduration=2.040125189 podStartE2EDuration="6.239041684s" totalImagesPullingTime="4.198916495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:41.238846095 +0000 UTC m=+48.831251933" watchObservedRunningTime="2026-07-15 12:08:41.239041684 +0000 UTC m=+48.831447523" Jul 15 12:08:42.238323 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.238277 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8jl9n"] Jul 15 12:08:42.261118 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.261087 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.264202 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.264163 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 12:08:42.264505 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.264270 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8jl9n"] Jul 15 12:08:42.264505 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.264409 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rwqkp\"" Jul 15 12:08:42.264505 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.264442 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 12:08:42.327101 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.327061 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25295c31-7362-4485-aec8-6d828236fad1-crio-socket\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.327457 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.327105 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.327457 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.327267 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chnb8\" (UniqueName: \"kubernetes.io/projected/25295c31-7362-4485-aec8-6d828236fad1-kube-api-access-chnb8\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.327457 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.327390 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.327599 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.327468 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25295c31-7362-4485-aec8-6d828236fad1-data-volume\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.380983 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.380894 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-p2bxs"] Jul 15 12:08:42.402668 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.402625 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-p2bxs"] Jul 15 12:08:42.402817 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.402763 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-p2bxs" Jul 15 12:08:42.405583 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.405555 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ths6w\"" Jul 15 12:08:42.405722 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.405586 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 15 12:08:42.407143 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.407126 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 15 12:08:42.428382 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.428360 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25295c31-7362-4485-aec8-6d828236fad1-data-volume\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.428487 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.428408 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25295c31-7362-4485-aec8-6d828236fad1-crio-socket\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.428487 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.428424 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.428487 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.428458 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65qkq\" (UniqueName: \"kubernetes.io/projected/b11ddfc9-7d6e-4ae4-9936-45902076348f-kube-api-access-65qkq\") pod \"migrator-7f59b54f6c-p2bxs\" (UID: \"b11ddfc9-7d6e-4ae4-9936-45902076348f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-p2bxs" Jul 15 12:08:42.428626 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.428489 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chnb8\" (UniqueName: \"kubernetes.io/projected/25295c31-7362-4485-aec8-6d828236fad1-kube-api-access-chnb8\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.428626 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.428559 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.428626 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:42.428605 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 12:08:42.428626 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.428613 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25295c31-7362-4485-aec8-6d828236fad1-crio-socket\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.428795 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:42.428663 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 12:08:42.428795 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:42.428689 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls podName:25295c31-7362-4485-aec8-6d828236fad1 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:42.928669542 +0000 UTC m=+50.521075375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jl9n" (UID: "25295c31-7362-4485-aec8-6d828236fad1") : secret "insights-runtime-extractor-tls" not found Jul 15 12:08:42.428795 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.428702 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25295c31-7362-4485-aec8-6d828236fad1-data-volume\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.428795 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:42.428714 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm podName:25295c31-7362-4485-aec8-6d828236fad1 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:42.928703145 +0000 UTC m=+50.521108961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jl9n" (UID: "25295c31-7362-4485-aec8-6d828236fad1") : configmap "kube-rbac-proxy" not found Jul 15 12:08:42.437279 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.437252 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chnb8\" (UniqueName: \"kubernetes.io/projected/25295c31-7362-4485-aec8-6d828236fad1-kube-api-access-chnb8\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.529993 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.529969 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65qkq\" (UniqueName: \"kubernetes.io/projected/b11ddfc9-7d6e-4ae4-9936-45902076348f-kube-api-access-65qkq\") pod \"migrator-7f59b54f6c-p2bxs\" (UID: \"b11ddfc9-7d6e-4ae4-9936-45902076348f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-p2bxs" Jul 15 12:08:42.543617 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.543598 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65qkq\" (UniqueName: \"kubernetes.io/projected/b11ddfc9-7d6e-4ae4-9936-45902076348f-kube-api-access-65qkq\") pod \"migrator-7f59b54f6c-p2bxs\" (UID: \"b11ddfc9-7d6e-4ae4-9936-45902076348f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-p2bxs" Jul 15 12:08:42.711810 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.711779 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-p2bxs" Jul 15 12:08:42.934279 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.933704 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.934279 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.933758 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:42.934279 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:42.933888 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 12:08:42.934279 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:42.933930 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls podName:25295c31-7362-4485-aec8-6d828236fad1 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:43.933917901 +0000 UTC m=+51.526323721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jl9n" (UID: "25295c31-7362-4485-aec8-6d828236fad1") : secret "insights-runtime-extractor-tls" not found Jul 15 12:08:42.934279 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:42.934208 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 12:08:42.934279 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:42.934245 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm podName:25295c31-7362-4485-aec8-6d828236fad1 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:43.934233893 +0000 UTC m=+51.526639709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jl9n" (UID: "25295c31-7362-4485-aec8-6d828236fad1") : configmap "kube-rbac-proxy" not found Jul 15 12:08:42.972804 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:42.972769 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-p2bxs"] Jul 15 12:08:42.974683 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:08:42.974657 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11ddfc9_7d6e_4ae4_9936_45902076348f.slice/crio-c848c9bf8d3d949756fdfc56a063bcc2d8c8de2de80175f08f00fc6cf983cfe6 WatchSource:0}: Error finding container c848c9bf8d3d949756fdfc56a063bcc2d8c8de2de80175f08f00fc6cf983cfe6: Status 404 returned error can't find the container with id c848c9bf8d3d949756fdfc56a063bcc2d8c8de2de80175f08f00fc6cf983cfe6 Jul 15 12:08:43.192074 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:43.192039 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" event={"ID":"2692b058-3858-44dd-9b73-6ebfc1b32004","Type":"ContainerStarted","Data":"67522a812c431aae73588197c6f4401726cf4311df293371b1325aadc10a10da"} Jul 15 12:08:43.193717 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:43.193696 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/0.log" Jul 15 12:08:43.193829 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:43.193731 2582 generic.go:356] "Generic (PLEG): container finished" podID="a6e9881e-09a6-46b6-99c1-2a970d1d9d1d" containerID="e87fb814d6207439e875640d39e92508ba97ec5521ff572be72cf7f33dcf2b49" exitCode=255 Jul 15 12:08:43.193829 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:43.193794 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5ksnl" event={"ID":"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d","Type":"ContainerDied","Data":"e87fb814d6207439e875640d39e92508ba97ec5521ff572be72cf7f33dcf2b49"} Jul 15 12:08:43.193967 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:43.193954 2582 scope.go:117] "RemoveContainer" containerID="e87fb814d6207439e875640d39e92508ba97ec5521ff572be72cf7f33dcf2b49" Jul 15 12:08:43.195129 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:43.195109 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-p2bxs" event={"ID":"b11ddfc9-7d6e-4ae4-9936-45902076348f","Type":"ContainerStarted","Data":"c848c9bf8d3d949756fdfc56a063bcc2d8c8de2de80175f08f00fc6cf983cfe6"} Jul 15 12:08:43.212559 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:43.212521 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" podStartSLOduration=2.650703822 podStartE2EDuration="6.212507684s" totalImagesPullingTime="3.561803862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:43.211516819 +0000 UTC m=+50.803922664" watchObservedRunningTime="2026-07-15 12:08:43.212507684 +0000 UTC m=+50.804913522" Jul 15 12:08:43.539168 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:43.539099 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:08:43.539482 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:43.539250 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 12:08:43.539482 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:43.539314 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls podName:ddd1a92b-63cc-4715-bb60-a75c45c5cb14 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:51.53929809 +0000 UTC m=+59.131703910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qhn9j" (UID: "ddd1a92b-63cc-4715-bb60-a75c45c5cb14") : secret "cluster-monitoring-operator-tls" not found Jul 15 12:08:43.740675 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:43.740623 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wn526\" (UID: \"f3c0aa44-c433-4fcd-93d3-aaf364ff2494\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" Jul 15 12:08:43.740815 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:43.740763 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 12:08:43.740848 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:43.740825 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls podName:f3c0aa44-c433-4fcd-93d3-aaf364ff2494 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:51.740809594 +0000 UTC m=+59.333215410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls") pod "cluster-samples-operator-65db858894-wn526" (UID: "f3c0aa44-c433-4fcd-93d3-aaf364ff2494") : secret "samples-operator-tls" not found Jul 15 12:08:43.839517 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:43.839443 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kcflq_9196c019-2ba1-4bd8-8d5a-f579b619f4eb/dns-node-resolver/0.log" Jul 15 12:08:43.942402 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:43.942371 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:43.942546 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:43.942439 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:43.942546 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:43.942495 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 12:08:43.942614 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:43.942546 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 12:08:43.942614 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:43.942562 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm podName:25295c31-7362-4485-aec8-6d828236fad1 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:45.94254491 +0000 UTC m=+53.534950743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jl9n" (UID: "25295c31-7362-4485-aec8-6d828236fad1") : configmap "kube-rbac-proxy" not found Jul 15 12:08:43.942614 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:43.942582 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls podName:25295c31-7362-4485-aec8-6d828236fad1 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:45.942571666 +0000 UTC m=+53.534977484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jl9n" (UID: "25295c31-7362-4485-aec8-6d828236fad1") : secret "insights-runtime-extractor-tls" not found Jul 15 12:08:44.199429 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:44.199402 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:08:44.199785 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:44.199770 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/0.log" Jul 15 12:08:44.199855 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:44.199803 2582 generic.go:356] "Generic (PLEG): container finished" podID="a6e9881e-09a6-46b6-99c1-2a970d1d9d1d" containerID="72535865651dc0b2714cbcf6c2b620c00c9e2c762a7c8d95dd0b603c5210c584" exitCode=255 Jul 15 12:08:44.199855 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:44.199836 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5ksnl" event={"ID":"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d","Type":"ContainerDied","Data":"72535865651dc0b2714cbcf6c2b620c00c9e2c762a7c8d95dd0b603c5210c584"} Jul 15 12:08:44.199928 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:44.199906 2582 scope.go:117] "RemoveContainer" containerID="e87fb814d6207439e875640d39e92508ba97ec5521ff572be72cf7f33dcf2b49" Jul 15 12:08:44.200108 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:44.200087 2582 scope.go:117] "RemoveContainer" containerID="72535865651dc0b2714cbcf6c2b620c00c9e2c762a7c8d95dd0b603c5210c584" Jul 15 12:08:44.200302 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:44.200280 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5ksnl_openshift-console-operator(a6e9881e-09a6-46b6-99c1-2a970d1d9d1d)\"" pod="openshift-console-operator/console-operator-7866497494-5ksnl" podUID="a6e9881e-09a6-46b6-99c1-2a970d1d9d1d" Jul 15 12:08:44.637439 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:44.637380 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qztnm_c3804496-d17a-4f8b-8193-76e79cfb59fd/node-ca/0.log" Jul 15 12:08:44.647702 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:44.647677 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:08:44.647834 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:44.647821 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 12:08:44.647883 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:44.647874 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls podName:95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef nodeName:}" failed. No retries permitted until 2026-07-15 12:09:00.647859706 +0000 UTC m=+68.240265538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls") pod "dns-default-v2dnj" (UID: "95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef") : secret "dns-default-metrics-tls" not found Jul 15 12:08:45.204763 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:45.204739 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:08:45.205105 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:45.205085 2582 scope.go:117] "RemoveContainer" containerID="72535865651dc0b2714cbcf6c2b620c00c9e2c762a7c8d95dd0b603c5210c584" Jul 15 12:08:45.205274 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:45.205253 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5ksnl_openshift-console-operator(a6e9881e-09a6-46b6-99c1-2a970d1d9d1d)\"" pod="openshift-console-operator/console-operator-7866497494-5ksnl" podUID="a6e9881e-09a6-46b6-99c1-2a970d1d9d1d" Jul 15 12:08:45.206522 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:45.206500 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-p2bxs" event={"ID":"b11ddfc9-7d6e-4ae4-9936-45902076348f","Type":"ContainerStarted","Data":"69a5b4b62d44f6777fa9f7c6e51886302db0966630abe7b305393a193b49b7e9"} Jul 15 12:08:45.206594 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:45.206541 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-p2bxs" event={"ID":"b11ddfc9-7d6e-4ae4-9936-45902076348f","Type":"ContainerStarted","Data":"34acfbabdb808fb5c620d938df6878bb60548f58cc814a8fb1bd071beb652bb9"} Jul 15 12:08:45.242826 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:45.242780 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-p2bxs" podStartSLOduration=1.471607576 podStartE2EDuration="3.242766991s" totalImagesPullingTime="1.771159415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:45.242359012 +0000 UTC m=+52.834764850" watchObservedRunningTime="2026-07-15 12:08:45.242766991 +0000 UTC m=+52.835172829" Jul 15 12:08:45.436339 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:45.436315 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hxm5v_32167b6f-91e5-4e82-8d59-2384ae0fa7bf/serve-healthcheck-canary/0.log" Jul 15 12:08:45.957225 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:45.957184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:45.957714 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:45.957294 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:45.957714 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:45.957337 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 12:08:45.957714 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:45.957353 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 12:08:45.957714 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:45.957403 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm podName:25295c31-7362-4485-aec8-6d828236fad1 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:49.95738975 +0000 UTC m=+57.549795566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jl9n" (UID: "25295c31-7362-4485-aec8-6d828236fad1") : configmap "kube-rbac-proxy" not found Jul 15 12:08:45.957714 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:45.957417 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls podName:25295c31-7362-4485-aec8-6d828236fad1 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:49.957410999 +0000 UTC m=+57.549816815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jl9n" (UID: "25295c31-7362-4485-aec8-6d828236fad1") : secret "insights-runtime-extractor-tls" not found Jul 15 12:08:46.086272 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.086235 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qcgvp"] Jul 15 12:08:46.106867 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.106826 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-qcgvp" Jul 15 12:08:46.112244 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.112211 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qcgvp"] Jul 15 12:08:46.116409 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.116388 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 15 12:08:46.116930 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.116912 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-86p29\"" Jul 15 12:08:46.117004 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.116930 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 15 12:08:46.117539 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.117522 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 15 12:08:46.117649 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.117528 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 15 12:08:46.159216 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.159186 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/eaec1e29-43b5-4447-8409-2627639e55d5-signing-key\") pod \"service-ca-79f68b9f4f-qcgvp\" (UID: \"eaec1e29-43b5-4447-8409-2627639e55d5\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcgvp" Jul 15 12:08:46.159216 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.159217 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/eaec1e29-43b5-4447-8409-2627639e55d5-signing-cabundle\") pod \"service-ca-79f68b9f4f-qcgvp\" (UID: \"eaec1e29-43b5-4447-8409-2627639e55d5\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcgvp" Jul 15 12:08:46.159397 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.159329 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52vmm\" (UniqueName: \"kubernetes.io/projected/eaec1e29-43b5-4447-8409-2627639e55d5-kube-api-access-52vmm\") pod \"service-ca-79f68b9f4f-qcgvp\" (UID: \"eaec1e29-43b5-4447-8409-2627639e55d5\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcgvp" Jul 15 12:08:46.239140 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.239054 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:46.239140 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.239112 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:46.239501 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.239484 2582 scope.go:117] "RemoveContainer" containerID="72535865651dc0b2714cbcf6c2b620c00c9e2c762a7c8d95dd0b603c5210c584" Jul 15 12:08:46.239712 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:46.239689 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5ksnl_openshift-console-operator(a6e9881e-09a6-46b6-99c1-2a970d1d9d1d)\"" pod="openshift-console-operator/console-operator-7866497494-5ksnl" podUID="a6e9881e-09a6-46b6-99c1-2a970d1d9d1d" Jul 15 12:08:46.260020 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.259993 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/eaec1e29-43b5-4447-8409-2627639e55d5-signing-key\") pod \"service-ca-79f68b9f4f-qcgvp\" (UID: \"eaec1e29-43b5-4447-8409-2627639e55d5\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcgvp" Jul 15 12:08:46.260020 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.260021 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/eaec1e29-43b5-4447-8409-2627639e55d5-signing-cabundle\") pod \"service-ca-79f68b9f4f-qcgvp\" (UID: \"eaec1e29-43b5-4447-8409-2627639e55d5\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcgvp" Jul 15 12:08:46.260271 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.260242 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52vmm\" (UniqueName: \"kubernetes.io/projected/eaec1e29-43b5-4447-8409-2627639e55d5-kube-api-access-52vmm\") pod \"service-ca-79f68b9f4f-qcgvp\" (UID: \"eaec1e29-43b5-4447-8409-2627639e55d5\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcgvp" Jul 15 12:08:46.260773 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.260746 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/eaec1e29-43b5-4447-8409-2627639e55d5-signing-cabundle\") pod \"service-ca-79f68b9f4f-qcgvp\" (UID: \"eaec1e29-43b5-4447-8409-2627639e55d5\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcgvp" Jul 15 12:08:46.262524 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.262508 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/eaec1e29-43b5-4447-8409-2627639e55d5-signing-key\") pod \"service-ca-79f68b9f4f-qcgvp\" (UID: \"eaec1e29-43b5-4447-8409-2627639e55d5\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcgvp" Jul 15 12:08:46.269720 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.269692 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52vmm\" (UniqueName: \"kubernetes.io/projected/eaec1e29-43b5-4447-8409-2627639e55d5-kube-api-access-52vmm\") pod \"service-ca-79f68b9f4f-qcgvp\" (UID: \"eaec1e29-43b5-4447-8409-2627639e55d5\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qcgvp" Jul 15 12:08:46.416466 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.416428 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-qcgvp" Jul 15 12:08:46.551833 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:46.551682 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qcgvp"] Jul 15 12:08:46.554363 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:08:46.554340 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaec1e29_43b5_4447_8409_2627639e55d5.slice/crio-9fae8c3475615acdcef65869b40c404fbf275e9fab880375701bc4bcd4b76a4f WatchSource:0}: Error finding container 9fae8c3475615acdcef65869b40c404fbf275e9fab880375701bc4bcd4b76a4f: Status 404 returned error can't find the container with id 9fae8c3475615acdcef65869b40c404fbf275e9fab880375701bc4bcd4b76a4f Jul 15 12:08:47.214581 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:47.214544 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-qcgvp" event={"ID":"eaec1e29-43b5-4447-8409-2627639e55d5","Type":"ContainerStarted","Data":"a69c6c4bbbcc4867806980c1f6d710cb189f842b6a7443ef608710cbc8e2d1f2"} Jul 15 12:08:47.215007 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:47.214597 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-qcgvp" event={"ID":"eaec1e29-43b5-4447-8409-2627639e55d5","Type":"ContainerStarted","Data":"9fae8c3475615acdcef65869b40c404fbf275e9fab880375701bc4bcd4b76a4f"} Jul 15 12:08:47.262704 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:47.262657 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-qcgvp" podStartSLOduration=1.26262099 podStartE2EDuration="1.26262099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:47.261561576 +0000 UTC m=+54.853967413" watchObservedRunningTime="2026-07-15 12:08:47.26262099 +0000 UTC m=+54.855026828" Jul 15 12:08:49.988170 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:49.988128 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:49.988713 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:49.988277 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 12:08:49.988713 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:49.988293 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:49.988713 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:49.988337 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls podName:25295c31-7362-4485-aec8-6d828236fad1 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:57.988321289 +0000 UTC m=+65.580727109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jl9n" (UID: "25295c31-7362-4485-aec8-6d828236fad1") : secret "insights-runtime-extractor-tls" not found Jul 15 12:08:49.988713 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:49.988358 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 12:08:49.988713 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:49.988401 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm podName:25295c31-7362-4485-aec8-6d828236fad1 nodeName:}" failed. No retries permitted until 2026-07-15 12:08:57.988390038 +0000 UTC m=+65.580795854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8jl9n" (UID: "25295c31-7362-4485-aec8-6d828236fad1") : configmap "kube-rbac-proxy" not found Jul 15 12:08:51.600310 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:51.600275 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:08:51.600687 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:51.600392 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 12:08:51.600687 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:51.600443 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls podName:ddd1a92b-63cc-4715-bb60-a75c45c5cb14 nodeName:}" failed. No retries permitted until 2026-07-15 12:09:07.600430207 +0000 UTC m=+75.192836024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qhn9j" (UID: "ddd1a92b-63cc-4715-bb60-a75c45c5cb14") : secret "cluster-monitoring-operator-tls" not found Jul 15 12:08:51.801824 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:51.801792 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wn526\" (UID: \"f3c0aa44-c433-4fcd-93d3-aaf364ff2494\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" Jul 15 12:08:51.804127 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:51.804107 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f3c0aa44-c433-4fcd-93d3-aaf364ff2494-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wn526\" (UID: \"f3c0aa44-c433-4fcd-93d3-aaf364ff2494\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" Jul 15 12:08:52.100696 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:52.100633 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" Jul 15 12:08:52.230817 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:52.230790 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526"] Jul 15 12:08:53.237933 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:53.237890 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" event={"ID":"f3c0aa44-c433-4fcd-93d3-aaf364ff2494","Type":"ContainerStarted","Data":"192365fc30f38c227afe0899f4b5cc35d2e8f1753573b2ea46c9f2f326e632ce"} Jul 15 12:08:54.242631 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:54.242592 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" event={"ID":"f3c0aa44-c433-4fcd-93d3-aaf364ff2494","Type":"ContainerStarted","Data":"9eaa2e89e4867fd95e6fef2bcefa0bb028193d66eab05479f6e136711470551e"} Jul 15 12:08:54.243036 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:54.242662 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" event={"ID":"f3c0aa44-c433-4fcd-93d3-aaf364ff2494","Type":"ContainerStarted","Data":"99c1be1124d3c88affaac7ed9a9dc1dff7547cdc617691036ccb6991ea681a1b"} Jul 15 12:08:54.268026 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:54.267975 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wn526" podStartSLOduration=17.669974271 podStartE2EDuration="19.267961236s" totalImagesPullingTime="1.597986965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:54.266680498 +0000 UTC m=+61.859086330" watchObservedRunningTime="2026-07-15 12:08:54.267961236 +0000 UTC m=+61.860367074" Jul 15 12:08:55.127242 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:55.127216 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wt84c" Jul 15 12:08:56.961039 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:56.961015 2582 scope.go:117] "RemoveContainer" containerID="72535865651dc0b2714cbcf6c2b620c00c9e2c762a7c8d95dd0b603c5210c584" Jul 15 12:08:57.253336 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:57.253263 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:08:57.253459 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:57.253351 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5ksnl" event={"ID":"a6e9881e-09a6-46b6-99c1-2a970d1d9d1d","Type":"ContainerStarted","Data":"8323ae7874e64efc7b0b54e0cc3fdcb2fc65d3fb84f44b2f3f6a123a27d58d63"} Jul 15 12:08:57.253689 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:57.253668 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:57.358596 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:57.358570 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-5ksnl" Jul 15 12:08:57.394301 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:57.394253 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-5ksnl" podStartSLOduration=15.990270508 podStartE2EDuration="22.394232579s" totalImagesPullingTime="6.403962071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:08:57.28723416 +0000 UTC m=+64.879639998" watchObservedRunningTime="2026-07-15 12:08:57.394232579 +0000 UTC m=+64.986638420" Jul 15 12:08:58.055669 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.055621 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:58.056012 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.055714 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:58.056012 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:58.055763 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 12:08:58.056012 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:08:58.055826 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls podName:25295c31-7362-4485-aec8-6d828236fad1 nodeName:}" failed. No retries permitted until 2026-07-15 12:09:14.055810808 +0000 UTC m=+81.648216627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8jl9n" (UID: "25295c31-7362-4485-aec8-6d828236fad1") : secret "insights-runtime-extractor-tls" not found Jul 15 12:08:58.056132 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.056115 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25295c31-7362-4485-aec8-6d828236fad1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:08:58.760807 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.760775 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs\") pod \"network-metrics-daemon-svjhf\" (UID: \"1ce43433-1205-4257-a355-91da9321806c\") " pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:58.760988 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.760849 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:58.764520 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.764498 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 12:08:58.765501 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.765487 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 12:08:58.774099 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.774073 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ce43433-1205-4257-a355-91da9321806c-metrics-certs\") pod \"network-metrics-daemon-svjhf\" (UID: \"1ce43433-1205-4257-a355-91da9321806c\") " pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:58.774242 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.774071 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42e44198-430d-4a24-ac72-001f7fc4a7b1-original-pull-secret\") pod \"global-pull-secret-syncer-bxd5k\" (UID: \"42e44198-430d-4a24-ac72-001f7fc4a7b1\") " pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:58.861734 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.861706 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsw2h\" (UniqueName: \"kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h\") pod \"network-check-target-2jc9g\" (UID: \"4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f\") " pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:58.877293 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.877270 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 12:08:58.884950 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.884931 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 12:08:58.894297 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.894274 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsw2h\" (UniqueName: \"kubernetes.io/projected/4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f-kube-api-access-hsw2h\") pod \"network-check-target-2jc9g\" (UID: \"4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f\") " pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:58.973490 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.973466 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s8wbv\"" Jul 15 12:08:58.978579 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.978564 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-674f4\"" Jul 15 12:08:58.978723 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.978711 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svjhf" Jul 15 12:08:58.980683 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.980668 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxd5k" Jul 15 12:08:58.986086 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:58.986069 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:08:59.138877 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:59.138849 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-svjhf"] Jul 15 12:08:59.141739 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:08:59.141713 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce43433_1205_4257_a355_91da9321806c.slice/crio-3909008e6ed2d6afe951f54fe6fdd5b7061977f2fdbba26b9f563fbb0ca5e5a4 WatchSource:0}: Error finding container 3909008e6ed2d6afe951f54fe6fdd5b7061977f2fdbba26b9f563fbb0ca5e5a4: Status 404 returned error can't find the container with id 3909008e6ed2d6afe951f54fe6fdd5b7061977f2fdbba26b9f563fbb0ca5e5a4 Jul 15 12:08:59.260551 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:59.260519 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-svjhf" event={"ID":"1ce43433-1205-4257-a355-91da9321806c","Type":"ContainerStarted","Data":"3909008e6ed2d6afe951f54fe6fdd5b7061977f2fdbba26b9f563fbb0ca5e5a4"} Jul 15 12:08:59.361828 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:59.361765 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bxd5k"] Jul 15 12:08:59.363549 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:08:59.363526 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2jc9g"] Jul 15 12:08:59.365078 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:08:59.365050 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e44198_430d_4a24_ac72_001f7fc4a7b1.slice/crio-77fdfad3158267fd6b0848f95abbe910209931473a27cf03059cc1431c354c35 WatchSource:0}: Error finding container 77fdfad3158267fd6b0848f95abbe910209931473a27cf03059cc1431c354c35: Status 404 returned error can't find the container with id 77fdfad3158267fd6b0848f95abbe910209931473a27cf03059cc1431c354c35 Jul 15 12:08:59.365792 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:08:59.365766 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4794e6b3_bf92_4057_b9b2_e0d8c6b2ae4f.slice/crio-adb560cdf8e62c5221843a3ef7593477834b4df3c47b1eb6402bc3b88f29574a WatchSource:0}: Error finding container adb560cdf8e62c5221843a3ef7593477834b4df3c47b1eb6402bc3b88f29574a: Status 404 returned error can't find the container with id adb560cdf8e62c5221843a3ef7593477834b4df3c47b1eb6402bc3b88f29574a Jul 15 12:09:00.266033 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:00.265955 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2jc9g" event={"ID":"4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f","Type":"ContainerStarted","Data":"adb560cdf8e62c5221843a3ef7593477834b4df3c47b1eb6402bc3b88f29574a"} Jul 15 12:09:00.267672 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:00.267591 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bxd5k" event={"ID":"42e44198-430d-4a24-ac72-001f7fc4a7b1","Type":"ContainerStarted","Data":"77fdfad3158267fd6b0848f95abbe910209931473a27cf03059cc1431c354c35"} Jul 15 12:09:00.678092 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:00.677897 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:09:00.682598 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:00.682570 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef-metrics-tls\") pod \"dns-default-v2dnj\" (UID: \"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef\") " pod="openshift-dns/dns-default-v2dnj" Jul 15 12:09:00.882862 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:00.882631 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cbvbt\"" Jul 15 12:09:00.890289 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:00.890260 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v2dnj" Jul 15 12:09:01.144513 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:01.144488 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v2dnj"] Jul 15 12:09:01.152202 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:09:01.152175 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95bb8651_ffdc_4a90_8bbf_1b51bd3f01ef.slice/crio-438c25430be1b0fd51571737d8fdbbb5ac203a8636d2b4cd2f2e380ac2a7437e WatchSource:0}: Error finding container 438c25430be1b0fd51571737d8fdbbb5ac203a8636d2b4cd2f2e380ac2a7437e: Status 404 returned error can't find the container with id 438c25430be1b0fd51571737d8fdbbb5ac203a8636d2b4cd2f2e380ac2a7437e Jul 15 12:09:01.274038 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:01.274001 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-svjhf" event={"ID":"1ce43433-1205-4257-a355-91da9321806c","Type":"ContainerStarted","Data":"7e46eff46159447d697adf58a2e7835ca575d20e04cbde133c92bff22a62d5e8"} Jul 15 12:09:01.274422 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:01.274285 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-svjhf" event={"ID":"1ce43433-1205-4257-a355-91da9321806c","Type":"ContainerStarted","Data":"efc0e81e44993c8c65bb140c1ae78888f6ee566f607d9141ea601d75aa00e9ca"} Jul 15 12:09:01.275611 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:01.275590 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2dnj" event={"ID":"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef","Type":"ContainerStarted","Data":"438c25430be1b0fd51571737d8fdbbb5ac203a8636d2b4cd2f2e380ac2a7437e"} Jul 15 12:09:01.296583 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:01.296530 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-svjhf" podStartSLOduration=66.417682804 podStartE2EDuration="1m8.296513816s" totalImagesPullingTime="1.878831012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:09:01.29356262 +0000 UTC m=+68.885968461" watchObservedRunningTime="2026-07-15 12:09:01.296513816 +0000 UTC m=+68.888919654" Jul 15 12:09:05.295370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:05.295281 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bxd5k" event={"ID":"42e44198-430d-4a24-ac72-001f7fc4a7b1","Type":"ContainerStarted","Data":"cf2cf41429658e62ca324f99e42b7f94b921839f75b2132835b69da192eef9f3"} Jul 15 12:09:05.297005 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:05.296973 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2dnj" event={"ID":"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef","Type":"ContainerStarted","Data":"a02c7c1bbc3dafad4607b1aafa81f6151c460ec3e8c577ce5cabf0788c7aaa62"} Jul 15 12:09:05.297136 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:05.297040 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v2dnj" Jul 15 12:09:05.297136 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:05.297068 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v2dnj" event={"ID":"95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef","Type":"ContainerStarted","Data":"38f29b7a443f18d5647182439fc2fae970a27ed584a85a7ea182825781fbbeb2"} Jul 15 12:09:05.298335 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:05.298313 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2jc9g" event={"ID":"4794e6b3-bf92-4057-b9b2-e0d8c6b2ae4f","Type":"ContainerStarted","Data":"eab9a25556d65be8f085a5e436a5b9560f1c6754ef5bcbb683c57713288365f2"} Jul 15 12:09:05.298451 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:05.298437 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:09:05.316661 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:05.316602 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bxd5k" podStartSLOduration=65.705526304 podStartE2EDuration="1m11.31659006s" totalImagesPullingTime="5.611063756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:09:05.316203495 +0000 UTC m=+72.908609332" watchObservedRunningTime="2026-07-15 12:09:05.31659006 +0000 UTC m=+72.908995897" Jul 15 12:09:05.339100 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:05.339059 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v2dnj" podStartSLOduration=33.488166634 podStartE2EDuration="37.33904624s" totalImagesPullingTime="3.850879606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:09:05.33806797 +0000 UTC m=+72.930473808" watchObservedRunningTime="2026-07-15 12:09:05.33904624 +0000 UTC m=+72.931452077" Jul 15 12:09:05.357006 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:05.356968 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2jc9g" podStartSLOduration=65.746522678 podStartE2EDuration="1m11.356956268s" totalImagesPullingTime="5.61043359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:09:05.356815699 +0000 UTC m=+72.949221537" watchObservedRunningTime="2026-07-15 12:09:05.356956268 +0000 UTC m=+72.949362106" Jul 15 12:09:07.635146 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:07.635106 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:09:07.637422 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:07.637400 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ddd1a92b-63cc-4715-bb60-a75c45c5cb14-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qhn9j\" (UID: \"ddd1a92b-63cc-4715-bb60-a75c45c5cb14\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:09:07.890458 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:07.890380 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8l79x\"" Jul 15 12:09:07.896046 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:07.896021 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" Jul 15 12:09:08.034809 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:08.034779 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j"] Jul 15 12:09:08.038191 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:09:08.038159 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd1a92b_63cc_4715_bb60_a75c45c5cb14.slice/crio-1440ff88937a3b602fa02e33fda0e580012b1fcce89b9ead3c76fcae14cc0c89 WatchSource:0}: Error finding container 1440ff88937a3b602fa02e33fda0e580012b1fcce89b9ead3c76fcae14cc0c89: Status 404 returned error can't find the container with id 1440ff88937a3b602fa02e33fda0e580012b1fcce89b9ead3c76fcae14cc0c89 Jul 15 12:09:08.308693 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:08.308660 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" event={"ID":"ddd1a92b-63cc-4715-bb60-a75c45c5cb14","Type":"ContainerStarted","Data":"1440ff88937a3b602fa02e33fda0e580012b1fcce89b9ead3c76fcae14cc0c89"} Jul 15 12:09:09.727989 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.727955 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5"] Jul 15 12:09:09.732253 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.732230 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.736809 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.736786 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 15 12:09:09.741002 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.740855 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 15 12:09:09.741440 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.741406 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 15 12:09:09.741440 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.741528 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 15 12:09:09.741440 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.741612 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 15 12:09:09.741861 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.741774 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 15 12:09:09.741861 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.741779 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 15 12:09:09.760808 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.760782 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5"] Jul 15 12:09:09.786478 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.786456 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7568c7bc-fsm4m"] Jul 15 12:09:09.788624 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.788608 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.794216 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.794197 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 12:09:09.794313 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.794197 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 12:09:09.794313 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.794204 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p8szp\"" Jul 15 12:09:09.796780 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.796761 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 12:09:09.799831 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.799814 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 12:09:09.817791 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.817723 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7568c7bc-fsm4m"] Jul 15 12:09:09.849174 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.849143 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/88cf3dd3-7d40-457d-8696-33c53d506659-hub\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.849276 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.849189 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6cbd7ac9-0ac2-4977-b745-60a200be5332-registry-certificates\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.849276 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.849220 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-bound-sa-token\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.849371 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.849286 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6mrd\" (UniqueName: \"kubernetes.io/projected/88cf3dd3-7d40-457d-8696-33c53d506659-kube-api-access-d6mrd\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.849371 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.849321 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6cbd7ac9-0ac2-4977-b745-60a200be5332-ca-trust-extracted\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.849466 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.849379 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6cbd7ac9-0ac2-4977-b745-60a200be5332-image-registry-private-configuration\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.849466 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.849411 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88cf3dd3-7d40-457d-8696-33c53d506659-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.849466 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.849451 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-registry-tls\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.849593 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.849482 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6cbd7ac9-0ac2-4977-b745-60a200be5332-installation-pull-secrets\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.849593 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.849512 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/88cf3dd3-7d40-457d-8696-33c53d506659-ca\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.849593 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.849537 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/88cf3dd3-7d40-457d-8696-33c53d506659-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.849593 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.849573 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/88cf3dd3-7d40-457d-8696-33c53d506659-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.849787 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.849620 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6cbd7ac9-0ac2-4977-b745-60a200be5332-trusted-ca\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.849787 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.849667 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pmpc\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-kube-api-access-2pmpc\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.855599 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.855580 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7568c7bc-fsm4m"] Jul 15 12:09:09.855807 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:09:09.855788 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-2pmpc registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" podUID="6cbd7ac9-0ac2-4977-b745-60a200be5332" Jul 15 12:09:09.950307 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.950274 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/88cf3dd3-7d40-457d-8696-33c53d506659-hub\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.950473 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.950317 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6cbd7ac9-0ac2-4977-b745-60a200be5332-registry-certificates\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.950473 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.950339 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-bound-sa-token\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.950473 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.950387 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6mrd\" (UniqueName: \"kubernetes.io/projected/88cf3dd3-7d40-457d-8696-33c53d506659-kube-api-access-d6mrd\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.950473 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.950420 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6cbd7ac9-0ac2-4977-b745-60a200be5332-ca-trust-extracted\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.950680 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.950614 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6cbd7ac9-0ac2-4977-b745-60a200be5332-image-registry-private-configuration\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.950728 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.950677 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88cf3dd3-7d40-457d-8696-33c53d506659-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.950728 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.950709 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-registry-tls\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.950817 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.950744 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6cbd7ac9-0ac2-4977-b745-60a200be5332-installation-pull-secrets\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.951088 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.950916 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6cbd7ac9-0ac2-4977-b745-60a200be5332-ca-trust-extracted\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.951088 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.950966 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/88cf3dd3-7d40-457d-8696-33c53d506659-ca\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.951088 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.950996 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/88cf3dd3-7d40-457d-8696-33c53d506659-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.951088 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.951044 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/88cf3dd3-7d40-457d-8696-33c53d506659-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.951088 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.951076 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6cbd7ac9-0ac2-4977-b745-60a200be5332-trusted-ca\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.951370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.951102 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pmpc\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-kube-api-access-2pmpc\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.951370 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.951266 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6cbd7ac9-0ac2-4977-b745-60a200be5332-registry-certificates\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.951920 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.951872 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/88cf3dd3-7d40-457d-8696-33c53d506659-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.952584 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.952555 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6cbd7ac9-0ac2-4977-b745-60a200be5332-trusted-ca\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.954161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.954093 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/88cf3dd3-7d40-457d-8696-33c53d506659-hub\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.954598 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.954563 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/88cf3dd3-7d40-457d-8696-33c53d506659-ca\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.955053 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.955012 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/88cf3dd3-7d40-457d-8696-33c53d506659-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.955147 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.955086 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88cf3dd3-7d40-457d-8696-33c53d506659-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.955221 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.955204 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-registry-tls\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.955281 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.955226 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6cbd7ac9-0ac2-4977-b745-60a200be5332-image-registry-private-configuration\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.955695 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.955676 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6cbd7ac9-0ac2-4977-b745-60a200be5332-installation-pull-secrets\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.961407 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.961385 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-bound-sa-token\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:09.965391 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.965358 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6mrd\" (UniqueName: \"kubernetes.io/projected/88cf3dd3-7d40-457d-8696-33c53d506659-kube-api-access-d6mrd\") pod \"cluster-proxy-proxy-agent-74454cb79f-5pnq5\" (UID: \"88cf3dd3-7d40-457d-8696-33c53d506659\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:09.968530 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:09.968510 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pmpc\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-kube-api-access-2pmpc\") pod \"image-registry-7568c7bc-fsm4m\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:10.059360 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.059296 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" Jul 15 12:09:10.215418 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.212898 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5"] Jul 15 12:09:10.219208 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:09:10.219178 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88cf3dd3_7d40_457d_8696_33c53d506659.slice/crio-67132fc20f35d7dc2dc6a25412be0ae818de0afea908cfd22ba972c9d203541b WatchSource:0}: Error finding container 67132fc20f35d7dc2dc6a25412be0ae818de0afea908cfd22ba972c9d203541b: Status 404 returned error can't find the container with id 67132fc20f35d7dc2dc6a25412be0ae818de0afea908cfd22ba972c9d203541b Jul 15 12:09:10.319174 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.319089 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" event={"ID":"88cf3dd3-7d40-457d-8696-33c53d506659","Type":"ContainerStarted","Data":"67132fc20f35d7dc2dc6a25412be0ae818de0afea908cfd22ba972c9d203541b"} Jul 15 12:09:10.320678 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.320652 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:10.320678 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.320658 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" event={"ID":"ddd1a92b-63cc-4715-bb60-a75c45c5cb14","Type":"ContainerStarted","Data":"854d4116b41f84bdae67eea54d4433d0a5a67efa6c278bfbce115f6c61d2fada"} Jul 15 12:09:10.334393 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.334372 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:10.340586 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.340547 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qhn9j" podStartSLOduration=33.27312029 podStartE2EDuration="35.340535146s" totalImagesPullingTime="2.067414856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:09:10.340490148 +0000 UTC m=+77.932895985" watchObservedRunningTime="2026-07-15 12:09:10.340535146 +0000 UTC m=+77.932940984" Jul 15 12:09:10.456512 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.456480 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-registry-tls\") pod \"6cbd7ac9-0ac2-4977-b745-60a200be5332\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " Jul 15 12:09:10.456697 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.456518 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6cbd7ac9-0ac2-4977-b745-60a200be5332-image-registry-private-configuration\") pod \"6cbd7ac9-0ac2-4977-b745-60a200be5332\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " Jul 15 12:09:10.456697 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.456549 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6cbd7ac9-0ac2-4977-b745-60a200be5332-ca-trust-extracted\") pod \"6cbd7ac9-0ac2-4977-b745-60a200be5332\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " Jul 15 12:09:10.456697 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.456576 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pmpc\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-kube-api-access-2pmpc\") pod \"6cbd7ac9-0ac2-4977-b745-60a200be5332\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " Jul 15 12:09:10.456697 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.456618 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-bound-sa-token\") pod \"6cbd7ac9-0ac2-4977-b745-60a200be5332\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " Jul 15 12:09:10.456944 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.456778 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6cbd7ac9-0ac2-4977-b745-60a200be5332-installation-pull-secrets\") pod \"6cbd7ac9-0ac2-4977-b745-60a200be5332\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " Jul 15 12:09:10.456944 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.456837 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6cbd7ac9-0ac2-4977-b745-60a200be5332-registry-certificates\") pod \"6cbd7ac9-0ac2-4977-b745-60a200be5332\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " Jul 15 12:09:10.456944 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.456866 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6cbd7ac9-0ac2-4977-b745-60a200be5332-trusted-ca\") pod \"6cbd7ac9-0ac2-4977-b745-60a200be5332\" (UID: \"6cbd7ac9-0ac2-4977-b745-60a200be5332\") " Jul 15 12:09:10.456944 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.456878 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cbd7ac9-0ac2-4977-b745-60a200be5332-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6cbd7ac9-0ac2-4977-b745-60a200be5332" (UID: "6cbd7ac9-0ac2-4977-b745-60a200be5332"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:09:10.457178 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.457154 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cbd7ac9-0ac2-4977-b745-60a200be5332-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6cbd7ac9-0ac2-4977-b745-60a200be5332" (UID: "6cbd7ac9-0ac2-4977-b745-60a200be5332"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 12:09:10.457321 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.457254 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6cbd7ac9-0ac2-4977-b745-60a200be5332-ca-trust-extracted\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:09:10.457515 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.457486 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cbd7ac9-0ac2-4977-b745-60a200be5332-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6cbd7ac9-0ac2-4977-b745-60a200be5332" (UID: "6cbd7ac9-0ac2-4977-b745-60a200be5332"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 12:09:10.459209 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.459169 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-kube-api-access-2pmpc" (OuterVolumeSpecName: "kube-api-access-2pmpc") pod "6cbd7ac9-0ac2-4977-b745-60a200be5332" (UID: "6cbd7ac9-0ac2-4977-b745-60a200be5332"). InnerVolumeSpecName "kube-api-access-2pmpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:09:10.459209 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.459195 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cbd7ac9-0ac2-4977-b745-60a200be5332-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6cbd7ac9-0ac2-4977-b745-60a200be5332" (UID: "6cbd7ac9-0ac2-4977-b745-60a200be5332"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 12:09:10.459338 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.459206 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6cbd7ac9-0ac2-4977-b745-60a200be5332" (UID: "6cbd7ac9-0ac2-4977-b745-60a200be5332"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:09:10.459338 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.459231 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6cbd7ac9-0ac2-4977-b745-60a200be5332" (UID: "6cbd7ac9-0ac2-4977-b745-60a200be5332"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:09:10.459877 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.459857 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cbd7ac9-0ac2-4977-b745-60a200be5332-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6cbd7ac9-0ac2-4977-b745-60a200be5332" (UID: "6cbd7ac9-0ac2-4977-b745-60a200be5332"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 12:09:10.558479 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.558449 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-bound-sa-token\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:09:10.558479 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.558471 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6cbd7ac9-0ac2-4977-b745-60a200be5332-installation-pull-secrets\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:09:10.558479 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.558484 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6cbd7ac9-0ac2-4977-b745-60a200be5332-registry-certificates\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:09:10.558678 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.558492 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6cbd7ac9-0ac2-4977-b745-60a200be5332-trusted-ca\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:09:10.558678 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.558500 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-registry-tls\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:09:10.558678 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.558509 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6cbd7ac9-0ac2-4977-b745-60a200be5332-image-registry-private-configuration\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:09:10.558678 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:10.558518 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pmpc\" (UniqueName: \"kubernetes.io/projected/6cbd7ac9-0ac2-4977-b745-60a200be5332-kube-api-access-2pmpc\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:09:11.324802 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:11.324717 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7568c7bc-fsm4m" Jul 15 12:09:11.365454 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:11.365410 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7568c7bc-fsm4m"] Jul 15 12:09:11.367072 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:11.367044 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7568c7bc-fsm4m"] Jul 15 12:09:12.962497 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:12.962463 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cbd7ac9-0ac2-4977-b745-60a200be5332" path="/var/lib/kubelet/pods/6cbd7ac9-0ac2-4977-b745-60a200be5332/volumes" Jul 15 12:09:14.085900 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:14.085871 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:09:14.087928 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:14.087893 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25295c31-7362-4485-aec8-6d828236fad1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8jl9n\" (UID: \"25295c31-7362-4485-aec8-6d828236fad1\") " pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:09:14.338515 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:14.338436 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" event={"ID":"88cf3dd3-7d40-457d-8696-33c53d506659","Type":"ContainerStarted","Data":"3f671f62170f82203cc577dfec69e939c85d57b92f4a60b879b11601ad2e0c0c"} Jul 15 12:09:14.338515 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:14.338477 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" event={"ID":"88cf3dd3-7d40-457d-8696-33c53d506659","Type":"ContainerStarted","Data":"043699acdda20b26801cf9967ebfabc4667577daf714393167991b9d2ea916e1"} Jul 15 12:09:14.338515 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:14.338490 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" event={"ID":"88cf3dd3-7d40-457d-8696-33c53d506659","Type":"ContainerStarted","Data":"1683fdc2e231b004481ab4e132a7690ce92c98715f452fbe7769989197a0b1c0"} Jul 15 12:09:14.363711 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:14.363660 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74454cb79f-5pnq5" podStartSLOduration=1.613059679 podStartE2EDuration="5.363629645s" totalImagesPullingTime="3.750569966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:09:14.361498466 +0000 UTC m=+81.953904303" watchObservedRunningTime="2026-07-15 12:09:14.363629645 +0000 UTC m=+81.956035483" Jul 15 12:09:14.375391 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:14.375367 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rwqkp\"" Jul 15 12:09:14.383734 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:14.383718 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8jl9n" Jul 15 12:09:14.516567 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:14.516442 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8jl9n"] Jul 15 12:09:14.519147 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:09:14.519128 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25295c31_7362_4485_aec8_6d828236fad1.slice/crio-3c84f7ce9eda270f22bf2ae811b3ea7a1e9a4fe8692fedec1f4414e0ff055449 WatchSource:0}: Error finding container 3c84f7ce9eda270f22bf2ae811b3ea7a1e9a4fe8692fedec1f4414e0ff055449: Status 404 returned error can't find the container with id 3c84f7ce9eda270f22bf2ae811b3ea7a1e9a4fe8692fedec1f4414e0ff055449 Jul 15 12:09:15.306030 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:15.305140 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v2dnj" Jul 15 12:09:15.346452 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:15.346409 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8jl9n" event={"ID":"25295c31-7362-4485-aec8-6d828236fad1","Type":"ContainerStarted","Data":"3c84f7ce9eda270f22bf2ae811b3ea7a1e9a4fe8692fedec1f4414e0ff055449"} Jul 15 12:09:19.362553 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:19.362522 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8jl9n" event={"ID":"25295c31-7362-4485-aec8-6d828236fad1","Type":"ContainerStarted","Data":"3adb7675bc69d75d29cd1b1d625dbae2c9f549475adc9ee99c4ea6790e519dea"} Jul 15 12:09:21.620348 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.619431 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-brxp4"] Jul 15 12:09:21.628351 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.628329 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.635440 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.635221 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 12:09:21.635440 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.635226 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 12:09:21.636025 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.635851 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 12:09:21.636025 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.635888 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 12:09:21.638016 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.636585 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pv4lp\"" Jul 15 12:09:21.757371 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.757332 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-metrics-client-ca\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.757539 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.757381 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-root\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.757539 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.757417 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttcjh\" (UniqueName: \"kubernetes.io/projected/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-kube-api-access-ttcjh\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.757539 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.757444 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.757539 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.757509 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-wtmp\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.757539 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.757537 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-textfile\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.757827 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.757561 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-sys\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.757827 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.757595 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-tls\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.757827 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.757615 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.858614 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.858573 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-textfile\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.858614 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.858614 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-sys\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.858868 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.858658 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-tls\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.858868 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.858721 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-sys\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.858868 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:09:21.858763 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 12:09:21.858868 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:09:21.858822 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-tls podName:86c2cc3b-926a-4807-8ead-49bb68bf2c8d nodeName:}" failed. No retries permitted until 2026-07-15 12:09:22.358799437 +0000 UTC m=+89.951205255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-tls") pod "node-exporter-brxp4" (UID: "86c2cc3b-926a-4807-8ead-49bb68bf2c8d") : secret "node-exporter-tls" not found Jul 15 12:09:21.858868 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.858816 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.859143 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.858878 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-metrics-client-ca\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.859143 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.858911 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-root\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.859143 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.858943 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttcjh\" (UniqueName: \"kubernetes.io/projected/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-kube-api-access-ttcjh\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.859143 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.858947 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-textfile\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.859143 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.858979 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.859143 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.858986 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-root\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.859143 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.859037 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-wtmp\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.859449 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.859182 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-wtmp\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.859507 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.859489 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.859565 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.859528 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-metrics-client-ca\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.863322 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.863281 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:21.883456 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:21.883403 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttcjh\" (UniqueName: \"kubernetes.io/projected/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-kube-api-access-ttcjh\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:22.363517 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:22.363487 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-tls\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:22.365586 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:22.365567 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86c2cc3b-926a-4807-8ead-49bb68bf2c8d-node-exporter-tls\") pod \"node-exporter-brxp4\" (UID: \"86c2cc3b-926a-4807-8ead-49bb68bf2c8d\") " pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:22.541190 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:22.541159 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-brxp4" Jul 15 12:09:23.025244 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:09:23.025216 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c2cc3b_926a_4807_8ead_49bb68bf2c8d.slice/crio-e58ca1af53e76a2708b7bc3d876f8b10cd24df473712d5087f2147229972f7a9 WatchSource:0}: Error finding container e58ca1af53e76a2708b7bc3d876f8b10cd24df473712d5087f2147229972f7a9: Status 404 returned error can't find the container with id e58ca1af53e76a2708b7bc3d876f8b10cd24df473712d5087f2147229972f7a9 Jul 15 12:09:23.381655 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:23.381563 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8jl9n" event={"ID":"25295c31-7362-4485-aec8-6d828236fad1","Type":"ContainerStarted","Data":"92926d47bf76ec47a1e041346cefcb876448be2855c314ca65208a161b3a2e45"} Jul 15 12:09:23.382806 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:23.382773 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brxp4" event={"ID":"86c2cc3b-926a-4807-8ead-49bb68bf2c8d","Type":"ContainerStarted","Data":"e58ca1af53e76a2708b7bc3d876f8b10cd24df473712d5087f2147229972f7a9"} Jul 15 12:09:24.390333 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:24.390285 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brxp4" event={"ID":"86c2cc3b-926a-4807-8ead-49bb68bf2c8d","Type":"ContainerStarted","Data":"1cb6b8d3f71a54998739c4b6aa375831fa824c2deaa610804834e6c6354e62ce"} Jul 15 12:09:25.396733 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:25.396693 2582 generic.go:356] "Generic (PLEG): container finished" podID="86c2cc3b-926a-4807-8ead-49bb68bf2c8d" containerID="1cb6b8d3f71a54998739c4b6aa375831fa824c2deaa610804834e6c6354e62ce" exitCode=0 Jul 15 12:09:25.396733 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:25.396730 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brxp4" event={"ID":"86c2cc3b-926a-4807-8ead-49bb68bf2c8d","Type":"ContainerDied","Data":"1cb6b8d3f71a54998739c4b6aa375831fa824c2deaa610804834e6c6354e62ce"} Jul 15 12:09:27.406888 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:27.406857 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8jl9n" event={"ID":"25295c31-7362-4485-aec8-6d828236fad1","Type":"ContainerStarted","Data":"6b55bd8b360291ddc4a74bedd0acfb5e182233961215f2d8030b5d1f5f7304ad"} Jul 15 12:09:27.408898 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:27.408872 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brxp4" event={"ID":"86c2cc3b-926a-4807-8ead-49bb68bf2c8d","Type":"ContainerStarted","Data":"547e12a7df04f54dc2eef8e0f333acd90cc71e27da39be650efd6bdf90340565"} Jul 15 12:09:27.409014 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:27.408910 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brxp4" event={"ID":"86c2cc3b-926a-4807-8ead-49bb68bf2c8d","Type":"ContainerStarted","Data":"efd1fe5049d877d14b7aed0497cd26c1bcf4931995fe1b119a39be9fd65c3558"} Jul 15 12:09:27.543610 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:27.543557 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8jl9n" podStartSLOduration=33.396174113 podStartE2EDuration="45.543542165s" totalImagesPullingTime="12.147368052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:08:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:09:27.469905198 +0000 UTC m=+95.062311058" watchObservedRunningTime="2026-07-15 12:09:27.543542165 +0000 UTC m=+95.135948002" Jul 15 12:09:27.543962 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:27.543928 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-brxp4" podStartSLOduration=5.210904433 podStartE2EDuration="6.543921781s" totalImagesPullingTime="1.249380093s" totalInitContainerRuntime="83.637255ms" isStatefulPod=true podCreationTimestamp="2026-07-15 12:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:09:27.542130877 +0000 UTC m=+95.134536716" watchObservedRunningTime="2026-07-15 12:09:27.543921781 +0000 UTC m=+95.136327618" Jul 15 12:09:36.303897 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:36.303866 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2jc9g" Jul 15 12:09:47.482690 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:47.482651 2582 generic.go:356] "Generic (PLEG): container finished" podID="9f420c45-dc1b-40f1-a7e0-cad33cc07830" containerID="6c11f3db872c1c6742348c12c28c3291d92bfa53193b385aafa25b6713fd9a73" exitCode=0 Jul 15 12:09:47.483101 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:47.482709 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" event={"ID":"9f420c45-dc1b-40f1-a7e0-cad33cc07830","Type":"ContainerDied","Data":"6c11f3db872c1c6742348c12c28c3291d92bfa53193b385aafa25b6713fd9a73"} Jul 15 12:09:47.483101 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:47.483028 2582 scope.go:117] "RemoveContainer" containerID="6c11f3db872c1c6742348c12c28c3291d92bfa53193b385aafa25b6713fd9a73" Jul 15 12:09:48.487657 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:09:48.487614 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7xp56" event={"ID":"9f420c45-dc1b-40f1-a7e0-cad33cc07830","Type":"ContainerStarted","Data":"18395f2c3fb1821cd3d351934aa6e02e15c305b0b0356923654b5d2c1fb84972"} Jul 15 12:10:12.575230 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:10:12.575196 2582 generic.go:356] "Generic (PLEG): container finished" podID="dc605393-5c17-4177-854e-d923b106ab9a" containerID="1ec3754d622a547db5315e5d812eb484e729d08c8edb4fdab7ba6285f2e28bff" exitCode=0 Jul 15 12:10:12.575230 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:10:12.575231 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" event={"ID":"dc605393-5c17-4177-854e-d923b106ab9a","Type":"ContainerDied","Data":"1ec3754d622a547db5315e5d812eb484e729d08c8edb4fdab7ba6285f2e28bff"} Jul 15 12:10:12.575699 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:10:12.575483 2582 scope.go:117] "RemoveContainer" containerID="1ec3754d622a547db5315e5d812eb484e729d08c8edb4fdab7ba6285f2e28bff" Jul 15 12:10:13.581108 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:10:13.581021 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-2gvf2" event={"ID":"dc605393-5c17-4177-854e-d923b106ab9a","Type":"ContainerStarted","Data":"5517b3ee4419e7644908edde772e49587c8de8cddff59e439a4810a4bddf6303"} Jul 15 12:10:13.582463 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:10:13.582438 2582 generic.go:356] "Generic (PLEG): container finished" podID="2692b058-3858-44dd-9b73-6ebfc1b32004" containerID="67522a812c431aae73588197c6f4401726cf4311df293371b1325aadc10a10da" exitCode=0 Jul 15 12:10:13.582570 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:10:13.582489 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" event={"ID":"2692b058-3858-44dd-9b73-6ebfc1b32004","Type":"ContainerDied","Data":"67522a812c431aae73588197c6f4401726cf4311df293371b1325aadc10a10da"} Jul 15 12:10:13.582762 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:10:13.582750 2582 scope.go:117] "RemoveContainer" containerID="67522a812c431aae73588197c6f4401726cf4311df293371b1325aadc10a10da" Jul 15 12:10:14.587968 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:10:14.587935 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-wspwm" event={"ID":"2692b058-3858-44dd-9b73-6ebfc1b32004","Type":"ContainerStarted","Data":"467789b6739334f46158daf1497636e18d24c2b895a8f1f181416749475a7ef3"} Jul 15 12:12:52.830764 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:12:52.830739 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:12:52.835008 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:12:52.834987 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:12:52.844044 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:12:52.844013 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:12:52.848055 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:12:52.848029 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 12:12:52.849161 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:12:52.849141 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:14:20.013407 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.013333 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7g7dp"] Jul 15 12:14:20.016329 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.016314 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7g7dp" Jul 15 12:14:20.025386 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.025365 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 12:14:20.025788 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.025771 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 12:14:20.025845 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.025771 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vnmmn\"" Jul 15 12:14:20.035632 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.035607 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7g7dp"] Jul 15 12:14:20.112195 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.112169 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/950b1354-b317-43a6-bb17-d16118320db8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7g7dp\" (UID: \"950b1354-b317-43a6-bb17-d16118320db8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7g7dp" Jul 15 12:14:20.112349 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.112272 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzdm6\" (UniqueName: \"kubernetes.io/projected/950b1354-b317-43a6-bb17-d16118320db8-kube-api-access-gzdm6\") pod \"openshift-lws-operator-fd8ccff4c-7g7dp\" (UID: \"950b1354-b317-43a6-bb17-d16118320db8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7g7dp" Jul 15 12:14:20.212587 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.212555 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzdm6\" (UniqueName: \"kubernetes.io/projected/950b1354-b317-43a6-bb17-d16118320db8-kube-api-access-gzdm6\") pod \"openshift-lws-operator-fd8ccff4c-7g7dp\" (UID: \"950b1354-b317-43a6-bb17-d16118320db8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7g7dp" Jul 15 12:14:20.212763 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.212609 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/950b1354-b317-43a6-bb17-d16118320db8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7g7dp\" (UID: \"950b1354-b317-43a6-bb17-d16118320db8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7g7dp" Jul 15 12:14:20.213008 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.212990 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/950b1354-b317-43a6-bb17-d16118320db8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7g7dp\" (UID: \"950b1354-b317-43a6-bb17-d16118320db8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7g7dp" Jul 15 12:14:20.222871 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.222854 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzdm6\" (UniqueName: \"kubernetes.io/projected/950b1354-b317-43a6-bb17-d16118320db8-kube-api-access-gzdm6\") pod \"openshift-lws-operator-fd8ccff4c-7g7dp\" (UID: \"950b1354-b317-43a6-bb17-d16118320db8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7g7dp" Jul 15 12:14:20.325283 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.325197 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7g7dp" Jul 15 12:14:20.450986 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.450903 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7g7dp"] Jul 15 12:14:20.453247 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:14:20.453220 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod950b1354_b317_43a6_bb17_d16118320db8.slice/crio-f2d37d44527add6b80db90e68487f258d0767b77e8ec8749a3f5eebff28708f6 WatchSource:0}: Error finding container f2d37d44527add6b80db90e68487f258d0767b77e8ec8749a3f5eebff28708f6: Status 404 returned error can't find the container with id f2d37d44527add6b80db90e68487f258d0767b77e8ec8749a3f5eebff28708f6 Jul 15 12:14:20.454817 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:20.454799 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 12:14:21.462069 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:21.462026 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7g7dp" event={"ID":"950b1354-b317-43a6-bb17-d16118320db8","Type":"ContainerStarted","Data":"f2d37d44527add6b80db90e68487f258d0767b77e8ec8749a3f5eebff28708f6"} Jul 15 12:14:23.472047 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:23.472010 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7g7dp" event={"ID":"950b1354-b317-43a6-bb17-d16118320db8","Type":"ContainerStarted","Data":"1e81ff1632f6851f79ff73aea4f6074f5c68404a5cff16996fba871dae6096dc"} Jul 15 12:14:23.493035 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:23.492986 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7g7dp" podStartSLOduration=1.922868943 podStartE2EDuration="4.492971335s" totalImagesPullingTime="2.570102392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:14:23.492200814 +0000 UTC m=+391.084606652" watchObservedRunningTime="2026-07-15 12:14:23.492971335 +0000 UTC m=+391.085377172" Jul 15 12:14:42.188143 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.188114 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk"] Jul 15 12:14:42.191320 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.191305 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.195299 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.195275 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 12:14:42.195391 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.195282 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 12:14:42.195792 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.195778 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 12:14:42.195840 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.195808 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j8fq9\"" Jul 15 12:14:42.195937 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.195923 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 12:14:42.210199 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.210177 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk"] Jul 15 12:14:42.369894 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.369867 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9061800-bf88-47c0-b764-606f27c7a3ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.370009 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.369912 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9061800-bf88-47c0-b764-606f27c7a3ed-tmp\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.370009 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.369933 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9061800-bf88-47c0-b764-606f27c7a3ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.370009 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.369989 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f85f\" (UniqueName: \"kubernetes.io/projected/d9061800-bf88-47c0-b764-606f27c7a3ed-kube-api-access-7f85f\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.370131 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.370014 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9061800-bf88-47c0-b764-606f27c7a3ed-manifests\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.471094 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.471035 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9061800-bf88-47c0-b764-606f27c7a3ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.471094 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.471078 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9061800-bf88-47c0-b764-606f27c7a3ed-tmp\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.471227 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.471096 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9061800-bf88-47c0-b764-606f27c7a3ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.471227 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.471115 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f85f\" (UniqueName: \"kubernetes.io/projected/d9061800-bf88-47c0-b764-606f27c7a3ed-kube-api-access-7f85f\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.471227 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.471134 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9061800-bf88-47c0-b764-606f27c7a3ed-manifests\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.471496 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.471466 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d9061800-bf88-47c0-b764-606f27c7a3ed-manifests\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.473363 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.473333 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d9061800-bf88-47c0-b764-606f27c7a3ed-tmp\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.473662 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.473628 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9061800-bf88-47c0-b764-606f27c7a3ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.473739 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.473666 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d9061800-bf88-47c0-b764-606f27c7a3ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.481764 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.481744 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f85f\" (UniqueName: \"kubernetes.io/projected/d9061800-bf88-47c0-b764-606f27c7a3ed-kube-api-access-7f85f\") pod \"opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk\" (UID: \"d9061800-bf88-47c0-b764-606f27c7a3ed\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.501736 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.501713 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:42.635363 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:42.635333 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk"] Jul 15 12:14:42.638428 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:14:42.638401 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9061800_bf88_47c0_b764_606f27c7a3ed.slice/crio-6a0617f554e4680d773532b2bd733d00a986abd8c1c5639c15f0cef4acd685f1 WatchSource:0}: Error finding container 6a0617f554e4680d773532b2bd733d00a986abd8c1c5639c15f0cef4acd685f1: Status 404 returned error can't find the container with id 6a0617f554e4680d773532b2bd733d00a986abd8c1c5639c15f0cef4acd685f1 Jul 15 12:14:43.546857 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:43.546824 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" event={"ID":"d9061800-bf88-47c0-b764-606f27c7a3ed","Type":"ContainerStarted","Data":"6a0617f554e4680d773532b2bd733d00a986abd8c1c5639c15f0cef4acd685f1"} Jul 15 12:14:47.564975 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:47.564940 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" event={"ID":"d9061800-bf88-47c0-b764-606f27c7a3ed","Type":"ContainerStarted","Data":"14a565353c89b243d37745044e314096288d9e1ccb507354f0ed4bcfcc073d05"} Jul 15 12:14:48.570826 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:48.570795 2582 generic.go:356] "Generic (PLEG): container finished" podID="d9061800-bf88-47c0-b764-606f27c7a3ed" containerID="14a565353c89b243d37745044e314096288d9e1ccb507354f0ed4bcfcc073d05" exitCode=0 Jul 15 12:14:48.571227 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:48.570867 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" event={"ID":"d9061800-bf88-47c0-b764-606f27c7a3ed","Type":"ContainerDied","Data":"14a565353c89b243d37745044e314096288d9e1ccb507354f0ed4bcfcc073d05"} Jul 15 12:14:49.576493 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:49.576461 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" event={"ID":"d9061800-bf88-47c0-b764-606f27c7a3ed","Type":"ContainerStarted","Data":"ca4255516e119817cdd1dd4c9d834f7a7017785dbf8c83949ae83416a289155a"} Jul 15 12:14:49.576968 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:49.576572 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:14:49.607063 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:14:49.607013 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" podStartSLOduration=2.211750726 podStartE2EDuration="7.606993449s" totalImagesPullingTime="4.309329988s" totalInitContainerRuntime="1.085912735s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:14:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:14:49.605182683 +0000 UTC m=+417.197588544" watchObservedRunningTime="2026-07-15 12:14:49.606993449 +0000 UTC m=+417.199399291" Jul 15 12:15:00.583140 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:00.583104 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk" Jul 15 12:15:02.967080 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:02.967043 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-c594875d4-68qsk"] Jul 15 12:15:02.974702 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:02.974682 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c594875d4-68qsk" Jul 15 12:15:02.977926 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:02.977908 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 15 12:15:02.979166 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:02.979146 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 15 12:15:02.979272 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:02.979183 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 12:15:02.979272 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:02.979237 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 12:15:02.979386 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:02.979236 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dnz7s\"" Jul 15 12:15:02.984974 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:02.984947 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c594875d4-68qsk"] Jul 15 12:15:03.021177 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:03.021150 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76648\" (UniqueName: \"kubernetes.io/projected/5f8631b5-030b-49fb-a851-049037722d45-kube-api-access-76648\") pod \"kube-auth-proxy-c594875d4-68qsk\" (UID: \"5f8631b5-030b-49fb-a851-049037722d45\") " pod="openshift-ingress/kube-auth-proxy-c594875d4-68qsk" Jul 15 12:15:03.021319 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:03.021198 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f8631b5-030b-49fb-a851-049037722d45-tmp\") pod \"kube-auth-proxy-c594875d4-68qsk\" (UID: \"5f8631b5-030b-49fb-a851-049037722d45\") " pod="openshift-ingress/kube-auth-proxy-c594875d4-68qsk" Jul 15 12:15:03.021319 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:03.021239 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f8631b5-030b-49fb-a851-049037722d45-tls-certs\") pod \"kube-auth-proxy-c594875d4-68qsk\" (UID: \"5f8631b5-030b-49fb-a851-049037722d45\") " pod="openshift-ingress/kube-auth-proxy-c594875d4-68qsk" Jul 15 12:15:03.122268 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:03.122237 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76648\" (UniqueName: \"kubernetes.io/projected/5f8631b5-030b-49fb-a851-049037722d45-kube-api-access-76648\") pod \"kube-auth-proxy-c594875d4-68qsk\" (UID: \"5f8631b5-030b-49fb-a851-049037722d45\") " pod="openshift-ingress/kube-auth-proxy-c594875d4-68qsk" Jul 15 12:15:03.122424 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:03.122299 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f8631b5-030b-49fb-a851-049037722d45-tmp\") pod \"kube-auth-proxy-c594875d4-68qsk\" (UID: \"5f8631b5-030b-49fb-a851-049037722d45\") " pod="openshift-ingress/kube-auth-proxy-c594875d4-68qsk" Jul 15 12:15:03.122424 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:03.122330 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f8631b5-030b-49fb-a851-049037722d45-tls-certs\") pod \"kube-auth-proxy-c594875d4-68qsk\" (UID: \"5f8631b5-030b-49fb-a851-049037722d45\") " pod="openshift-ingress/kube-auth-proxy-c594875d4-68qsk" Jul 15 12:15:03.124420 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:03.124386 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f8631b5-030b-49fb-a851-049037722d45-tmp\") pod \"kube-auth-proxy-c594875d4-68qsk\" (UID: \"5f8631b5-030b-49fb-a851-049037722d45\") " pod="openshift-ingress/kube-auth-proxy-c594875d4-68qsk" Jul 15 12:15:03.124692 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:03.124671 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f8631b5-030b-49fb-a851-049037722d45-tls-certs\") pod \"kube-auth-proxy-c594875d4-68qsk\" (UID: \"5f8631b5-030b-49fb-a851-049037722d45\") " pod="openshift-ingress/kube-auth-proxy-c594875d4-68qsk" Jul 15 12:15:03.131458 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:03.131438 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76648\" (UniqueName: \"kubernetes.io/projected/5f8631b5-030b-49fb-a851-049037722d45-kube-api-access-76648\") pod \"kube-auth-proxy-c594875d4-68qsk\" (UID: \"5f8631b5-030b-49fb-a851-049037722d45\") " pod="openshift-ingress/kube-auth-proxy-c594875d4-68qsk" Jul 15 12:15:03.284468 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:03.284376 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c594875d4-68qsk" Jul 15 12:15:03.424461 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:03.424425 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c594875d4-68qsk"] Jul 15 12:15:03.428466 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:15:03.428437 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8631b5_030b_49fb_a851_049037722d45.slice/crio-8cfb2384d3f9f2c6aa46c8b08ab93bd712e9478145e9ed289be7c9a348949cfd WatchSource:0}: Error finding container 8cfb2384d3f9f2c6aa46c8b08ab93bd712e9478145e9ed289be7c9a348949cfd: Status 404 returned error can't find the container with id 8cfb2384d3f9f2c6aa46c8b08ab93bd712e9478145e9ed289be7c9a348949cfd Jul 15 12:15:03.630366 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:03.630283 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c594875d4-68qsk" event={"ID":"5f8631b5-030b-49fb-a851-049037722d45","Type":"ContainerStarted","Data":"8cfb2384d3f9f2c6aa46c8b08ab93bd712e9478145e9ed289be7c9a348949cfd"} Jul 15 12:15:07.650841 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:07.650801 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c594875d4-68qsk" event={"ID":"5f8631b5-030b-49fb-a851-049037722d45","Type":"ContainerStarted","Data":"7d0770e0c14a1be3b91f516dd0067d9c8a790c8bc41748f7b892e5ec4f7d2bdc"} Jul 15 12:15:07.672357 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:07.672302 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-c594875d4-68qsk" podStartSLOduration=2.30015438 podStartE2EDuration="5.672286662s" totalImagesPullingTime="3.372132282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:07.671239919 +0000 UTC m=+435.263645756" watchObservedRunningTime="2026-07-15 12:15:07.672286662 +0000 UTC m=+435.264692545" Jul 15 12:15:10.479385 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.479356 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7"] Jul 15 12:15:10.482710 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.482687 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.485490 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.485472 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 12:15:10.486591 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.486574 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 12:15:10.486761 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.486747 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 12:15:10.486831 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.486786 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 12:15:10.486831 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.486797 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vqs6l\"" Jul 15 12:15:10.500721 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.500699 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7"] Jul 15 12:15:10.578183 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.578158 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.578275 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.578196 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9st5\" (UniqueName: \"kubernetes.io/projected/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-kube-api-access-m9st5\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.578275 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.578222 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.578353 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.578315 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.578393 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.578350 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.578393 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.578377 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.578463 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.578394 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.679437 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.679406 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9st5\" (UniqueName: \"kubernetes.io/projected/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-kube-api-access-m9st5\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.679631 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.679448 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.679631 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.679495 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.679631 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.679528 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.679631 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.679559 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.679631 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.679584 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.679631 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.679620 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.680871 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.680849 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.682301 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.682279 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.682476 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.682454 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.682661 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.682614 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.682739 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.682689 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.705179 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.705154 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9st5\" (UniqueName: \"kubernetes.io/projected/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-kube-api-access-m9st5\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.708984 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.708956 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bcebbf0-5dbf-45ef-96db-9f491fddb1bb-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p5vv7\" (UID: \"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.791469 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.791408 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:10.939540 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:10.939514 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7"] Jul 15 12:15:10.940292 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:15:10.940267 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bcebbf0_5dbf_45ef_96db_9f491fddb1bb.slice/crio-69ab110b88a21f9b0a0605de016cb16d51de0b64d48867e6f392b9e62e64740d WatchSource:0}: Error finding container 69ab110b88a21f9b0a0605de016cb16d51de0b64d48867e6f392b9e62e64740d: Status 404 returned error can't find the container with id 69ab110b88a21f9b0a0605de016cb16d51de0b64d48867e6f392b9e62e64740d Jul 15 12:15:11.669668 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:11.669595 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" event={"ID":"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb","Type":"ContainerStarted","Data":"69ab110b88a21f9b0a0605de016cb16d51de0b64d48867e6f392b9e62e64740d"} Jul 15 12:15:13.302381 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.302338 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 15 12:15:13.302622 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.302421 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 15 12:15:13.401968 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.401941 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2"] Jul 15 12:15:13.405107 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.405090 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:13.409150 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.409130 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 12:15:13.409755 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.409738 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 12:15:13.410307 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.410287 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-s4g8z\"" Jul 15 12:15:13.410399 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.410350 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 12:15:13.419869 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.419838 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2"] Jul 15 12:15:13.502743 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.502711 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/998731c2-833a-410e-8c0e-3937a36e0016-manager-config\") pod \"lws-controller-manager-749cb4df47-24gs2\" (UID: \"998731c2-833a-410e-8c0e-3937a36e0016\") " pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:13.502743 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.502741 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/998731c2-833a-410e-8c0e-3937a36e0016-metrics-cert\") pod \"lws-controller-manager-749cb4df47-24gs2\" (UID: \"998731c2-833a-410e-8c0e-3937a36e0016\") " pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:13.502935 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.502763 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/998731c2-833a-410e-8c0e-3937a36e0016-cert\") pod \"lws-controller-manager-749cb4df47-24gs2\" (UID: \"998731c2-833a-410e-8c0e-3937a36e0016\") " pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:13.502935 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.502904 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz5jc\" (UniqueName: \"kubernetes.io/projected/998731c2-833a-410e-8c0e-3937a36e0016-kube-api-access-lz5jc\") pod \"lws-controller-manager-749cb4df47-24gs2\" (UID: \"998731c2-833a-410e-8c0e-3937a36e0016\") " pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:13.604226 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.604139 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz5jc\" (UniqueName: \"kubernetes.io/projected/998731c2-833a-410e-8c0e-3937a36e0016-kube-api-access-lz5jc\") pod \"lws-controller-manager-749cb4df47-24gs2\" (UID: \"998731c2-833a-410e-8c0e-3937a36e0016\") " pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:13.604226 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.604183 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/998731c2-833a-410e-8c0e-3937a36e0016-manager-config\") pod \"lws-controller-manager-749cb4df47-24gs2\" (UID: \"998731c2-833a-410e-8c0e-3937a36e0016\") " pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:13.604226 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.604201 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/998731c2-833a-410e-8c0e-3937a36e0016-metrics-cert\") pod \"lws-controller-manager-749cb4df47-24gs2\" (UID: \"998731c2-833a-410e-8c0e-3937a36e0016\") " pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:13.604226 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.604219 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/998731c2-833a-410e-8c0e-3937a36e0016-cert\") pod \"lws-controller-manager-749cb4df47-24gs2\" (UID: \"998731c2-833a-410e-8c0e-3937a36e0016\") " pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:13.604861 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.604843 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/998731c2-833a-410e-8c0e-3937a36e0016-manager-config\") pod \"lws-controller-manager-749cb4df47-24gs2\" (UID: \"998731c2-833a-410e-8c0e-3937a36e0016\") " pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:13.606760 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.606729 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/998731c2-833a-410e-8c0e-3937a36e0016-cert\") pod \"lws-controller-manager-749cb4df47-24gs2\" (UID: \"998731c2-833a-410e-8c0e-3937a36e0016\") " pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:13.606868 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.606785 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/998731c2-833a-410e-8c0e-3937a36e0016-metrics-cert\") pod \"lws-controller-manager-749cb4df47-24gs2\" (UID: \"998731c2-833a-410e-8c0e-3937a36e0016\") " pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:13.623524 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.623502 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz5jc\" (UniqueName: \"kubernetes.io/projected/998731c2-833a-410e-8c0e-3937a36e0016-kube-api-access-lz5jc\") pod \"lws-controller-manager-749cb4df47-24gs2\" (UID: \"998731c2-833a-410e-8c0e-3937a36e0016\") " pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:13.680029 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.680000 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" event={"ID":"7bcebbf0-5dbf-45ef-96db-9f491fddb1bb","Type":"ContainerStarted","Data":"6be47e127f79996ee0d3c62f2351df01572c06268a055e61faddb12b3d74aa85"} Jul 15 12:15:13.680128 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.680075 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:13.715010 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.714987 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:13.879594 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.879542 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" podStartSLOduration=1.519676504 podStartE2EDuration="3.879519503s" totalImagesPullingTime="2.359842999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:13.761423804 +0000 UTC m=+441.353829657" watchObservedRunningTime="2026-07-15 12:15:13.879519503 +0000 UTC m=+441.471925342" Jul 15 12:15:13.880149 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:13.880131 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2"] Jul 15 12:15:13.880903 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:15:13.880875 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998731c2_833a_410e_8c0e_3937a36e0016.slice/crio-f1fc1fbde3058b580652ebf5a49c5a46769f53c8a92addad2bb2098af0ec5c7f WatchSource:0}: Error finding container f1fc1fbde3058b580652ebf5a49c5a46769f53c8a92addad2bb2098af0ec5c7f: Status 404 returned error can't find the container with id f1fc1fbde3058b580652ebf5a49c5a46769f53c8a92addad2bb2098af0ec5c7f Jul 15 12:15:14.685149 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:14.685117 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" event={"ID":"998731c2-833a-410e-8c0e-3937a36e0016","Type":"ContainerStarted","Data":"f1fc1fbde3058b580652ebf5a49c5a46769f53c8a92addad2bb2098af0ec5c7f"} Jul 15 12:15:14.686875 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:14.686855 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p5vv7" Jul 15 12:15:15.690803 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:15.690766 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" event={"ID":"998731c2-833a-410e-8c0e-3937a36e0016","Type":"ContainerStarted","Data":"002071c806bc92fb1f853d6cb8a766414b3b60752d664ea77043a8b6e4700500"} Jul 15 12:15:15.722393 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:15.722350 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" podStartSLOduration=1.033016228 podStartE2EDuration="2.722335865s" totalImagesPullingTime="1.689319637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:15:15.721413338 +0000 UTC m=+443.313819177" watchObservedRunningTime="2026-07-15 12:15:15.722335865 +0000 UTC m=+443.314741750" Jul 15 12:15:16.695891 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:16.695865 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:15:27.701704 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:15:27.701669 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-749cb4df47-24gs2" Jul 15 12:17:52.862743 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:17:52.862718 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:17:52.866807 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:17:52.866786 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:17:52.867901 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:17:52.867883 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:17:52.871718 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:17:52.871702 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:22:52.887766 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:22:52.887699 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:22:52.891325 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:22:52.891304 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:22:52.892848 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:22:52.892826 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:22:52.895685 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:22:52.895669 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:27:52.916922 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:27:52.916897 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:27:52.918330 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:27:52.917533 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:27:52.921277 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:27:52.921260 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:27:52.921813 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:27:52.921797 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:32:52.940676 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:32:52.940625 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:32:52.942205 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:32:52.941795 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:32:52.944772 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:32:52.944754 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:32:52.945569 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:32:52.945553 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:37:52.965020 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:37:52.964914 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:37:52.969490 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:37:52.966736 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:37:52.969490 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:37:52.969230 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:37:52.970910 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:37:52.970894 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:42:52.988761 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:42:52.988650 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:42:52.992879 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:42:52.990385 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:42:52.992879 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:42:52.992853 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:42:52.994512 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:42:52.994491 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:46:33.287314 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.287280 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf"] Jul 15 12:46:33.290580 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.290562 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.294885 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.294867 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fec782\"/\"openshift-service-ca.crt\"" Jul 15 12:46:33.295098 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.295083 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fec782\"/\"kube-root-ca.crt\"" Jul 15 12:46:33.295191 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.295173 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fec782\"/\"test-model-fec782-kserve-self-signed-certs\"" Jul 15 12:46:33.295245 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.295175 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fec782\"/\"default-dockercfg-7stqv\"" Jul 15 12:46:33.316246 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.316211 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf"] Jul 15 12:46:33.333732 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.333708 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62bsj\" (UniqueName: \"kubernetes.io/projected/91b883d7-209f-4f75-accf-c323d2ee342a-kube-api-access-62bsj\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.333844 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.333747 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-model-cache\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.333844 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.333772 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-tmp-dir\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.333912 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.333851 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-home\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.333912 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.333877 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b883d7-209f-4f75-accf-c323d2ee342a-tls-certs\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.333912 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.333901 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-dshm\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.434553 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.434520 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-home\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.434553 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.434555 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b883d7-209f-4f75-accf-c323d2ee342a-tls-certs\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.434826 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.434579 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-dshm\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.434826 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.434609 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62bsj\" (UniqueName: \"kubernetes.io/projected/91b883d7-209f-4f75-accf-c323d2ee342a-kube-api-access-62bsj\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.434826 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.434633 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-model-cache\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.434826 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.434684 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-tmp-dir\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.435014 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.434962 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-home\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.435076 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.435032 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-model-cache\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.435076 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.435050 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-tmp-dir\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.436783 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.436764 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-dshm\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.437036 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.437021 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b883d7-209f-4f75-accf-c323d2ee342a-tls-certs\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.442677 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.442653 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62bsj\" (UniqueName: \"kubernetes.io/projected/91b883d7-209f-4f75-accf-c323d2ee342a-kube-api-access-62bsj\") pod \"test-model-fec782-kserve-865cd74699-9v9zf\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.600072 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.599990 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:33.735115 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.735092 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf"] Jul 15 12:46:33.737436 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:46:33.737409 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91b883d7_209f_4f75_accf_c323d2ee342a.slice/crio-4aeee5b406f1068a143106cb821ab82e970335e83129768506d2123afce53d88 WatchSource:0}: Error finding container 4aeee5b406f1068a143106cb821ab82e970335e83129768506d2123afce53d88: Status 404 returned error can't find the container with id 4aeee5b406f1068a143106cb821ab82e970335e83129768506d2123afce53d88 Jul 15 12:46:33.739505 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:33.739490 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 12:46:34.363097 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:34.363056 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" event={"ID":"91b883d7-209f-4f75-accf-c323d2ee342a","Type":"ContainerStarted","Data":"4aeee5b406f1068a143106cb821ab82e970335e83129768506d2123afce53d88"} Jul 15 12:46:35.371056 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:35.371016 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" event={"ID":"91b883d7-209f-4f75-accf-c323d2ee342a","Type":"ContainerStarted","Data":"9b7a09ae482cfbb77c9f6496dc6150d259ff885860674523a6245027701ed608"} Jul 15 12:46:35.397335 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:35.397276 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" podStartSLOduration=1.2876411380000001 podStartE2EDuration="2.397259976s" totalImagesPullingTime="1.109618838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:46:35.396306001 +0000 UTC m=+2322.988711851" watchObservedRunningTime="2026-07-15 12:46:35.397259976 +0000 UTC m=+2322.989665812" Jul 15 12:46:43.600733 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:43.600699 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:43.600733 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:43.600740 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:43.613014 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:43.612984 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:46:44.419215 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:46:44.419188 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:47:27.621510 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:27.621470 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf"] Jul 15 12:47:42.640798 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.640749 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" podUID="91b883d7-209f-4f75-accf-c323d2ee342a" containerName="main" containerID="cri-o://9b7a09ae482cfbb77c9f6496dc6150d259ff885860674523a6245027701ed608" gracePeriod=45 Jul 15 12:47:42.885998 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.885976 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:47:42.920690 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.920615 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-tmp-dir\") pod \"91b883d7-209f-4f75-accf-c323d2ee342a\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " Jul 15 12:47:42.920690 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.920676 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b883d7-209f-4f75-accf-c323d2ee342a-tls-certs\") pod \"91b883d7-209f-4f75-accf-c323d2ee342a\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " Jul 15 12:47:42.920903 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.920706 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-home\") pod \"91b883d7-209f-4f75-accf-c323d2ee342a\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " Jul 15 12:47:42.920903 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.920749 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62bsj\" (UniqueName: \"kubernetes.io/projected/91b883d7-209f-4f75-accf-c323d2ee342a-kube-api-access-62bsj\") pod \"91b883d7-209f-4f75-accf-c323d2ee342a\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " Jul 15 12:47:42.920903 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.920799 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-model-cache\") pod \"91b883d7-209f-4f75-accf-c323d2ee342a\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " Jul 15 12:47:42.920903 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.920841 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-dshm\") pod \"91b883d7-209f-4f75-accf-c323d2ee342a\" (UID: \"91b883d7-209f-4f75-accf-c323d2ee342a\") " Jul 15 12:47:42.921134 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.920921 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "91b883d7-209f-4f75-accf-c323d2ee342a" (UID: "91b883d7-209f-4f75-accf-c323d2ee342a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:47:42.921227 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.921167 2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-tmp-dir\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:47:42.921308 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.921274 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-home" (OuterVolumeSpecName: "home") pod "91b883d7-209f-4f75-accf-c323d2ee342a" (UID: "91b883d7-209f-4f75-accf-c323d2ee342a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:47:42.921558 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.921521 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-model-cache" (OuterVolumeSpecName: "model-cache") pod "91b883d7-209f-4f75-accf-c323d2ee342a" (UID: "91b883d7-209f-4f75-accf-c323d2ee342a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:47:42.923308 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.923282 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-dshm" (OuterVolumeSpecName: "dshm") pod "91b883d7-209f-4f75-accf-c323d2ee342a" (UID: "91b883d7-209f-4f75-accf-c323d2ee342a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:47:42.923393 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.923361 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91b883d7-209f-4f75-accf-c323d2ee342a-kube-api-access-62bsj" (OuterVolumeSpecName: "kube-api-access-62bsj") pod "91b883d7-209f-4f75-accf-c323d2ee342a" (UID: "91b883d7-209f-4f75-accf-c323d2ee342a"). InnerVolumeSpecName "kube-api-access-62bsj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:47:42.923464 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:42.923444 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91b883d7-209f-4f75-accf-c323d2ee342a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "91b883d7-209f-4f75-accf-c323d2ee342a" (UID: "91b883d7-209f-4f75-accf-c323d2ee342a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 12:47:43.022336 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:43.022303 2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91b883d7-209f-4f75-accf-c323d2ee342a-tls-certs\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:47:43.022336 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:43.022329 2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-home\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:47:43.022336 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:43.022338 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62bsj\" (UniqueName: \"kubernetes.io/projected/91b883d7-209f-4f75-accf-c323d2ee342a-kube-api-access-62bsj\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:47:43.022560 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:43.022348 2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-model-cache\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:47:43.022560 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:43.022359 2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91b883d7-209f-4f75-accf-c323d2ee342a-dshm\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:47:43.651321 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:43.651280 2582 generic.go:356] "Generic (PLEG): container finished" podID="91b883d7-209f-4f75-accf-c323d2ee342a" containerID="9b7a09ae482cfbb77c9f6496dc6150d259ff885860674523a6245027701ed608" exitCode=0 Jul 15 12:47:43.651724 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:43.651332 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" Jul 15 12:47:43.651724 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:43.651344 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" event={"ID":"91b883d7-209f-4f75-accf-c323d2ee342a","Type":"ContainerDied","Data":"9b7a09ae482cfbb77c9f6496dc6150d259ff885860674523a6245027701ed608"} Jul 15 12:47:43.651724 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:43.651384 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf" event={"ID":"91b883d7-209f-4f75-accf-c323d2ee342a","Type":"ContainerDied","Data":"4aeee5b406f1068a143106cb821ab82e970335e83129768506d2123afce53d88"} Jul 15 12:47:43.651724 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:43.651403 2582 scope.go:117] "RemoveContainer" containerID="9b7a09ae482cfbb77c9f6496dc6150d259ff885860674523a6245027701ed608" Jul 15 12:47:43.659342 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:43.659326 2582 scope.go:117] "RemoveContainer" containerID="9b7a09ae482cfbb77c9f6496dc6150d259ff885860674523a6245027701ed608" Jul 15 12:47:43.659584 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:47:43.659564 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b7a09ae482cfbb77c9f6496dc6150d259ff885860674523a6245027701ed608\": container with ID starting with 9b7a09ae482cfbb77c9f6496dc6150d259ff885860674523a6245027701ed608 not found: ID does not exist" containerID="9b7a09ae482cfbb77c9f6496dc6150d259ff885860674523a6245027701ed608" Jul 15 12:47:43.659666 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:43.659591 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b7a09ae482cfbb77c9f6496dc6150d259ff885860674523a6245027701ed608"} err="failed to get container status \"9b7a09ae482cfbb77c9f6496dc6150d259ff885860674523a6245027701ed608\": rpc error: code = NotFound desc = could not find container \"9b7a09ae482cfbb77c9f6496dc6150d259ff885860674523a6245027701ed608\": container with ID starting with 9b7a09ae482cfbb77c9f6496dc6150d259ff885860674523a6245027701ed608 not found: ID does not exist" Jul 15 12:47:43.687696 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:43.687662 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf"] Jul 15 12:47:43.693586 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:43.693563 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-fec782/test-model-fec782-kserve-865cd74699-9v9zf"] Jul 15 12:47:44.962088 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:44.962054 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91b883d7-209f-4f75-accf-c323d2ee342a" path="/var/lib/kubelet/pods/91b883d7-209f-4f75-accf-c323d2ee342a/volumes" Jul 15 12:47:53.012538 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:53.012427 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:47:53.015331 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:53.014270 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:47:53.016475 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:53.016454 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:47:53.018352 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:47:53.018333 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:50:35.005766 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.005736 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7"] Jul 15 12:50:35.006196 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.006037 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b883d7-209f-4f75-accf-c323d2ee342a" containerName="main" Jul 15 12:50:35.006196 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.006049 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b883d7-209f-4f75-accf-c323d2ee342a" containerName="main" Jul 15 12:50:35.006196 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.006114 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="91b883d7-209f-4f75-accf-c323d2ee342a" containerName="main" Jul 15 12:50:35.009091 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.009073 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.012385 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.012363 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bdc1bb\"/\"auth-test-model-bdc1bb-kserve-self-signed-certs\"" Jul 15 12:50:35.013467 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.013449 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bdc1bb\"/\"kube-root-ca.crt\"" Jul 15 12:50:35.013587 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.013536 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bdc1bb\"/\"openshift-service-ca.crt\"" Jul 15 12:50:35.013587 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.013571 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bdc1bb\"/\"default-dockercfg-k8sd6\"" Jul 15 12:50:35.013777 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.013704 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-model-cache\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.013777 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.013766 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-tmp-dir\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.013896 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.013878 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/645e8bc6-a7b9-470e-b760-91559d3e575f-tls-certs\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.013955 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.013939 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-dshm\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.013995 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.013968 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-home\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.014149 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.014133 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f876z\" (UniqueName: \"kubernetes.io/projected/645e8bc6-a7b9-470e-b760-91559d3e575f-kube-api-access-f876z\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.031708 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.031686 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7"] Jul 15 12:50:35.115214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.115178 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f876z\" (UniqueName: \"kubernetes.io/projected/645e8bc6-a7b9-470e-b760-91559d3e575f-kube-api-access-f876z\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.115408 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.115245 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-model-cache\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.115408 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.115274 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-tmp-dir\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.115408 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.115300 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/645e8bc6-a7b9-470e-b760-91559d3e575f-tls-certs\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.115408 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.115341 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-dshm\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.115408 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.115362 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-home\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.115781 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.115756 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-model-cache\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.115877 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.115801 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-tmp-dir\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.115877 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.115813 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-home\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.117545 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.117515 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-dshm\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.117884 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.117862 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/645e8bc6-a7b9-470e-b760-91559d3e575f-tls-certs\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.128741 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.128719 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f876z\" (UniqueName: \"kubernetes.io/projected/645e8bc6-a7b9-470e-b760-91559d3e575f-kube-api-access-f876z\") pod \"auth-test-model-bdc1bb-kserve-8664d45547-jr7l7\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.318590 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.318498 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:35.449833 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:35.447532 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7"] Jul 15 12:50:35.452034 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:50:35.452005 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod645e8bc6_a7b9_470e_b760_91559d3e575f.slice/crio-b3ccf0501cec9412a94e3b4ef0461aea1f4f4622652c36522d25a35df02ab2d0 WatchSource:0}: Error finding container b3ccf0501cec9412a94e3b4ef0461aea1f4f4622652c36522d25a35df02ab2d0: Status 404 returned error can't find the container with id b3ccf0501cec9412a94e3b4ef0461aea1f4f4622652c36522d25a35df02ab2d0 Jul 15 12:50:36.357967 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:36.357934 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" event={"ID":"645e8bc6-a7b9-470e-b760-91559d3e575f","Type":"ContainerStarted","Data":"e90f704073488aeb13b422ac2766835c5f3f46d2da9bf46e8b1f4d9279817269"} Jul 15 12:50:36.357967 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:36.357974 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" event={"ID":"645e8bc6-a7b9-470e-b760-91559d3e575f","Type":"ContainerStarted","Data":"b3ccf0501cec9412a94e3b4ef0461aea1f4f4622652c36522d25a35df02ab2d0"} Jul 15 12:50:36.375595 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:36.375548 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" podStartSLOduration=2.375532635 podStartE2EDuration="2.375532635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:50:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:50:36.375171368 +0000 UTC m=+2563.967577205" watchObservedRunningTime="2026-07-15 12:50:36.375532635 +0000 UTC m=+2563.967938471" Jul 15 12:50:45.318959 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:45.318902 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:45.318959 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:45.318976 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:45.331151 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:45.331121 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:50:45.407202 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:50:45.407172 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:52:33.276717 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:33.276681 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7"] Jul 15 12:52:48.295724 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.295678 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" podUID="645e8bc6-a7b9-470e-b760-91559d3e575f" containerName="main" containerID="cri-o://e90f704073488aeb13b422ac2766835c5f3f46d2da9bf46e8b1f4d9279817269" gracePeriod=45 Jul 15 12:52:48.525432 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.525408 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:52:48.626674 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.626584 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-tmp-dir\") pod \"645e8bc6-a7b9-470e-b760-91559d3e575f\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " Jul 15 12:52:48.626674 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.626615 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-model-cache\") pod \"645e8bc6-a7b9-470e-b760-91559d3e575f\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " Jul 15 12:52:48.626674 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.626670 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f876z\" (UniqueName: \"kubernetes.io/projected/645e8bc6-a7b9-470e-b760-91559d3e575f-kube-api-access-f876z\") pod \"645e8bc6-a7b9-470e-b760-91559d3e575f\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " Jul 15 12:52:48.627222 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.626727 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-dshm\") pod \"645e8bc6-a7b9-470e-b760-91559d3e575f\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " Jul 15 12:52:48.627222 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.626752 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-home\") pod \"645e8bc6-a7b9-470e-b760-91559d3e575f\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " Jul 15 12:52:48.627222 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.626812 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/645e8bc6-a7b9-470e-b760-91559d3e575f-tls-certs\") pod \"645e8bc6-a7b9-470e-b760-91559d3e575f\" (UID: \"645e8bc6-a7b9-470e-b760-91559d3e575f\") " Jul 15 12:52:48.627222 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.626880 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "645e8bc6-a7b9-470e-b760-91559d3e575f" (UID: "645e8bc6-a7b9-470e-b760-91559d3e575f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:52:48.627222 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.626961 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-model-cache" (OuterVolumeSpecName: "model-cache") pod "645e8bc6-a7b9-470e-b760-91559d3e575f" (UID: "645e8bc6-a7b9-470e-b760-91559d3e575f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:52:48.627222 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.627025 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-home" (OuterVolumeSpecName: "home") pod "645e8bc6-a7b9-470e-b760-91559d3e575f" (UID: "645e8bc6-a7b9-470e-b760-91559d3e575f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:52:48.627222 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.627038 2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-tmp-dir\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:52:48.627222 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.627051 2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-model-cache\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:52:48.628973 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.628947 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/645e8bc6-a7b9-470e-b760-91559d3e575f-kube-api-access-f876z" (OuterVolumeSpecName: "kube-api-access-f876z") pod "645e8bc6-a7b9-470e-b760-91559d3e575f" (UID: "645e8bc6-a7b9-470e-b760-91559d3e575f"). InnerVolumeSpecName "kube-api-access-f876z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:52:48.629085 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.628990 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-dshm" (OuterVolumeSpecName: "dshm") pod "645e8bc6-a7b9-470e-b760-91559d3e575f" (UID: "645e8bc6-a7b9-470e-b760-91559d3e575f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:52:48.629085 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.629010 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645e8bc6-a7b9-470e-b760-91559d3e575f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "645e8bc6-a7b9-470e-b760-91559d3e575f" (UID: "645e8bc6-a7b9-470e-b760-91559d3e575f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 12:52:48.728338 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.728297 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f876z\" (UniqueName: \"kubernetes.io/projected/645e8bc6-a7b9-470e-b760-91559d3e575f-kube-api-access-f876z\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:52:48.728338 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.728331 2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-dshm\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:52:48.728338 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.728341 2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/645e8bc6-a7b9-470e-b760-91559d3e575f-home\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:52:48.728338 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.728348 2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/645e8bc6-a7b9-470e-b760-91559d3e575f-tls-certs\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:52:48.910578 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.910498 2582 generic.go:356] "Generic (PLEG): container finished" podID="645e8bc6-a7b9-470e-b760-91559d3e575f" containerID="e90f704073488aeb13b422ac2766835c5f3f46d2da9bf46e8b1f4d9279817269" exitCode=0 Jul 15 12:52:48.910578 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.910540 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" Jul 15 12:52:48.910578 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.910567 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" event={"ID":"645e8bc6-a7b9-470e-b760-91559d3e575f","Type":"ContainerDied","Data":"e90f704073488aeb13b422ac2766835c5f3f46d2da9bf46e8b1f4d9279817269"} Jul 15 12:52:48.910806 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.910598 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7" event={"ID":"645e8bc6-a7b9-470e-b760-91559d3e575f","Type":"ContainerDied","Data":"b3ccf0501cec9412a94e3b4ef0461aea1f4f4622652c36522d25a35df02ab2d0"} Jul 15 12:52:48.910806 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.910614 2582 scope.go:117] "RemoveContainer" containerID="e90f704073488aeb13b422ac2766835c5f3f46d2da9bf46e8b1f4d9279817269" Jul 15 12:52:48.919222 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.919207 2582 scope.go:117] "RemoveContainer" containerID="e90f704073488aeb13b422ac2766835c5f3f46d2da9bf46e8b1f4d9279817269" Jul 15 12:52:48.919454 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:52:48.919435 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e90f704073488aeb13b422ac2766835c5f3f46d2da9bf46e8b1f4d9279817269\": container with ID starting with e90f704073488aeb13b422ac2766835c5f3f46d2da9bf46e8b1f4d9279817269 not found: ID does not exist" containerID="e90f704073488aeb13b422ac2766835c5f3f46d2da9bf46e8b1f4d9279817269" Jul 15 12:52:48.919517 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.919461 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e90f704073488aeb13b422ac2766835c5f3f46d2da9bf46e8b1f4d9279817269"} err="failed to get container status \"e90f704073488aeb13b422ac2766835c5f3f46d2da9bf46e8b1f4d9279817269\": rpc error: code = NotFound desc = could not find container \"e90f704073488aeb13b422ac2766835c5f3f46d2da9bf46e8b1f4d9279817269\": container with ID starting with e90f704073488aeb13b422ac2766835c5f3f46d2da9bf46e8b1f4d9279817269 not found: ID does not exist" Jul 15 12:52:48.932399 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.932371 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7"] Jul 15 12:52:48.937042 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.937019 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-bdc1bb/auth-test-model-bdc1bb-kserve-8664d45547-jr7l7"] Jul 15 12:52:48.962133 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:48.962105 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="645e8bc6-a7b9-470e-b760-91559d3e575f" path="/var/lib/kubelet/pods/645e8bc6-a7b9-470e-b760-91559d3e575f/volumes" Jul 15 12:52:53.035791 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:53.035695 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:52:53.051232 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:53.037481 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:52:53.051232 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:53.039598 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:52:53.051232 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:52:53.041295 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wt84c_060bfdcc-ad52-4390-8054-d63a9b024e9c/ovn-acl-logging/0.log" Jul 15 12:53:31.725742 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.725708 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk"] Jul 15 12:53:31.726190 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.726021 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="645e8bc6-a7b9-470e-b760-91559d3e575f" containerName="main" Jul 15 12:53:31.726190 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.726031 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="645e8bc6-a7b9-470e-b760-91559d3e575f" containerName="main" Jul 15 12:53:31.726190 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.726077 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="645e8bc6-a7b9-470e-b760-91559d3e575f" containerName="main" Jul 15 12:53:31.728885 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.728869 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.732090 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.732067 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bdc1bb\"/\"sub-test-model-bdc1bb-kserve-self-signed-certs\"" Jul 15 12:53:31.733283 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.733266 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bdc1bb\"/\"openshift-service-ca.crt\"" Jul 15 12:53:31.733519 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.733507 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bdc1bb\"/\"kube-root-ca.crt\"" Jul 15 12:53:31.733588 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.733576 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bdc1bb\"/\"default-dockercfg-k8sd6\"" Jul 15 12:53:31.747422 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.747398 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk"] Jul 15 12:53:31.768361 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.768336 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-tmp-dir\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.768472 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.768380 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-model-cache\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.768472 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.768400 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-home\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.768472 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.768424 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-dshm\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.768472 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.768454 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmdmp\" (UniqueName: \"kubernetes.io/projected/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-kube-api-access-mmdmp\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.768596 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.768479 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-tls-certs\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.868965 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.868933 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-model-cache\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.868965 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.868969 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-home\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.869157 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.868991 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-dshm\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.869157 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.869020 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmdmp\" (UniqueName: \"kubernetes.io/projected/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-kube-api-access-mmdmp\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.869157 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.869046 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-tls-certs\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.869296 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.869275 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-tmp-dir\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.869426 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.869410 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-home\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.869513 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.869494 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-model-cache\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.869577 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.869562 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-tmp-dir\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.871310 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.871292 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-dshm\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.871573 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.871558 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-tls-certs\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:31.881486 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:31.881456 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmdmp\" (UniqueName: \"kubernetes.io/projected/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-kube-api-access-mmdmp\") pod \"sub-test-model-bdc1bb-kserve-fcc697755-shsxk\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:32.037739 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:32.037628 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:32.170972 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:32.170934 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk"] Jul 15 12:53:32.173543 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:53:32.173518 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c85b6d9_81e5_4750_9e1c_4dcf2b9ff4f0.slice/crio-03855d77dff8b3a32d5b4ac06fd39a43891837d488b29ef7af81e4c087880545 WatchSource:0}: Error finding container 03855d77dff8b3a32d5b4ac06fd39a43891837d488b29ef7af81e4c087880545: Status 404 returned error can't find the container with id 03855d77dff8b3a32d5b4ac06fd39a43891837d488b29ef7af81e4c087880545 Jul 15 12:53:33.086092 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:33.086053 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" event={"ID":"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0","Type":"ContainerStarted","Data":"946013741ca5596a9ae9ca9fc6f735e762386920b576a1c3ff482a3c10f25b99"} Jul 15 12:53:33.086092 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:33.086094 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" event={"ID":"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0","Type":"ContainerStarted","Data":"03855d77dff8b3a32d5b4ac06fd39a43891837d488b29ef7af81e4c087880545"} Jul 15 12:53:33.114107 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:33.114060 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" podStartSLOduration=2.114045243 podStartE2EDuration="2.114045243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:53:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:53:33.111778822 +0000 UTC m=+2740.704184658" watchObservedRunningTime="2026-07-15 12:53:33.114045243 +0000 UTC m=+2740.706451082" Jul 15 12:53:42.038732 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:42.038679 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:42.039155 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:42.038750 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:42.050998 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:42.050976 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:53:42.134876 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:53:42.134853 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:54:19.797951 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:19.797871 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk"] Jul 15 12:54:28.694183 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.694145 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb"] Jul 15 12:54:28.697407 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.697390 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.703389 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.703368 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-abb283\"/\"kube-root-ca.crt\"" Jul 15 12:54:28.703389 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.703379 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-abb283\"/\"default-dockercfg-wvnsg\"" Jul 15 12:54:28.703569 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.703430 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-abb283\"/\"openshift-service-ca.crt\"" Jul 15 12:54:28.704582 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.704567 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-abb283\"/\"rate-test-model-abb283-kserve-self-signed-certs\"" Jul 15 12:54:28.721713 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.721687 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb"] Jul 15 12:54:28.735536 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.735509 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-dshm\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.735647 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.735539 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swzmd\" (UniqueName: \"kubernetes.io/projected/90439a17-82ec-4f6a-8bd0-b20e898ad570-kube-api-access-swzmd\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.735647 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.735596 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-model-cache\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.735647 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.735628 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-home\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.735750 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.735659 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90439a17-82ec-4f6a-8bd0-b20e898ad570-tls-certs\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.735750 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.735707 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-tmp-dir\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.836730 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.836692 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-tmp-dir\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.836921 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.836743 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-dshm\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.836921 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.836766 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swzmd\" (UniqueName: \"kubernetes.io/projected/90439a17-82ec-4f6a-8bd0-b20e898ad570-kube-api-access-swzmd\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.836921 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.836818 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-model-cache\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.836921 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.836856 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-home\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.836921 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.836880 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90439a17-82ec-4f6a-8bd0-b20e898ad570-tls-certs\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.837207 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.837180 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-tmp-dir\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.837307 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.837200 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-model-cache\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.837307 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.837234 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-home\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.838963 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.838944 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-dshm\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.839296 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.839277 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90439a17-82ec-4f6a-8bd0-b20e898ad570-tls-certs\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:28.854199 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:28.854178 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swzmd\" (UniqueName: \"kubernetes.io/projected/90439a17-82ec-4f6a-8bd0-b20e898ad570-kube-api-access-swzmd\") pod \"rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:29.006794 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:29.006708 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:29.147342 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:29.147316 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb"] Jul 15 12:54:29.149246 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:54:29.149223 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90439a17_82ec_4f6a_8bd0_b20e898ad570.slice/crio-fa65ee9916c85b09763b35ac2ba910f3f9bd99435294fce251963c2514a8c39d WatchSource:0}: Error finding container fa65ee9916c85b09763b35ac2ba910f3f9bd99435294fce251963c2514a8c39d: Status 404 returned error can't find the container with id fa65ee9916c85b09763b35ac2ba910f3f9bd99435294fce251963c2514a8c39d Jul 15 12:54:29.324212 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:29.324129 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" event={"ID":"90439a17-82ec-4f6a-8bd0-b20e898ad570","Type":"ContainerStarted","Data":"7369cc7775c4bbdea7897722143eec0171f1a2a5ee1d62b314b3d4d3df4838c2"} Jul 15 12:54:29.324212 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:29.324177 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" event={"ID":"90439a17-82ec-4f6a-8bd0-b20e898ad570","Type":"ContainerStarted","Data":"fa65ee9916c85b09763b35ac2ba910f3f9bd99435294fce251963c2514a8c39d"} Jul 15 12:54:29.347968 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:29.347921 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" podStartSLOduration=1.347907351 podStartE2EDuration="1.347907351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:54:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:54:29.346904697 +0000 UTC m=+2796.939310536" watchObservedRunningTime="2026-07-15 12:54:29.347907351 +0000 UTC m=+2796.940313187" Jul 15 12:54:34.817113 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:34.817070 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" podUID="9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0" containerName="main" containerID="cri-o://946013741ca5596a9ae9ca9fc6f735e762386920b576a1c3ff482a3c10f25b99" gracePeriod=45 Jul 15 12:54:35.050352 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.050327 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:54:35.087734 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.087632 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-tmp-dir\") pod \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " Jul 15 12:54:35.087734 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.087712 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-model-cache\") pod \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " Jul 15 12:54:35.087927 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.087782 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-home\") pod \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " Jul 15 12:54:35.087927 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.087807 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmdmp\" (UniqueName: \"kubernetes.io/projected/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-kube-api-access-mmdmp\") pod \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " Jul 15 12:54:35.087927 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.087857 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-tls-certs\") pod \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " Jul 15 12:54:35.087927 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.087890 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-dshm\") pod \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\" (UID: \"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0\") " Jul 15 12:54:35.087927 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.087894 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0" (UID: "9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:54:35.088159 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.088008 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-model-cache" (OuterVolumeSpecName: "model-cache") pod "9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0" (UID: "9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:54:35.088159 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.088069 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-home" (OuterVolumeSpecName: "home") pod "9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0" (UID: "9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:54:35.088250 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.088190 2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-home\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:54:35.088250 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.088208 2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-tmp-dir\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:54:35.088250 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.088223 2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-model-cache\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:54:35.089882 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.089848 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-dshm" (OuterVolumeSpecName: "dshm") pod "9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0" (UID: "9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:54:35.090027 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.089960 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-kube-api-access-mmdmp" (OuterVolumeSpecName: "kube-api-access-mmdmp") pod "9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0" (UID: "9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0"). InnerVolumeSpecName "kube-api-access-mmdmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:54:35.090088 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.090016 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0" (UID: "9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 12:54:35.189105 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.189074 2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-tls-certs\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:54:35.189105 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.189100 2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-dshm\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:54:35.189105 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.189109 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmdmp\" (UniqueName: \"kubernetes.io/projected/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0-kube-api-access-mmdmp\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:54:35.350107 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.350027 2582 generic.go:356] "Generic (PLEG): container finished" podID="9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0" containerID="946013741ca5596a9ae9ca9fc6f735e762386920b576a1c3ff482a3c10f25b99" exitCode=0 Jul 15 12:54:35.350107 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.350072 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" Jul 15 12:54:35.350107 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.350095 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" event={"ID":"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0","Type":"ContainerDied","Data":"946013741ca5596a9ae9ca9fc6f735e762386920b576a1c3ff482a3c10f25b99"} Jul 15 12:54:35.350294 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.350126 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk" event={"ID":"9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0","Type":"ContainerDied","Data":"03855d77dff8b3a32d5b4ac06fd39a43891837d488b29ef7af81e4c087880545"} Jul 15 12:54:35.350294 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.350144 2582 scope.go:117] "RemoveContainer" containerID="946013741ca5596a9ae9ca9fc6f735e762386920b576a1c3ff482a3c10f25b99" Jul 15 12:54:35.358890 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.358874 2582 scope.go:117] "RemoveContainer" containerID="946013741ca5596a9ae9ca9fc6f735e762386920b576a1c3ff482a3c10f25b99" Jul 15 12:54:35.359149 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:54:35.359131 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"946013741ca5596a9ae9ca9fc6f735e762386920b576a1c3ff482a3c10f25b99\": container with ID starting with 946013741ca5596a9ae9ca9fc6f735e762386920b576a1c3ff482a3c10f25b99 not found: ID does not exist" containerID="946013741ca5596a9ae9ca9fc6f735e762386920b576a1c3ff482a3c10f25b99" Jul 15 12:54:35.359214 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.359163 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"946013741ca5596a9ae9ca9fc6f735e762386920b576a1c3ff482a3c10f25b99"} err="failed to get container status \"946013741ca5596a9ae9ca9fc6f735e762386920b576a1c3ff482a3c10f25b99\": rpc error: code = NotFound desc = could not find container \"946013741ca5596a9ae9ca9fc6f735e762386920b576a1c3ff482a3c10f25b99\": container with ID starting with 946013741ca5596a9ae9ca9fc6f735e762386920b576a1c3ff482a3c10f25b99 not found: ID does not exist" Jul 15 12:54:35.373113 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.373087 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk"] Jul 15 12:54:35.380258 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:35.380237 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-bdc1bb/sub-test-model-bdc1bb-kserve-fcc697755-shsxk"] Jul 15 12:54:36.962553 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:36.962515 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0" path="/var/lib/kubelet/pods/9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0/volumes" Jul 15 12:54:39.007887 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:39.007858 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:39.007887 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:39.007896 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:39.019781 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:39.019751 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:54:39.379035 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:54:39.378961 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:55:49.393505 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:55:49.393434 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb"] Jul 15 12:56:04.412269 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.412206 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" podUID="90439a17-82ec-4f6a-8bd0-b20e898ad570" containerName="main" containerID="cri-o://7369cc7775c4bbdea7897722143eec0171f1a2a5ee1d62b314b3d4d3df4838c2" gracePeriod=45 Jul 15 12:56:04.651768 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.651743 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:56:04.712149 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.712121 2582 generic.go:356] "Generic (PLEG): container finished" podID="90439a17-82ec-4f6a-8bd0-b20e898ad570" containerID="7369cc7775c4bbdea7897722143eec0171f1a2a5ee1d62b314b3d4d3df4838c2" exitCode=0 Jul 15 12:56:04.712278 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.712171 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" Jul 15 12:56:04.712278 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.712179 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" event={"ID":"90439a17-82ec-4f6a-8bd0-b20e898ad570","Type":"ContainerDied","Data":"7369cc7775c4bbdea7897722143eec0171f1a2a5ee1d62b314b3d4d3df4838c2"} Jul 15 12:56:04.712278 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.712212 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb" event={"ID":"90439a17-82ec-4f6a-8bd0-b20e898ad570","Type":"ContainerDied","Data":"fa65ee9916c85b09763b35ac2ba910f3f9bd99435294fce251963c2514a8c39d"} Jul 15 12:56:04.712278 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.712232 2582 scope.go:117] "RemoveContainer" containerID="7369cc7775c4bbdea7897722143eec0171f1a2a5ee1d62b314b3d4d3df4838c2" Jul 15 12:56:04.719892 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.719877 2582 scope.go:117] "RemoveContainer" containerID="7369cc7775c4bbdea7897722143eec0171f1a2a5ee1d62b314b3d4d3df4838c2" Jul 15 12:56:04.720142 ip-10-0-141-123 kubenswrapper[2582]: E0715 12:56:04.720123 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7369cc7775c4bbdea7897722143eec0171f1a2a5ee1d62b314b3d4d3df4838c2\": container with ID starting with 7369cc7775c4bbdea7897722143eec0171f1a2a5ee1d62b314b3d4d3df4838c2 not found: ID does not exist" containerID="7369cc7775c4bbdea7897722143eec0171f1a2a5ee1d62b314b3d4d3df4838c2" Jul 15 12:56:04.720200 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.720149 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7369cc7775c4bbdea7897722143eec0171f1a2a5ee1d62b314b3d4d3df4838c2"} err="failed to get container status \"7369cc7775c4bbdea7897722143eec0171f1a2a5ee1d62b314b3d4d3df4838c2\": rpc error: code = NotFound desc = could not find container \"7369cc7775c4bbdea7897722143eec0171f1a2a5ee1d62b314b3d4d3df4838c2\": container with ID starting with 7369cc7775c4bbdea7897722143eec0171f1a2a5ee1d62b314b3d4d3df4838c2 not found: ID does not exist" Jul 15 12:56:04.762668 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.762630 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-home\") pod \"90439a17-82ec-4f6a-8bd0-b20e898ad570\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " Jul 15 12:56:04.762747 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.762729 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-tmp-dir\") pod \"90439a17-82ec-4f6a-8bd0-b20e898ad570\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " Jul 15 12:56:04.762784 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.762762 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swzmd\" (UniqueName: \"kubernetes.io/projected/90439a17-82ec-4f6a-8bd0-b20e898ad570-kube-api-access-swzmd\") pod \"90439a17-82ec-4f6a-8bd0-b20e898ad570\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " Jul 15 12:56:04.762831 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.762800 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-dshm\") pod \"90439a17-82ec-4f6a-8bd0-b20e898ad570\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " Jul 15 12:56:04.762885 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.762855 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90439a17-82ec-4f6a-8bd0-b20e898ad570-tls-certs\") pod \"90439a17-82ec-4f6a-8bd0-b20e898ad570\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " Jul 15 12:56:04.762885 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.762881 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-model-cache\") pod \"90439a17-82ec-4f6a-8bd0-b20e898ad570\" (UID: \"90439a17-82ec-4f6a-8bd0-b20e898ad570\") " Jul 15 12:56:04.762980 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.762899 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-home" (OuterVolumeSpecName: "home") pod "90439a17-82ec-4f6a-8bd0-b20e898ad570" (UID: "90439a17-82ec-4f6a-8bd0-b20e898ad570"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:56:04.763030 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.762975 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "90439a17-82ec-4f6a-8bd0-b20e898ad570" (UID: "90439a17-82ec-4f6a-8bd0-b20e898ad570"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:56:04.763087 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.763074 2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-home\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:56:04.763135 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.763089 2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-tmp-dir\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:56:04.763190 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.763172 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-model-cache" (OuterVolumeSpecName: "model-cache") pod "90439a17-82ec-4f6a-8bd0-b20e898ad570" (UID: "90439a17-82ec-4f6a-8bd0-b20e898ad570"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:56:04.764889 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.764860 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90439a17-82ec-4f6a-8bd0-b20e898ad570-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "90439a17-82ec-4f6a-8bd0-b20e898ad570" (UID: "90439a17-82ec-4f6a-8bd0-b20e898ad570"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 12:56:04.764969 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.764895 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90439a17-82ec-4f6a-8bd0-b20e898ad570-kube-api-access-swzmd" (OuterVolumeSpecName: "kube-api-access-swzmd") pod "90439a17-82ec-4f6a-8bd0-b20e898ad570" (UID: "90439a17-82ec-4f6a-8bd0-b20e898ad570"). InnerVolumeSpecName "kube-api-access-swzmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 12:56:04.764969 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.764918 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-dshm" (OuterVolumeSpecName: "dshm") pod "90439a17-82ec-4f6a-8bd0-b20e898ad570" (UID: "90439a17-82ec-4f6a-8bd0-b20e898ad570"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 12:56:04.864063 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.864040 2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90439a17-82ec-4f6a-8bd0-b20e898ad570-tls-certs\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:56:04.864063 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.864060 2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-model-cache\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:56:04.864191 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.864068 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swzmd\" (UniqueName: \"kubernetes.io/projected/90439a17-82ec-4f6a-8bd0-b20e898ad570-kube-api-access-swzmd\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:56:04.864191 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:04.864077 2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90439a17-82ec-4f6a-8bd0-b20e898ad570-dshm\") on node \"ip-10-0-141-123.ec2.internal\" DevicePath \"\"" Jul 15 12:56:05.029959 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:05.029927 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb"] Jul 15 12:56:05.034447 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:05.034426 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-abb283/rate-test-model-abb283-kserve-6dc5bcb48c-rxxkb"] Jul 15 12:56:06.961337 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:56:06.961302 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90439a17-82ec-4f6a-8bd0-b20e898ad570" path="/var/lib/kubelet/pods/90439a17-82ec-4f6a-8bd0-b20e898ad570/volumes" Jul 15 12:57:09.194246 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:09.194218 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk_d9061800-bf88-47c0-b764-606f27c7a3ed/copy-manifests/0.log" Jul 15 12:57:09.202769 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:09.202748 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk_d9061800-bf88-47c0-b764-606f27c7a3ed/manager/0.log" Jul 15 12:57:14.015602 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:14.015574 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p5vv7_7bcebbf0-5dbf-45ef-96db-9f491fddb1bb/discovery/0.log" Jul 15 12:57:14.138540 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:14.138514 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c594875d4-68qsk_5f8631b5-030b-49fb-a851-049037722d45/kube-auth-proxy/0.log" Jul 15 12:57:23.949451 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:23.949379 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bxd5k_42e44198-430d-4a24-ac72-001f7fc4a7b1/global-pull-secret-syncer/0.log" Jul 15 12:57:24.186325 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:24.186296 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6m59g_03f084d1-05e4-486c-9220-9d855c890f80/konnectivity-agent/0.log" Jul 15 12:57:24.306120 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:24.306041 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-123.ec2.internal_b288c0263dd3bd9ee0a8c0f7dd2e8f04/haproxy/0.log" Jul 15 12:57:31.588533 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:31.588504 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-qhn9j_ddd1a92b-63cc-4715-bb60-a75c45c5cb14/cluster-monitoring-operator/0.log" Jul 15 12:57:31.836771 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:31.836744 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brxp4_86c2cc3b-926a-4807-8ead-49bb68bf2c8d/node-exporter/0.log" Jul 15 12:57:31.868131 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:31.868065 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brxp4_86c2cc3b-926a-4807-8ead-49bb68bf2c8d/kube-rbac-proxy/0.log" Jul 15 12:57:31.899386 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:31.899361 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brxp4_86c2cc3b-926a-4807-8ead-49bb68bf2c8d/init-textfile/0.log" Jul 15 12:57:33.177269 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.177243 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957"] Jul 15 12:57:33.177605 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.177512 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90439a17-82ec-4f6a-8bd0-b20e898ad570" containerName="main" Jul 15 12:57:33.177605 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.177522 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="90439a17-82ec-4f6a-8bd0-b20e898ad570" containerName="main" Jul 15 12:57:33.177605 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.177536 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0" containerName="main" Jul 15 12:57:33.177605 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.177541 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0" containerName="main" Jul 15 12:57:33.177605 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.177584 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c85b6d9-81e5-4750-9e1c-4dcf2b9ff4f0" containerName="main" Jul 15 12:57:33.177605 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.177594 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="90439a17-82ec-4f6a-8bd0-b20e898ad570" containerName="main" Jul 15 12:57:33.180340 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.180324 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.183432 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.183410 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8qq8t\"/\"default-dockercfg-9f9g5\"" Jul 15 12:57:33.183566 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.183524 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8qq8t\"/\"openshift-service-ca.crt\"" Jul 15 12:57:33.184512 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.184498 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8qq8t\"/\"kube-root-ca.crt\"" Jul 15 12:57:33.192240 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.192220 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957"] Jul 15 12:57:33.228245 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.228225 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb99c523-9cfd-4b95-81fc-c978534f3257-sys\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.228345 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.228253 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p94h9\" (UniqueName: \"kubernetes.io/projected/cb99c523-9cfd-4b95-81fc-c978534f3257-kube-api-access-p94h9\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.228345 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.228281 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb99c523-9cfd-4b95-81fc-c978534f3257-proc\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.228452 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.228358 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb99c523-9cfd-4b95-81fc-c978534f3257-lib-modules\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.228452 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.228402 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb99c523-9cfd-4b95-81fc-c978534f3257-podres\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.329700 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.329680 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb99c523-9cfd-4b95-81fc-c978534f3257-sys\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.329802 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.329706 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p94h9\" (UniqueName: \"kubernetes.io/projected/cb99c523-9cfd-4b95-81fc-c978534f3257-kube-api-access-p94h9\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.329802 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.329734 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb99c523-9cfd-4b95-81fc-c978534f3257-proc\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.329802 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.329757 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb99c523-9cfd-4b95-81fc-c978534f3257-lib-modules\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.329802 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.329775 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb99c523-9cfd-4b95-81fc-c978534f3257-podres\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.329984 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.329803 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb99c523-9cfd-4b95-81fc-c978534f3257-sys\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.329984 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.329822 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cb99c523-9cfd-4b95-81fc-c978534f3257-proc\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.329984 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.329879 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb99c523-9cfd-4b95-81fc-c978534f3257-lib-modules\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.329984 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.329906 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cb99c523-9cfd-4b95-81fc-c978534f3257-podres\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.342329 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.342299 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p94h9\" (UniqueName: \"kubernetes.io/projected/cb99c523-9cfd-4b95-81fc-c978534f3257-kube-api-access-p94h9\") pod \"perf-node-gather-daemonset-8q957\" (UID: \"cb99c523-9cfd-4b95-81fc-c978534f3257\") " pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.490063 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.490010 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:33.614154 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:33.614045 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957"] Jul 15 12:57:33.616882 ip-10-0-141-123 kubenswrapper[2582]: W0715 12:57:33.616853 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcb99c523_9cfd_4b95_81fc_c978534f3257.slice/crio-23040e905d92f48b1daff5ace8ffa562bf50918a9756b2c7f71c7185efc0158e WatchSource:0}: Error finding container 23040e905d92f48b1daff5ace8ffa562bf50918a9756b2c7f71c7185efc0158e: Status 404 returned error can't find the container with id 23040e905d92f48b1daff5ace8ffa562bf50918a9756b2c7f71c7185efc0158e Jul 15 12:57:34.070488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:34.070404 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" event={"ID":"cb99c523-9cfd-4b95-81fc-c978534f3257","Type":"ContainerStarted","Data":"7b751991b7ebad062601165075156beb10a5ea301c622c07353a1627ac200944"} Jul 15 12:57:34.070488 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:34.070450 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" event={"ID":"cb99c523-9cfd-4b95-81fc-c978534f3257","Type":"ContainerStarted","Data":"23040e905d92f48b1daff5ace8ffa562bf50918a9756b2c7f71c7185efc0158e"} Jul 15 12:57:34.070671 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:34.070492 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:34.092268 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:34.092224 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" podStartSLOduration=1.092209794 podStartE2EDuration="1.092209794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:57:34.090502262 +0000 UTC m=+2981.682908131" watchObservedRunningTime="2026-07-15 12:57:34.092209794 +0000 UTC m=+2981.684615631" Jul 15 12:57:34.699358 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:34.699329 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/1.log" Jul 15 12:57:34.705180 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:34.705158 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5ksnl_a6e9881e-09a6-46b6-99c1-2a970d1d9d1d/console-operator/2.log" Jul 15 12:57:35.815952 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:35.815926 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-ksf4f_a93d7e61-ee61-402a-b5b3-c0ebae7f0699/volume-data-source-validator/0.log" Jul 15 12:57:36.961194 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:36.961157 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2dnj_95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef/dns/0.log" Jul 15 12:57:36.983473 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:36.983451 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v2dnj_95bb8651-ffdc-4a90-8bbf-1b51bd3f01ef/kube-rbac-proxy/0.log" Jul 15 12:57:37.036903 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:37.036881 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kcflq_9196c019-2ba1-4bd8-8d5a-f579b619f4eb/dns-node-resolver/0.log" Jul 15 12:57:37.701083 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:37.701051 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qztnm_c3804496-d17a-4f8b-8193-76e79cfb59fd/node-ca/0.log" Jul 15 12:57:38.873987 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:38.873958 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p5vv7_7bcebbf0-5dbf-45ef-96db-9f491fddb1bb/discovery/0.log" Jul 15 12:57:38.896270 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:38.896246 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c594875d4-68qsk_5f8631b5-030b-49fb-a851-049037722d45/kube-auth-proxy/0.log" Jul 15 12:57:39.815682 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:39.815655 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hxm5v_32167b6f-91e5-4e82-8d59-2384ae0fa7bf/serve-healthcheck-canary/0.log" Jul 15 12:57:40.083087 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:40.083016 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8qq8t/perf-node-gather-daemonset-8q957" Jul 15 12:57:40.334420 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:40.334352 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-2gvf2_dc605393-5c17-4177-854e-d923b106ab9a/insights-operator/0.log" Jul 15 12:57:40.335187 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:40.335172 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-2gvf2_dc605393-5c17-4177-854e-d923b106ab9a/insights-operator/1.log" Jul 15 12:57:40.358310 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:40.358289 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8jl9n_25295c31-7362-4485-aec8-6d828236fad1/kube-rbac-proxy/0.log" Jul 15 12:57:40.409285 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:40.409262 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8jl9n_25295c31-7362-4485-aec8-6d828236fad1/exporter/0.log" Jul 15 12:57:40.465172 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:40.465149 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8jl9n_25295c31-7362-4485-aec8-6d828236fad1/extractor/0.log" Jul 15 12:57:43.385842 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:43.385760 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p5vv7_7bcebbf0-5dbf-45ef-96db-9f491fddb1bb/discovery/0.log" Jul 15 12:57:43.395455 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:43.395435 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c594875d4-68qsk_5f8631b5-030b-49fb-a851-049037722d45/kube-auth-proxy/0.log" Jul 15 12:57:43.687486 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:43.687463 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk_d9061800-bf88-47c0-b764-606f27c7a3ed/manager/0.log" Jul 15 12:57:43.713437 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:43.713415 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd4cf8ff5-jccvk_d9061800-bf88-47c0-b764-606f27c7a3ed/copy-manifests/0.log" Jul 15 12:57:44.881337 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:44.881304 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p5vv7_7bcebbf0-5dbf-45ef-96db-9f491fddb1bb/discovery/0.log" Jul 15 12:57:44.894474 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:44.894451 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c594875d4-68qsk_5f8631b5-030b-49fb-a851-049037722d45/kube-auth-proxy/0.log" Jul 15 12:57:45.025534 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:45.025510 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-749cb4df47-24gs2_998731c2-833a-410e-8c0e-3937a36e0016/manager/0.log" Jul 15 12:57:45.091371 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:45.091352 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-7g7dp_950b1354-b317-43a6-bb17-d16118320db8/openshift-lws-operator/0.log" Jul 15 12:57:50.137997 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:50.137969 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-p2bxs_b11ddfc9-7d6e-4ae4-9936-45902076348f/migrator/0.log" Jul 15 12:57:50.168869 ip-10-0-141-123 kubenswrapper[2582]: I0715 12:57:50.168847 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-p2bxs_b11ddfc9-7d6e-4ae4-9936-45902076348f/graceful-termination/0.log"