Jul 16 16:50:24.401607 ip-10-0-140-61 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 16 16:50:24.401621 ip-10-0-140-61 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 16 16:50:24.401630 ip-10-0-140-61 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 16 16:50:24.401960 ip-10-0-140-61 systemd[1]: Failed to start Kubernetes Kubelet. Jul 16 16:50:34.509311 ip-10-0-140-61 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 16 16:50:34.509326 ip-10-0-140-61 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c89dd396970e4ab9a476e70203190399 -- Jul 16 16:52:11.693828 ip-10-0-140-61 systemd[1]: Starting Kubernetes Kubelet... Jul 16 16:52:12.134214 ip-10-0-140-61 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 16:52:12.134214 ip-10-0-140-61 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 16:52:12.134214 ip-10-0-140-61 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 16:52:12.134214 ip-10-0-140-61 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 16:52:12.134214 ip-10-0-140-61 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 16:52:12.135609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.135467 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 16:52:12.143157 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143131 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:12.143157 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143155 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:12.143157 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143160 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143164 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143168 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143171 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143174 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143177 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143180 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143182 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143185 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143187 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143190 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143192 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143195 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143197 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143200 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143203 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143207 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143212 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143216 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:12.143272 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143219 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143221 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143224 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143228 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143231 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143235 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143239 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143242 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143245 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143247 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143250 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143252 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143254 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143257 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143260 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143279 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143283 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143287 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143292 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:12.143789 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143295 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143298 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143300 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143303 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143305 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143308 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143311 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143313 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143316 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143319 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143321 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143324 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143326 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143328 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143331 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143334 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143336 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143339 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143342 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143344 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:12.144287 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143348 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143350 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143352 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143355 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143357 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143360 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143362 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143364 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143368 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143370 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143373 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143376 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143378 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143381 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143383 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143386 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143388 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143391 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143394 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143397 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:12.144826 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143400 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143402 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143405 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143407 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143410 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143412 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143414 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143417 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143419 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143422 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143424 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143426 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143429 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143431 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143433 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143436 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143439 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143441 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.143444 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145060 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:12.145343 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145068 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145072 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145075 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145077 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145081 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145084 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145087 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145091 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145095 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145098 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145101 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145103 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145106 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145109 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145112 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145115 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145118 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145120 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145123 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:12.145889 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145125 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145128 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145132 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145136 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145139 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145142 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145145 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145147 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145150 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145154 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145157 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145159 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145162 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145167 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145170 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145173 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145176 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145179 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145182 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:12.146435 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145185 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145187 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145190 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145192 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145194 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145197 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145199 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145201 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145205 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145207 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145210 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145213 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145215 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145217 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145220 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145222 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145225 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145227 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145229 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145232 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:12.146949 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145234 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145237 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145239 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145242 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145245 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145247 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145249 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145252 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145255 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145258 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145260 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145263 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145266 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145268 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145271 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145273 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145275 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145278 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145280 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145282 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:12.147476 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145286 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145288 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145291 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145293 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145295 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145298 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145300 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145303 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145305 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145308 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145310 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145312 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145315 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145317 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145320 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145323 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145326 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145328 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145330 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145333 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:12.148037 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145759 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145764 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145767 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145772 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145776 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145780 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145783 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145785 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145789 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145791 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145794 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145797 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145800 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145803 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145806 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145809 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145811 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145814 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145816 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145819 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:12.148567 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145822 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145825 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145828 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145831 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145833 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145836 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145838 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145841 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145844 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145847 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145850 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145852 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145855 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145858 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145860 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145863 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145865 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145868 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145871 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145873 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:12.149091 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145876 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145878 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145880 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145883 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145886 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145888 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145890 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145894 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145896 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145899 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145902 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145905 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145907 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145909 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145912 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145914 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145917 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145923 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145927 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145929 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:12.149677 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145932 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145934 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145936 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145939 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145941 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145944 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145946 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145949 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145951 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145954 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145957 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145959 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145962 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145964 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145967 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145969 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145972 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145975 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145977 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:12.150191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145980 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145982 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145984 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145987 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145989 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145992 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145994 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145997 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.145999 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146002 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146006 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146008 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146012 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146015 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146018 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146021 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146024 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146026 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146029 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146031 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:12.150743 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146116 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146123 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146130 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146134 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146139 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146143 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146147 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146152 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146157 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146160 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146164 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146167 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146170 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146173 2563 flags.go:64] FLAG: --cgroup-root="" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146176 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146179 2563 flags.go:64] FLAG: --client-ca-file="" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146182 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146185 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146190 2563 flags.go:64] FLAG: --cluster-domain="" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146192 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146195 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146198 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146204 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146208 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 16:52:12.151246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146211 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146214 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146217 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146220 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146223 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146226 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146229 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146232 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146236 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146239 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146242 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146245 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146248 2563 flags.go:64] FLAG: --enable-server="true" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146254 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146258 2563 flags.go:64] FLAG: --event-burst="100" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146261 2563 flags.go:64] FLAG: --event-qps="50" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146266 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146270 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146272 2563 flags.go:64] FLAG: --eviction-hard="" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146276 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146279 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146281 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146284 2563 flags.go:64] FLAG: --eviction-soft="" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146288 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146291 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 16:52:12.151887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146294 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146297 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146300 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146302 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146305 2563 flags.go:64] FLAG: --feature-gates="" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146310 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146313 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146316 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146319 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146322 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146325 2563 flags.go:64] FLAG: --help="false" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146327 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146330 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146333 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146336 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146339 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146342 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146345 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146348 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146351 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146353 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146357 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146360 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146364 2563 flags.go:64] FLAG: --kube-reserved="" Jul 16 16:52:12.152580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146367 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146370 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146373 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146375 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146378 2563 flags.go:64] FLAG: --lock-file="" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146381 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146384 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146387 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146392 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146394 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146397 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146400 2563 flags.go:64] FLAG: --logging-format="text" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146402 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146407 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146409 2563 flags.go:64] FLAG: --manifest-url="" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146412 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146417 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146420 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146424 2563 flags.go:64] FLAG: --max-pods="110" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146426 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146430 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146432 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146435 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146439 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146446 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 16:52:12.153487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146449 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146458 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146461 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146464 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146467 2563 flags.go:64] FLAG: --pod-cidr="" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146470 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146477 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146480 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146483 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146485 2563 flags.go:64] FLAG: --port="10250" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146488 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146491 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a7690477eab70f16" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146494 2563 flags.go:64] FLAG: --qos-reserved="" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146497 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146500 2563 flags.go:64] FLAG: --register-node="true" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146503 2563 flags.go:64] FLAG: --register-with-taints="" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146506 2563 flags.go:64] FLAG: --registry-burst="10" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146509 2563 flags.go:64] FLAG: --registry-qps="5" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146512 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146515 2563 flags.go:64] FLAG: --reserved-memory="" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146518 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146522 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146525 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146528 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146531 2563 flags.go:64] FLAG: --runonce="false" Jul 16 16:52:12.154609 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146534 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146537 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146539 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146542 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146558 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146562 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146565 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146568 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146570 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146573 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146576 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146579 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146582 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146587 2563 flags.go:64] FLAG: --system-cgroups="" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146590 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146596 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146598 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146601 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146606 2563 flags.go:64] FLAG: --tls-min-version="" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146608 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146611 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146614 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146617 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146620 2563 flags.go:64] FLAG: --v="2" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146624 2563 flags.go:64] FLAG: --version="false" Jul 16 16:52:12.155671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146628 2563 flags.go:64] FLAG: --vmodule="" Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146632 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.146635 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146753 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146757 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146760 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146763 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146767 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146770 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146772 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146775 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146777 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146780 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146782 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146785 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146787 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146789 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146792 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146794 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:12.156332 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146797 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146801 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146804 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146807 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146809 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146813 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146815 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146818 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146820 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146822 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146825 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146827 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146830 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146832 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146835 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146838 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146841 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146844 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146846 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146848 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146851 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:12.157191 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146853 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146856 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146858 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146861 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146863 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146865 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146868 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146870 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146873 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146875 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146878 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146880 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146884 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146887 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146890 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146892 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146895 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146897 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146899 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146902 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:12.158125 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146904 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146907 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146909 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146911 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146914 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146916 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146919 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146922 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146924 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146927 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146929 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146932 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146935 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146937 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146939 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146942 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146944 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146947 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146950 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:12.158681 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146952 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146955 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146957 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146960 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146964 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146968 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146971 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146974 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146977 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146980 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146982 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146984 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146987 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146989 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146991 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146993 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146996 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.146998 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.147000 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:12.159484 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.147004 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:12.160359 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.147008 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:12.160359 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.147012 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:12.160359 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.147016 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:12.160359 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.147021 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 16:52:12.160359 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.155391 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 16:52:12.160359 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.155413 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 16:52:12.160359 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.156373 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 16:52:12.160359 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.156388 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 16:52:12.160359 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156492 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:12.160359 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156500 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:12.160359 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156505 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:12.160359 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156509 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:12.160359 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156513 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:12.160359 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156518 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156523 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156527 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156532 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156536 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156540 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156544 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156574 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156578 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156582 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156586 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156591 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156595 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156600 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156604 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156608 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156613 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156617 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156622 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156625 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:12.160804 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156629 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156634 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156638 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156642 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156646 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156650 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156655 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156659 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156663 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156667 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156671 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156675 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156679 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156683 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156687 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156691 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156696 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156702 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156708 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:12.161458 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156712 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156724 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156729 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156735 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156740 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156745 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156750 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156754 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156759 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156763 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156770 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156776 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156780 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156784 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156789 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156793 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156797 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156801 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156806 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:12.162054 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156810 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156814 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156819 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156823 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156827 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156831 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156835 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156840 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156844 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156849 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156853 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156857 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156861 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156865 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156869 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156884 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156888 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156893 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156897 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156901 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:12.162569 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156905 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156909 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156914 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156918 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156923 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156927 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156931 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156935 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156939 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156944 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156948 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156952 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156957 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156961 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156965 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:12.163153 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.156970 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.156978 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157220 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157228 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157232 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157237 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157241 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157245 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157250 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157254 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157258 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157262 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157266 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157279 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157284 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:12.163565 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157288 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157292 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157304 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157309 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157313 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157317 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157321 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157325 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157330 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157334 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157338 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157342 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157347 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157351 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157356 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157360 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157364 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157368 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157372 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:12.164032 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157377 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157381 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157385 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157389 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157393 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157397 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157401 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157405 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157412 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157428 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157433 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157437 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157450 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157454 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157458 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157462 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157467 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157471 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157475 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157480 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:12.164519 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157484 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157488 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157493 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157497 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157500 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157505 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157509 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157538 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157543 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157564 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157569 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157573 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157579 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157583 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157588 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157592 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157596 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157601 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157605 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157608 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:12.165071 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157612 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157616 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157620 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157624 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157627 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157639 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157644 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157649 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157653 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157657 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157661 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157665 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157670 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157674 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157678 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157682 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157687 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157694 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157698 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157702 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:12.165627 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157706 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:12.166417 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157711 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:12.166417 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157715 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:12.166417 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157719 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:12.166417 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157725 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:12.166417 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157731 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:12.166417 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:12.157735 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:12.166417 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.157743 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 16:52:12.166417 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.157933 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 16:52:12.166417 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.161154 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 16:52:12.166417 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.162906 2563 server.go:1019] "Starting client certificate rotation" Jul 16 16:52:12.166417 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.163022 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 16:52:12.166417 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.163063 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 16:52:12.168537 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.168514 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 16:52:12.171135 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.171116 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 16:52:12.179314 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.179295 2563 log.go:25] "Validated CRI v1 runtime API" Jul 16 16:52:12.182728 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.182713 2563 log.go:25] "Validated CRI v1 image API" Jul 16 16:52:12.188600 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.188577 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 16:52:12.191297 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.191267 2563 fs.go:135] Filesystem UUIDs: map[40ce0719-ae2a-416b-8a1b-f7d0db0fc990:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a8c6124d-0a1e-4d50-afd9-25c045824204:/dev/nvme0n1p3] Jul 16 16:52:12.191380 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.191296 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 16:52:12.195507 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.195483 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 16:52:12.198425 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.198312 2563 manager.go:216] Machine: {Timestamp:2026-07-16 16:52:12.196082729 +0000 UTC m=+0.375338949 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3118014 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec260b08ac1720dbe513f4d5a10eb41f SystemUUID:ec260b08-ac17-20db-e513-f4d5a10eb41f BootID:c89dd396-970e-4ab9-a476-e70203190399 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:35:c6:e8:d6:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:35:c6:e8:d6:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:10:26:b7:18:01 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 16:52:12.198425 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.198418 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 16:52:12.198620 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.198530 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 16:52:12.200855 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.200817 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 16:52:12.201052 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.200857 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-61.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 16:52:12.202595 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.202544 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 16:52:12.202701 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.202601 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 16:52:12.202701 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.202616 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 16:52:12.203491 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.203473 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 16:52:12.205494 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.205473 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 16:52:12.210293 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.210271 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 16 16:52:12.210473 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.210460 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 16:52:12.210579 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.210567 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 16 16:52:12.210630 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.210596 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 16:52:12.210630 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.210623 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 16:52:12.210725 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.210637 2563 kubelet.go:398] "Adding apiserver pod source" Jul 16 16:52:12.210725 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.210651 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 16:52:12.211222 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.211175 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 16:52:12.211222 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.211201 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 16:52:12.213815 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.213799 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 16:52:12.218180 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.218161 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 16:52:12.218261 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.218243 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 16:52:12.219825 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.219804 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 16:52:12.219929 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.219833 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 16:52:12.219929 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.219842 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 16:52:12.219929 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.219849 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 16:52:12.219929 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.219860 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 16:52:12.219929 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.219872 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 16:52:12.219929 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.219883 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 16:52:12.219929 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.219891 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 16:52:12.219929 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.219885 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 16:52:12.219929 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.219900 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 16:52:12.220210 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.219950 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 16:52:12.220210 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.219962 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 16:52:12.220210 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.219969 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 16:52:12.220210 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.219964 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 16:52:12.220706 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.220696 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 16:52:12.220706 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.220707 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 16:52:12.224162 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.224144 2563 server.go:1268] "Started kubelet" Jul 16 16:52:12.224271 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.224222 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 16:52:12.224415 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.224363 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 16:52:12.224462 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.224438 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 16:52:12.224868 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.224845 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-61.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 16:52:12.225032 ip-10-0-140-61 systemd[1]: Started Kubernetes Kubelet. Jul 16 16:52:12.225987 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.225977 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 16:52:12.226301 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.226288 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 16 16:52:12.229477 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.229457 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 16:52:12.233036 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.231858 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-61.ec2.internal.18c2d34d811b028c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-61.ec2.internal,UID:ip-10-0-140-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-61.ec2.internal,},FirstTimestamp:2026-07-16 16:52:12.224111244 +0000 UTC m=+0.403367465,LastTimestamp:2026-07-16 16:52:12.224111244 +0000 UTC m=+0.403367465,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-61.ec2.internal,}" Jul 16 16:52:12.234654 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.234633 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 16:52:12.234746 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.234669 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 16:52:12.234811 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.234744 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 16 16:52:12.236333 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.235622 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 16:52:12.236333 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.235638 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 16:52:12.236333 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.235636 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 16:52:12.236333 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.235986 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 16 16:52:12.236333 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.235994 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 16 16:52:12.236333 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.236259 2563 factory.go:55] Registering systemd factory Jul 16 16:52:12.236333 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.236275 2563 factory.go:223] Registration of the systemd container factory successfully Jul 16 16:52:12.236718 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.236687 2563 factory.go:153] Registering CRI-O factory Jul 16 16:52:12.236718 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.236701 2563 factory.go:223] Registration of the crio container factory successfully Jul 16 16:52:12.236804 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.236750 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 16:52:12.236804 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.236771 2563 factory.go:103] Registering Raw factory Jul 16 16:52:12.236804 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.236784 2563 manager.go:1196] Started watching for new ooms in manager Jul 16 16:52:12.237456 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.237429 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 16:52:12.237593 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.237462 2563 manager.go:349] Starting recovery of all containers Jul 16 16:52:12.238681 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.238656 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 16:52:12.245937 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.245914 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jz6g2" Jul 16 16:52:12.248689 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.248477 2563 manager.go:354] Recovery completed Jul 16 16:52:12.254028 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.254009 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:12.254375 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.254359 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jz6g2" Jul 16 16:52:12.255967 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.255952 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:12.256040 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.255981 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:12.256040 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.255991 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:12.256565 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.256531 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 16:52:12.256565 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.256562 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 16:52:12.256699 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.256580 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 16 16:52:12.256699 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.256580 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:12.257335 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.257318 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:12.257422 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.257344 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:12.257422 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.257353 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:12.258006 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.257923 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-61.ec2.internal.18c2d34d83011671 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-61.ec2.internal,UID:ip-10-0-140-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-61.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-61.ec2.internal,},FirstTimestamp:2026-07-16 16:52:12.255966833 +0000 UTC m=+0.435223054,LastTimestamp:2026-07-16 16:52:12.255966833 +0000 UTC m=+0.435223054,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-61.ec2.internal,}" Jul 16 16:52:12.259371 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.259358 2563 policy_none.go:49] "None policy: Start" Jul 16 16:52:12.259432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.259375 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 16:52:12.259432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.259386 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 16:52:12.261393 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.261382 2563 policy_none.go:47] "Start" Jul 16 16:52:12.295231 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.295212 2563 manager.go:337] "Starting Device Plugin manager" Jul 16 16:52:12.295344 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.295247 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 16:52:12.295344 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.295261 2563 server.go:87] "Starting device plugin registration server" Jul 16 16:52:12.295760 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.295577 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 16:52:12.295760 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.295594 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 16:52:12.295760 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.295680 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 16:52:12.296265 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.295784 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 16:52:12.296265 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.295794 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 16:52:12.296365 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.296292 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 16:52:12.296365 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.296339 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-61.ec2.internal\" not found" Jul 16 16:52:12.341032 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.340972 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 16:52:12.342454 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.342434 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 16:52:12.342511 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.342484 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 16:52:12.342511 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.342510 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 16:52:12.342621 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.342570 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 16:52:12.345279 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.345255 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:12.396521 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.396434 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:12.397446 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.397431 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:12.397496 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.397461 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:12.397496 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.397472 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:12.397496 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.397495 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.408417 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.408389 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.408499 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.408420 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-61.ec2.internal\": node \"ip-10-0-140-61.ec2.internal\" not found" Jul 16 16:52:12.427142 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.427106 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 16 16:52:12.442802 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.442772 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"] Jul 16 16:52:12.442925 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.442849 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:12.443900 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.443879 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:12.444031 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.443908 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:12.444031 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.443925 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:12.446241 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.446226 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:12.446372 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.446342 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.446420 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.446383 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:12.447039 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.447014 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:12.447039 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.447038 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:12.447159 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.447047 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:12.447159 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.447068 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:12.447159 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.447094 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:12.447159 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.447108 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:12.449948 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.449931 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.450041 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.449964 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:12.450686 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.450672 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:12.450782 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.450696 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:12.450782 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.450706 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:12.473520 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.473488 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-61.ec2.internal\" not found" node="ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.477965 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.477944 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-61.ec2.internal\" not found" node="ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.527261 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.527231 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 16 16:52:12.537532 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.537506 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.537618 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.537540 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.537618 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.537578 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c90a46431eae6b3cdd7f5745d0d2187-config\") pod \"kube-apiserver-proxy-ip-10-0-140-61.ec2.internal\" (UID: \"5c90a46431eae6b3cdd7f5745d0d2187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.627560 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.627525 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 16 16:52:12.637892 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.637866 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.637940 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.637897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.637940 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.637916 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c90a46431eae6b3cdd7f5745d0d2187-config\") pod \"kube-apiserver-proxy-ip-10-0-140-61.ec2.internal\" (UID: \"5c90a46431eae6b3cdd7f5745d0d2187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.638004 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.637975 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.638032 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.638024 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.638061 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.638048 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c90a46431eae6b3cdd7f5745d0d2187-config\") pod \"kube-apiserver-proxy-ip-10-0-140-61.ec2.internal\" (UID: \"5c90a46431eae6b3cdd7f5745d0d2187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.728261 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.728230 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 16 16:52:12.775774 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.775750 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.780349 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:12.780335 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" Jul 16 16:52:12.828845 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.828807 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 16 16:52:12.929372 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:12.929346 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 16 16:52:13.030014 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:13.029964 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found" Jul 16 16:52:13.093282 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.093258 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:13.135468 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.135447 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" Jul 16 16:52:13.149466 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.149449 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 16:52:13.150749 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.150736 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" Jul 16 16:52:13.159619 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.159602 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 16:52:13.161738 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.161727 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 16:52:13.161849 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.161834 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 16:52:13.161886 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.161868 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 16:52:13.211046 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.211026 2563 apiserver.go:52] "Watching apiserver" Jul 16 16:52:13.223145 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.223124 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 16:52:13.224521 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.224068 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal","openshift-cluster-node-tuning-operator/tuned-zxjhw","openshift-dns/node-resolver-6mpfx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal","openshift-multus/multus-additional-cni-plugins-qfdn2","openshift-multus/multus-kpdjj","openshift-multus/network-metrics-daemon-p8bxj","kube-system/konnectivity-agent-2hd8z","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7","openshift-image-registry/node-ca-6fwnq","openshift-network-diagnostics/network-check-target-2ltgt","openshift-network-operator/iptables-alerter-zr6qr","openshift-ovn-kubernetes/ovnkube-node-j8z9j","kube-system/global-pull-secret-syncer-k4c97"] Jul 16 16:52:13.226856 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.226837 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6fwnq" Jul 16 16:52:13.228348 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.228330 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 16:52:13.228429 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.228368 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 16:52:13.228514 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.228498 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 16:52:13.228664 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.228651 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cn847\"" Jul 16 16:52:13.229132 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.229114 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:13.229209 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:13.229167 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:13.231142 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.231122 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2hd8z" Jul 16 16:52:13.232746 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.232728 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cllzh\"" Jul 16 16:52:13.232824 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.232776 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 16:52:13.232861 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.232852 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 16:52:13.233363 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.233348 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zr6qr" Jul 16 16:52:13.234746 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.234728 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:52:13.234819 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.234762 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 16:52:13.234900 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.234880 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 16:52:13.234971 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.234887 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2l8cc\"" Jul 16 16:52:13.234971 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.234950 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 16:52:13.235988 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.235972 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:13.236055 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:13.236039 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:13.238737 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.238722 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.240791 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.240772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6be25c0-d3f1-449a-9a74-5915c0ac7965-serviceca\") pod \"node-ca-6fwnq\" (UID: \"e6be25c0-d3f1-449a-9a74-5915c0ac7965\") " pod="openshift-image-registry/node-ca-6fwnq" Jul 16 16:52:13.240915 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.240800 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs\") pod \"network-metrics-daemon-p8bxj\" (UID: \"616b8d16-1b94-4015-bd70-d3f891934cc0\") " pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:13.240915 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.240826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-system-cni-dir\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.240915 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.240849 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-multus-socket-dir-parent\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.240915 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.240859 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.240915 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.240882 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-multus-conf-dir\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241161 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.240926 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6be25c0-d3f1-449a-9a74-5915c0ac7965-host\") pod \"node-ca-6fwnq\" (UID: \"e6be25c0-d3f1-449a-9a74-5915c0ac7965\") " pod="openshift-image-registry/node-ca-6fwnq" Jul 16 16:52:13.241161 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.240959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abaee616-fc40-40a2-8415-6c253b3e0c89-konnectivity-ca\") pod \"konnectivity-agent-2hd8z\" (UID: \"abaee616-fc40-40a2-8415-6c253b3e0c89\") " pod="kube-system/konnectivity-agent-2hd8z" Jul 16 16:52:13.241161 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.240986 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgfd7\" (UniqueName: \"kubernetes.io/projected/616b8d16-1b94-4015-bd70-d3f891934cc0-kube-api-access-mgfd7\") pod \"network-metrics-daemon-p8bxj\" (UID: \"616b8d16-1b94-4015-bd70-d3f891934cc0\") " pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:13.241161 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-os-release\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241161 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241040 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-run-netns\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241161 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241066 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abaee616-fc40-40a2-8415-6c253b3e0c89-agent-certs\") pod \"konnectivity-agent-2hd8z\" (UID: \"abaee616-fc40-40a2-8415-6c253b3e0c89\") " pod="kube-system/konnectivity-agent-2hd8z" Jul 16 16:52:13.241161 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e99c497-e769-4773-8777-6643fafc9bb6-iptables-alerter-script\") pod \"iptables-alerter-zr6qr\" (UID: \"3e99c497-e769-4773-8777-6643fafc9bb6\") " pod="openshift-network-operator/iptables-alerter-zr6qr" Jul 16 16:52:13.241161 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241112 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-cnibin\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241161 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58rxk\" (UniqueName: \"kubernetes.io/projected/e6be25c0-d3f1-449a-9a74-5915c0ac7965-kube-api-access-58rxk\") pod \"node-ca-6fwnq\" (UID: \"e6be25c0-d3f1-449a-9a74-5915c0ac7965\") " pod="openshift-image-registry/node-ca-6fwnq" Jul 16 16:52:13.241161 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e99c497-e769-4773-8777-6643fafc9bb6-host-slash\") pod \"iptables-alerter-zr6qr\" (UID: \"3e99c497-e769-4773-8777-6643fafc9bb6\") " pod="openshift-network-operator/iptables-alerter-zr6qr" Jul 16 16:52:13.241510 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-var-lib-cni-bin\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241510 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241204 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-var-lib-kubelet\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241510 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-hostroot\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241510 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-run-multus-certs\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241510 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241271 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2g8k\" (UniqueName: \"kubernetes.io/projected/2d717853-81cb-4975-8c68-fea79c880f46-kube-api-access-c2g8k\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241510 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d717853-81cb-4975-8c68-fea79c880f46-cni-binary-copy\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241510 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241317 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-var-lib-cni-multus\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241510 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d717853-81cb-4975-8c68-fea79c880f46-multus-daemon-config\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241510 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241364 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-etc-kubernetes\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241510 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241388 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g8sn\" (UniqueName: \"kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn\") pod \"network-check-target-2ltgt\" (UID: \"ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54\") " pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:13.241510 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241435 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-multus-cni-dir\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241510 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241454 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-run-k8s-cni-cncf-io\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.241510 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.241479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zksj2\" (UniqueName: \"kubernetes.io/projected/3e99c497-e769-4773-8777-6643fafc9bb6-kube-api-access-zksj2\") pod \"iptables-alerter-zr6qr\" (UID: \"3e99c497-e769-4773-8777-6643fafc9bb6\") " pod="openshift-network-operator/iptables-alerter-zr6qr" Jul 16 16:52:13.242300 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.242284 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 16:52:13.242374 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.242339 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gt56w\"" Jul 16 16:52:13.242374 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.242347 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 16:52:13.242473 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.242387 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 16:52:13.242473 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.242401 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 16:52:13.243108 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.243089 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 16:52:13.243201 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.243158 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 16:52:13.243201 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.243179 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bnnz8\"" Jul 16 16:52:13.243306 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.243293 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 16:52:13.243390 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.243373 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.245192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.245174 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 16:52:13.245298 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.245280 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 16:52:13.245362 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.245300 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 16:52:13.245362 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.245311 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 16:52:13.245362 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.245326 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 16:52:13.245362 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.245360 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 16:52:13.245571 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.245411 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mxf8b\"" Jul 16 16:52:13.245771 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.245756 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.247101 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.247084 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:13.247775 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.247754 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:52:13.247844 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.247805 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dnsx9\"" Jul 16 16:52:13.247884 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.247861 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 16:52:13.248575 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.248560 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.249976 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.249960 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 16:52:13.250128 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.250115 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 16:52:13.250173 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.250142 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5k765\"" Jul 16 16:52:13.251184 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.251164 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6mpfx" Jul 16 16:52:13.253361 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.253119 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 16:52:13.253361 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.253188 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v7nsp\"" Jul 16 16:52:13.253361 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.253250 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 16:52:13.255269 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.254233 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 16:52:13.255269 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.254717 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:13.255269 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:13.254799 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:13.259069 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.259022 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 16:47:13 +0000 UTC" deadline="2028-04-16 09:41:35.031125204 +0000 UTC" Jul 16 16:52:13.259069 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.259067 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15352h49m21.772060109s" Jul 16 16:52:13.267350 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.267330 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2nb9l" Jul 16 16:52:13.274960 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.274932 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2nb9l" Jul 16 16:52:13.337166 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.337137 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 16:52:13.341837 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.341818 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-cni-netd\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.341922 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.341848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-var-lib-cni-multus\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.341922 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.341868 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d717853-81cb-4975-8c68-fea79c880f46-multus-daemon-config\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.341922 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.341893 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8749d82-f357-4897-82e5-7a4a02e757f0-system-cni-dir\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.341922 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.341915 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmk8m\" (UniqueName: \"kubernetes.io/projected/f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a-kube-api-access-pmk8m\") pod \"node-resolver-6mpfx\" (UID: \"f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a\") " pod="openshift-dns/node-resolver-6mpfx" Jul 16 16:52:13.342049 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.341931 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-var-lib-cni-multus\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.342049 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.341956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-systemd-units\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.342049 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.341987 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-run-netns\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.342049 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342019 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-modprobe-d\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.342049 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342040 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-lib-modules\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.342241 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-run-k8s-cni-cncf-io\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.342241 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-host\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.342241 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342105 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w55jr\" (UniqueName: \"kubernetes.io/projected/eb57aa64-5197-46a7-ae33-4b2f8e9817de-kube-api-access-w55jr\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.342241 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342154 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-run-k8s-cni-cncf-io\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.342241 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342180 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-etc-openvswitch\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.342241 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342198 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-cni-bin\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.342241 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342213 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-tuned\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.342241 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342229 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs\") pod \"network-metrics-daemon-p8bxj\" (UID: \"616b8d16-1b94-4015-bd70-d3f891934cc0\") " pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342244 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-system-cni-dir\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-multus-socket-dir-parent\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342283 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-multus-conf-dir\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abaee616-fc40-40a2-8415-6c253b3e0c89-konnectivity-ca\") pod \"konnectivity-agent-2hd8z\" (UID: \"abaee616-fc40-40a2-8415-6c253b3e0c89\") " pod="kube-system/konnectivity-agent-2hd8z" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:13.342303 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342313 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgfd7\" (UniqueName: \"kubernetes.io/projected/616b8d16-1b94-4015-bd70-d3f891934cc0-kube-api-access-mgfd7\") pod \"network-metrics-daemon-p8bxj\" (UID: \"616b8d16-1b94-4015-bd70-d3f891934cc0\") " pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342328 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-system-cni-dir\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342328 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-kubelet\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342355 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-multus-socket-dir-parent\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342366 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d717853-81cb-4975-8c68-fea79c880f46-multus-daemon-config\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342364 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-multus-conf-dir\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:13.342372 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs podName:616b8d16-1b94-4015-bd70-d3f891934cc0 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:13.842352231 +0000 UTC m=+2.021608453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs") pod "network-metrics-daemon-p8bxj" (UID: "616b8d16-1b94-4015-bd70-d3f891934cc0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342431 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-os-release\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342468 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8749d82-f357-4897-82e5-7a4a02e757f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342494 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-slash\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342487 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-os-release\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.342661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-run-systemd\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-var-lib-openvswitch\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342587 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb69eacb-ddea-492f-93e0-91625661c1e3-ovnkube-config\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342604 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58rxk\" (UniqueName: \"kubernetes.io/projected/e6be25c0-d3f1-449a-9a74-5915c0ac7965-kube-api-access-58rxk\") pod \"node-ca-6fwnq\" (UID: \"e6be25c0-d3f1-449a-9a74-5915c0ac7965\") " pod="openshift-image-registry/node-ca-6fwnq" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342625 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e99c497-e769-4773-8777-6643fafc9bb6-host-slash\") pod \"iptables-alerter-zr6qr\" (UID: \"3e99c497-e769-4773-8777-6643fafc9bb6\") " pod="openshift-network-operator/iptables-alerter-zr6qr" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342647 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342669 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb69eacb-ddea-492f-93e0-91625661c1e3-ovnkube-script-lib\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-sysctl-conf\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342689 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e99c497-e769-4773-8777-6643fafc9bb6-host-slash\") pod \"iptables-alerter-zr6qr\" (UID: \"3e99c497-e769-4773-8777-6643fafc9bb6\") " pod="openshift-network-operator/iptables-alerter-zr6qr" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342730 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-var-lib-cni-bin\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-var-lib-kubelet\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342790 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-var-lib-kubelet\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342818 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-var-lib-cni-bin\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342842 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8749d82-f357-4897-82e5-7a4a02e757f0-os-release\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342863 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a-hosts-file\") pod \"node-resolver-6mpfx\" (UID: \"f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a\") " pod="openshift-dns/node-resolver-6mpfx" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d717853-81cb-4975-8c68-fea79c880f46-cni-binary-copy\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342895 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-etc-kubernetes\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.343360 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342894 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abaee616-fc40-40a2-8415-6c253b3e0c89-konnectivity-ca\") pod \"konnectivity-agent-2hd8z\" (UID: \"abaee616-fc40-40a2-8415-6c253b3e0c89\") " pod="kube-system/konnectivity-agent-2hd8z" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342920 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8sn\" (UniqueName: \"kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn\") pod \"network-check-target-2ltgt\" (UID: \"ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54\") " pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342939 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-etc-kubernetes\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342957 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-registration-dir\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342979 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-kubernetes\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.342993 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-sysctl-d\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343006 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-var-lib-kubelet\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-multus-cni-dir\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343054 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zksj2\" (UniqueName: \"kubernetes.io/projected/3e99c497-e769-4773-8777-6643fafc9bb6-kube-api-access-zksj2\") pod \"iptables-alerter-zr6qr\" (UID: \"3e99c497-e769-4773-8777-6643fafc9bb6\") " pod="openshift-network-operator/iptables-alerter-zr6qr" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343081 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-device-dir\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-sys-fs\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343129 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-multus-cni-dir\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343164 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdwlq\" (UniqueName: \"kubernetes.io/projected/fb69eacb-ddea-492f-93e0-91625661c1e3-kube-api-access-jdwlq\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343192 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-run-ovn\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343241 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.343986 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343268 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-systemd\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb57aa64-5197-46a7-ae33-4b2f8e9817de-tmp\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6be25c0-d3f1-449a-9a74-5915c0ac7965-serviceca\") pod \"node-ca-6fwnq\" (UID: \"e6be25c0-d3f1-449a-9a74-5915c0ac7965\") " pod="openshift-image-registry/node-ca-6fwnq" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343334 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d717853-81cb-4975-8c68-fea79c880f46-cni-binary-copy\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343343 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-socket-dir\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g6s4\" (UniqueName: \"kubernetes.io/projected/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-kube-api-access-6g6s4\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343413 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-dbus\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343426 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-run-openvswitch\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-node-log\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343452 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb69eacb-ddea-492f-93e0-91625661c1e3-ovn-node-metrics-cert\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343476 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-sysconfig\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6be25c0-d3f1-449a-9a74-5915c0ac7965-host\") pod \"node-ca-6fwnq\" (UID: \"e6be25c0-d3f1-449a-9a74-5915c0ac7965\") " pod="openshift-image-registry/node-ca-6fwnq" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343536 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6be25c0-d3f1-449a-9a74-5915c0ac7965-host\") pod \"node-ca-6fwnq\" (UID: \"e6be25c0-d3f1-449a-9a74-5915c0ac7965\") " pod="openshift-image-registry/node-ca-6fwnq" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-etc-selinux\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8749d82-f357-4897-82e5-7a4a02e757f0-cnibin\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343604 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a8749d82-f357-4897-82e5-7a4a02e757f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343622 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-run-netns\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.344583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343636 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abaee616-fc40-40a2-8415-6c253b3e0c89-agent-certs\") pod \"konnectivity-agent-2hd8z\" (UID: \"abaee616-fc40-40a2-8415-6c253b3e0c89\") " pod="kube-system/konnectivity-agent-2hd8z" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343665 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-run-netns\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343690 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e6be25c0-d3f1-449a-9a74-5915c0ac7965-serviceca\") pod \"node-ca-6fwnq\" (UID: \"e6be25c0-d3f1-449a-9a74-5915c0ac7965\") " pod="openshift-image-registry/node-ca-6fwnq" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343702 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e99c497-e769-4773-8777-6643fafc9bb6-iptables-alerter-script\") pod \"iptables-alerter-zr6qr\" (UID: \"3e99c497-e769-4773-8777-6643fafc9bb6\") " pod="openshift-network-operator/iptables-alerter-zr6qr" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343789 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a8749d82-f357-4897-82e5-7a4a02e757f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-log-socket\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343893 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb69eacb-ddea-492f-93e0-91625661c1e3-env-overrides\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343920 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-cnibin\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8749d82-f357-4897-82e5-7a4a02e757f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s67gq\" (UniqueName: \"kubernetes.io/projected/a8749d82-f357-4897-82e5-7a4a02e757f0-kube-api-access-s67gq\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343940 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343970 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a-tmp-dir\") pod \"node-resolver-6mpfx\" (UID: \"f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a\") " pod="openshift-dns/node-resolver-6mpfx" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343987 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-cnibin\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.343992 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-run\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.344013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-sys\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.344034 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-hostroot\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.344049 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-run-multus-certs\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.345192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.344063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2g8k\" (UniqueName: \"kubernetes.io/projected/2d717853-81cb-4975-8c68-fea79c880f46-kube-api-access-c2g8k\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.345732 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.344079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-kubelet-config\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:13.345732 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.344108 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.345732 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.344129 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e99c497-e769-4773-8777-6643fafc9bb6-iptables-alerter-script\") pod \"iptables-alerter-zr6qr\" (UID: \"3e99c497-e769-4773-8777-6643fafc9bb6\") " pod="openshift-network-operator/iptables-alerter-zr6qr" Jul 16 16:52:13.345732 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.344131 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-hostroot\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.345732 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.344250 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d717853-81cb-4975-8c68-fea79c880f46-host-run-multus-certs\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.346990 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.346970 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abaee616-fc40-40a2-8415-6c253b3e0c89-agent-certs\") pod \"konnectivity-agent-2hd8z\" (UID: \"abaee616-fc40-40a2-8415-6c253b3e0c89\") " pod="kube-system/konnectivity-agent-2hd8z" Jul 16 16:52:13.351128 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:13.351110 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:13.351214 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:13.351133 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:13.351214 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:13.351146 2563 projected.go:196] Error preparing data for projected volume kube-api-access-5g8sn for pod openshift-network-diagnostics/network-check-target-2ltgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:13.351214 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:13.351204 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn podName:ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:13.851186133 +0000 UTC m=+2.030442357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5g8sn" (UniqueName: "kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn") pod "network-check-target-2ltgt" (UID: "ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:13.352025 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.351992 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgfd7\" (UniqueName: \"kubernetes.io/projected/616b8d16-1b94-4015-bd70-d3f891934cc0-kube-api-access-mgfd7\") pod \"network-metrics-daemon-p8bxj\" (UID: \"616b8d16-1b94-4015-bd70-d3f891934cc0\") " pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:13.353199 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.353175 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zksj2\" (UniqueName: \"kubernetes.io/projected/3e99c497-e769-4773-8777-6643fafc9bb6-kube-api-access-zksj2\") pod \"iptables-alerter-zr6qr\" (UID: \"3e99c497-e769-4773-8777-6643fafc9bb6\") " pod="openshift-network-operator/iptables-alerter-zr6qr" Jul 16 16:52:13.353331 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.353312 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58rxk\" (UniqueName: \"kubernetes.io/projected/e6be25c0-d3f1-449a-9a74-5915c0ac7965-kube-api-access-58rxk\") pod \"node-ca-6fwnq\" (UID: \"e6be25c0-d3f1-449a-9a74-5915c0ac7965\") " pod="openshift-image-registry/node-ca-6fwnq" Jul 16 16:52:13.361168 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.361141 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2g8k\" (UniqueName: \"kubernetes.io/projected/2d717853-81cb-4975-8c68-fea79c880f46-kube-api-access-c2g8k\") pod \"multus-kpdjj\" (UID: \"2d717853-81cb-4975-8c68-fea79c880f46\") " pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.366647 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.366631 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:13.426108 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:13.426073 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc0c7a3681d7c042fbc0dd13cac7333.slice/crio-966e0a181fd0dfb094d75e35b73135f4edd6a2efb78617fbf498fdc41575dc6c WatchSource:0}: Error finding container 966e0a181fd0dfb094d75e35b73135f4edd6a2efb78617fbf498fdc41575dc6c: Status 404 returned error can't find the container with id 966e0a181fd0dfb094d75e35b73135f4edd6a2efb78617fbf498fdc41575dc6c Jul 16 16:52:13.430994 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.430979 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 16:52:13.444864 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.444844 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-kubernetes\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.444963 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.444872 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-sysctl-d\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.444963 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.444887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-var-lib-kubelet\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.444963 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.444903 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-device-dir\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.444963 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.444917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-sys-fs\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.444963 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.444931 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:13.444963 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.444945 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdwlq\" (UniqueName: \"kubernetes.io/projected/fb69eacb-ddea-492f-93e0-91625661c1e3-kube-api-access-jdwlq\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.444967 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-run-ovn\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.444973 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-kubernetes\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.444990 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445001 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-device-dir\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445014 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-systemd\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445002 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-var-lib-kubelet\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445022 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-sysctl-d\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445040 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-sys-fs\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445044 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-run-ovn\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445048 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb57aa64-5197-46a7-ae33-4b2f8e9817de-tmp\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:13.445063 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445063 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445104 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-socket-dir\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445134 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g6s4\" (UniqueName: \"kubernetes.io/projected/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-kube-api-access-6g6s4\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:13.445159 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret podName:affdec92-dfd2-49b0-878a-4ef13cc5bfa0 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:13.945143181 +0000 UTC m=+2.124399394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret") pod "global-pull-secret-syncer-k4c97" (UID: "affdec92-dfd2-49b0-878a-4ef13cc5bfa0") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:13.445211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445173 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-systemd\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445222 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-socket-dir\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445263 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-dbus\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445293 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-run-openvswitch\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445319 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-dbus\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445337 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-node-log\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb69eacb-ddea-492f-93e0-91625661c1e3-ovn-node-metrics-cert\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445365 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-run-openvswitch\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445388 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-sysconfig\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445404 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-node-log\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445422 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-etc-selinux\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445446 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8749d82-f357-4897-82e5-7a4a02e757f0-cnibin\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445470 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-sysconfig\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445472 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a8749d82-f357-4897-82e5-7a4a02e757f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445520 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8749d82-f357-4897-82e5-7a4a02e757f0-cnibin\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a8749d82-f357-4897-82e5-7a4a02e757f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445572 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-etc-selinux\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.446058 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445610 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-log-socket\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445669 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb69eacb-ddea-492f-93e0-91625661c1e3-env-overrides\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445696 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8749d82-f357-4897-82e5-7a4a02e757f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445722 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s67gq\" (UniqueName: \"kubernetes.io/projected/a8749d82-f357-4897-82e5-7a4a02e757f0-kube-api-access-s67gq\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445738 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-log-socket\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445747 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a-tmp-dir\") pod \"node-resolver-6mpfx\" (UID: \"f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a\") " pod="openshift-dns/node-resolver-6mpfx" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-run\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-sys\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-kubelet-config\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445838 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-cni-netd\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445887 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8749d82-f357-4897-82e5-7a4a02e757f0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445911 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-cni-netd\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445960 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-kubelet-config\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446003 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446053 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-run\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.445924 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-sys\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.447220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8749d82-f357-4897-82e5-7a4a02e757f0-system-cni-dir\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446113 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmk8m\" (UniqueName: \"kubernetes.io/projected/f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a-kube-api-access-pmk8m\") pod \"node-resolver-6mpfx\" (UID: \"f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a\") " pod="openshift-dns/node-resolver-6mpfx" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-systemd-units\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446188 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8749d82-f357-4897-82e5-7a4a02e757f0-system-cni-dir\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446193 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-run-netns\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446243 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a-tmp-dir\") pod \"node-resolver-6mpfx\" (UID: \"f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a\") " pod="openshift-dns/node-resolver-6mpfx" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446243 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-systemd-units\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446258 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-modprobe-d\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-lib-modules\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446310 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb69eacb-ddea-492f-93e0-91625661c1e3-env-overrides\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-host\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446323 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-run-netns\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446371 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w55jr\" (UniqueName: \"kubernetes.io/projected/eb57aa64-5197-46a7-ae33-4b2f8e9817de-kube-api-access-w55jr\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446378 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-host\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446404 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-etc-openvswitch\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446435 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-cni-bin\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446436 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-lib-modules\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-tuned\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.448104 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446507 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-etc-openvswitch\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446525 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-kubelet\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8749d82-f357-4897-82e5-7a4a02e757f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446596 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-slash\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446619 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-run-systemd\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-var-lib-openvswitch\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446643 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-kubelet\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446482 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-cni-bin\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb69eacb-ddea-492f-93e0-91625661c1e3-ovnkube-config\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446694 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446701 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-run-systemd\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446716 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb69eacb-ddea-492f-93e0-91625661c1e3-ovnkube-script-lib\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-sysctl-conf\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446742 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-host-slash\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446763 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8749d82-f357-4897-82e5-7a4a02e757f0-os-release\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446787 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a-hosts-file\") pod \"node-resolver-6mpfx\" (UID: \"f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a\") " pod="openshift-dns/node-resolver-6mpfx" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446827 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-registration-dir\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.448904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446847 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a8749d82-f357-4897-82e5-7a4a02e757f0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.449432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446911 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-registration-dir\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.449432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446914 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.449432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.446991 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8749d82-f357-4897-82e5-7a4a02e757f0-os-release\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.449432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.447017 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-sysctl-conf\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.449432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.447032 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb69eacb-ddea-492f-93e0-91625661c1e3-var-lib-openvswitch\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.449432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.447067 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a-hosts-file\") pod \"node-resolver-6mpfx\" (UID: \"f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a\") " pod="openshift-dns/node-resolver-6mpfx" Jul 16 16:52:13.449432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.447099 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-modprobe-d\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.449432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.447153 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb69eacb-ddea-492f-93e0-91625661c1e3-ovnkube-config\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.449432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.447169 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb69eacb-ddea-492f-93e0-91625661c1e3-ovnkube-script-lib\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.449432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.447518 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8749d82-f357-4897-82e5-7a4a02e757f0-cni-binary-copy\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.449432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.447524 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb57aa64-5197-46a7-ae33-4b2f8e9817de-tmp\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.449432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.447700 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb69eacb-ddea-492f-93e0-91625661c1e3-ovn-node-metrics-cert\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.449432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.448041 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a8749d82-f357-4897-82e5-7a4a02e757f0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.449432 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.448814 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb57aa64-5197-46a7-ae33-4b2f8e9817de-etc-tuned\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.453259 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.453234 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g6s4\" (UniqueName: \"kubernetes.io/projected/0c7b31dc-aa4a-41be-b3b6-b1878fd02f63-kube-api-access-6g6s4\") pod \"aws-ebs-csi-driver-node-gbsf7\" (UID: \"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:13.453667 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.453645 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdwlq\" (UniqueName: \"kubernetes.io/projected/fb69eacb-ddea-492f-93e0-91625661c1e3-kube-api-access-jdwlq\") pod \"ovnkube-node-j8z9j\" (UID: \"fb69eacb-ddea-492f-93e0-91625661c1e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:13.454129 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.454109 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w55jr\" (UniqueName: \"kubernetes.io/projected/eb57aa64-5197-46a7-ae33-4b2f8e9817de-kube-api-access-w55jr\") pod \"tuned-zxjhw\" (UID: \"eb57aa64-5197-46a7-ae33-4b2f8e9817de\") " pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:13.454228 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.454212 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmk8m\" (UniqueName: \"kubernetes.io/projected/f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a-kube-api-access-pmk8m\") pod \"node-resolver-6mpfx\" (UID: \"f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a\") " pod="openshift-dns/node-resolver-6mpfx" Jul 16 16:52:13.454396 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.454381 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s67gq\" (UniqueName: \"kubernetes.io/projected/a8749d82-f357-4897-82e5-7a4a02e757f0-kube-api-access-s67gq\") pod \"multus-additional-cni-plugins-qfdn2\" (UID: \"a8749d82-f357-4897-82e5-7a4a02e757f0\") " pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:13.554598 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.554520 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6fwnq" Jul 16 16:52:13.566647 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:13.566623 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6be25c0_d3f1_449a_9a74_5915c0ac7965.slice/crio-1e9a2c4c73f5f6309e936a78b4e905d1b0ba048d62f6b09a0859fcfbc51e1d99 WatchSource:0}: Error finding container 1e9a2c4c73f5f6309e936a78b4e905d1b0ba048d62f6b09a0859fcfbc51e1d99: Status 404 returned error can't find the container with id 1e9a2c4c73f5f6309e936a78b4e905d1b0ba048d62f6b09a0859fcfbc51e1d99 Jul 16 16:52:13.570632 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.570617 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2hd8z" Jul 16 16:52:13.578380 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:13.578357 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabaee616_fc40_40a2_8415_6c253b3e0c89.slice/crio-ac25ae54074e0f9ebcdb7019611fd8ec2bf8ab9d23c3e2791b2efdde39429991 WatchSource:0}: Error finding container ac25ae54074e0f9ebcdb7019611fd8ec2bf8ab9d23c3e2791b2efdde39429991: Status 404 returned error can't find the container with id ac25ae54074e0f9ebcdb7019611fd8ec2bf8ab9d23c3e2791b2efdde39429991 Jul 16 16:52:13.589501 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.589484 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zr6qr" Jul 16 16:52:13.590628 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:13.590610 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kpdjj" Jul 16 16:52:13.597905 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:13.597881 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e99c497_e769_4773_8777_6643fafc9bb6.slice/crio-4e730346cb5530db1ea6bae8761b5a8a728bf6a644e26862bed5c40c0235db92 WatchSource:0}: Error finding container 4e730346cb5530db1ea6bae8761b5a8a728bf6a644e26862bed5c40c0235db92: Status 404 returned error can't find the container with id 4e730346cb5530db1ea6bae8761b5a8a728bf6a644e26862bed5c40c0235db92 Jul 16 16:52:13.600922 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:13.600906 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d717853_81cb_4975_8c68_fea79c880f46.slice/crio-e8be205f497e98ba9163e09970475ae25a8f83227d4c3f5dfb7150607329efbc WatchSource:0}: Error finding container e8be205f497e98ba9163e09970475ae25a8f83227d4c3f5dfb7150607329efbc: Status 404 returned error can't find the container with id e8be205f497e98ba9163e09970475ae25a8f83227d4c3f5dfb7150607329efbc Jul 16 16:52:14.881593 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:14.881558 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" Jul 16 16:52:14.887647 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:14.887626 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:14.890417 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:14.890396 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7b31dc_aa4a_41be_b3b6_b1878fd02f63.slice/crio-3eabc514e780627fd2b280f67d2821babe1ecaa5f9b323a1b5f096c5bfb286c6 WatchSource:0}: Error finding container 3eabc514e780627fd2b280f67d2821babe1ecaa5f9b323a1b5f096c5bfb286c6: Status 404 returned error can't find the container with id 3eabc514e780627fd2b280f67d2821babe1ecaa5f9b323a1b5f096c5bfb286c6 Jul 16 16:52:14.896190 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:14.896171 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb69eacb_ddea_492f_93e0_91625661c1e3.slice/crio-8749be0a7f74d99d24c91bb000afcc40548a6d4f206493b29652bc2d4455e64d WatchSource:0}: Error finding container 8749be0a7f74d99d24c91bb000afcc40548a6d4f206493b29652bc2d4455e64d: Status 404 returned error can't find the container with id 8749be0a7f74d99d24c91bb000afcc40548a6d4f206493b29652bc2d4455e64d Jul 16 16:52:14.903185 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:14.903166 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" Jul 16 16:52:14.912186 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:14.912168 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb57aa64_5197_46a7_ae33_4b2f8e9817de.slice/crio-33b66f7999658968a9745cfaef79f907c16c8b494563641b43c3cb991fa5257c WatchSource:0}: Error finding container 33b66f7999658968a9745cfaef79f907c16c8b494563641b43c3cb991fa5257c: Status 404 returned error can't find the container with id 33b66f7999658968a9745cfaef79f907c16c8b494563641b43c3cb991fa5257c Jul 16 16:52:14.926635 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:14.926619 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qfdn2" Jul 16 16:52:14.931384 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:14.931366 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6mpfx" Jul 16 16:52:14.934179 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:14.934088 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8749d82_f357_4897_82e5_7a4a02e757f0.slice/crio-6922169e6ae64e0e5cda6abf9e109f6de85ceb0e6484eafe30d58ff18c4adbfc WatchSource:0}: Error finding container 6922169e6ae64e0e5cda6abf9e109f6de85ceb0e6484eafe30d58ff18c4adbfc: Status 404 returned error can't find the container with id 6922169e6ae64e0e5cda6abf9e109f6de85ceb0e6484eafe30d58ff18c4adbfc Jul 16 16:52:14.940720 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:14.940702 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89f9cf1_72d8_4f16_b4ac_4816fb07fc4a.slice/crio-ab7cafeb9c37713349a7ddd3225e353df0bc2df949e8e1c5162bb883cbe7b49e WatchSource:0}: Error finding container ab7cafeb9c37713349a7ddd3225e353df0bc2df949e8e1c5162bb883cbe7b49e: Status 404 returned error can't find the container with id ab7cafeb9c37713349a7ddd3225e353df0bc2df949e8e1c5162bb883cbe7b49e Jul 16 16:52:15.106076 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.105994 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs\") pod \"network-metrics-daemon-p8bxj\" (UID: \"616b8d16-1b94-4015-bd70-d3f891934cc0\") " pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:15.106208 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:15.106080 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:15.106208 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:15.106124 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs podName:616b8d16-1b94-4015-bd70-d3f891934cc0 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:16.106111903 +0000 UTC m=+3.029352070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs") pod "network-metrics-daemon-p8bxj" (UID: "616b8d16-1b94-4015-bd70-d3f891934cc0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:15.207043 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.207011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8sn\" (UniqueName: \"kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn\") pod \"network-check-target-2ltgt\" (UID: \"ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54\") " pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:15.207215 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.207060 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:15.207215 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:15.207158 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:15.207215 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:15.207182 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:15.207215 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:15.207195 2563 projected.go:196] Error preparing data for projected volume kube-api-access-5g8sn for pod openshift-network-diagnostics/network-check-target-2ltgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:15.207417 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:15.207219 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:15.207417 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:15.207259 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn podName:ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:16.20724155 +0000 UTC m=+3.130481734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5g8sn" (UniqueName: "kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn") pod "network-check-target-2ltgt" (UID: "ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:15.207417 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:15.207282 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret podName:affdec92-dfd2-49b0-878a-4ef13cc5bfa0 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:16.207271355 +0000 UTC m=+3.130511534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret") pod "global-pull-secret-syncer-k4c97" (UID: "affdec92-dfd2-49b0-878a-4ef13cc5bfa0") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:15.492106 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:15.492069 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c90a46431eae6b3cdd7f5745d0d2187.slice/crio-8eacfaf6a6d82ef6a8bef2d5cf25754b4425da8bca83e4c1958e9c6d22d61f3c WatchSource:0}: Error finding container 8eacfaf6a6d82ef6a8bef2d5cf25754b4425da8bca83e4c1958e9c6d22d61f3c: Status 404 returned error can't find the container with id 8eacfaf6a6d82ef6a8bef2d5cf25754b4425da8bca83e4c1958e9c6d22d61f3c Jul 16 16:52:15.533676 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.533636 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 16:47:14 +0000 UTC" deadline="2028-04-15 16:43:06.671048776 +0000 UTC" Jul 16 16:52:15.533676 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.533675 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15335h50m51.137378608s" Jul 16 16:52:15.585512 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.585487 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:15.624869 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.624748 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kpdjj" event={"ID":"2d717853-81cb-4975-8c68-fea79c880f46","Type":"ContainerStarted","Data":"e8be205f497e98ba9163e09970475ae25a8f83227d4c3f5dfb7150607329efbc"} Jul 16 16:52:15.639747 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.639717 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" event={"ID":"4bc0c7a3681d7c042fbc0dd13cac7333","Type":"ContainerStarted","Data":"966e0a181fd0dfb094d75e35b73135f4edd6a2efb78617fbf498fdc41575dc6c"} Jul 16 16:52:15.642388 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.642334 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6mpfx" event={"ID":"f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a","Type":"ContainerStarted","Data":"ab7cafeb9c37713349a7ddd3225e353df0bc2df949e8e1c5162bb883cbe7b49e"} Jul 16 16:52:15.644685 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.644659 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" event={"ID":"eb57aa64-5197-46a7-ae33-4b2f8e9817de","Type":"ContainerStarted","Data":"33b66f7999658968a9745cfaef79f907c16c8b494563641b43c3cb991fa5257c"} Jul 16 16:52:15.647072 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.647046 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" event={"ID":"fb69eacb-ddea-492f-93e0-91625661c1e3","Type":"ContainerStarted","Data":"8749be0a7f74d99d24c91bb000afcc40548a6d4f206493b29652bc2d4455e64d"} Jul 16 16:52:15.655022 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.654826 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" event={"ID":"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63","Type":"ContainerStarted","Data":"3eabc514e780627fd2b280f67d2821babe1ecaa5f9b323a1b5f096c5bfb286c6"} Jul 16 16:52:15.657326 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.657297 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zr6qr" event={"ID":"3e99c497-e769-4773-8777-6643fafc9bb6","Type":"ContainerStarted","Data":"4e730346cb5530db1ea6bae8761b5a8a728bf6a644e26862bed5c40c0235db92"} Jul 16 16:52:15.659295 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.659271 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2hd8z" event={"ID":"abaee616-fc40-40a2-8415-6c253b3e0c89","Type":"ContainerStarted","Data":"ac25ae54074e0f9ebcdb7019611fd8ec2bf8ab9d23c3e2791b2efdde39429991"} Jul 16 16:52:15.664298 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.664279 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6fwnq" event={"ID":"e6be25c0-d3f1-449a-9a74-5915c0ac7965","Type":"ContainerStarted","Data":"1e9a2c4c73f5f6309e936a78b4e905d1b0ba048d62f6b09a0859fcfbc51e1d99"} Jul 16 16:52:15.669579 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.669443 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" event={"ID":"5c90a46431eae6b3cdd7f5745d0d2187","Type":"ContainerStarted","Data":"8eacfaf6a6d82ef6a8bef2d5cf25754b4425da8bca83e4c1958e9c6d22d61f3c"} Jul 16 16:52:15.671124 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:15.671039 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdn2" event={"ID":"a8749d82-f357-4897-82e5-7a4a02e757f0","Type":"ContainerStarted","Data":"6922169e6ae64e0e5cda6abf9e109f6de85ceb0e6484eafe30d58ff18c4adbfc"} Jul 16 16:52:16.115184 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:16.115118 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs\") pod \"network-metrics-daemon-p8bxj\" (UID: \"616b8d16-1b94-4015-bd70-d3f891934cc0\") " pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:16.115357 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:16.115328 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:16.115420 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:16.115392 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs podName:616b8d16-1b94-4015-bd70-d3f891934cc0 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:18.115373327 +0000 UTC m=+5.038613540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs") pod "network-metrics-daemon-p8bxj" (UID: "616b8d16-1b94-4015-bd70-d3f891934cc0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:16.216017 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:16.215978 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8sn\" (UniqueName: \"kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn\") pod \"network-check-target-2ltgt\" (UID: \"ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54\") " pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:16.216198 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:16.216036 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:16.216198 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:16.216168 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:16.216198 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:16.216179 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:16.216198 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:16.216194 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:16.216440 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:16.216208 2563 projected.go:196] Error preparing data for projected volume kube-api-access-5g8sn for pod openshift-network-diagnostics/network-check-target-2ltgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:16.216440 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:16.216251 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret podName:affdec92-dfd2-49b0-878a-4ef13cc5bfa0 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:18.216230495 +0000 UTC m=+5.139470677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret") pod "global-pull-secret-syncer-k4c97" (UID: "affdec92-dfd2-49b0-878a-4ef13cc5bfa0") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:16.216440 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:16.216272 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn podName:ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:18.216263108 +0000 UTC m=+5.139503281 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5g8sn" (UniqueName: "kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn") pod "network-check-target-2ltgt" (UID: "ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:16.534649 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:16.534342 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 16:47:14 +0000 UTC" deadline="2028-03-02 04:07:38.241670395 +0000 UTC" Jul 16 16:52:16.534649 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:16.534400 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14267h15m21.707276379s" Jul 16 16:52:16.599637 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:16.599611 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:16.599809 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:16.599750 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:16.599876 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:16.599835 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:16.599922 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:16.599911 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:16.599977 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:16.599966 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:16.600072 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:16.600028 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:16.843147 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:16.843076 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:18.131814 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:18.131743 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs\") pod \"network-metrics-daemon-p8bxj\" (UID: \"616b8d16-1b94-4015-bd70-d3f891934cc0\") " pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:18.132282 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:18.131924 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:18.132282 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:18.131990 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs podName:616b8d16-1b94-4015-bd70-d3f891934cc0 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:22.131970645 +0000 UTC m=+9.055210830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs") pod "network-metrics-daemon-p8bxj" (UID: "616b8d16-1b94-4015-bd70-d3f891934cc0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:18.232541 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:18.232501 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8sn\" (UniqueName: \"kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn\") pod \"network-check-target-2ltgt\" (UID: \"ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54\") " pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:18.232735 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:18.232553 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:18.232735 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:18.232707 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:18.232840 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:18.232769 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret podName:affdec92-dfd2-49b0-878a-4ef13cc5bfa0 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:22.232750169 +0000 UTC m=+9.155990343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret") pod "global-pull-secret-syncer-k4c97" (UID: "affdec92-dfd2-49b0-878a-4ef13cc5bfa0") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:18.233206 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:18.233186 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:18.233277 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:18.233212 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:18.233277 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:18.233224 2563 projected.go:196] Error preparing data for projected volume kube-api-access-5g8sn for pod openshift-network-diagnostics/network-check-target-2ltgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:18.233277 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:18.233271 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn podName:ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:22.233256411 +0000 UTC m=+9.156496582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5g8sn" (UniqueName: "kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn") pod "network-check-target-2ltgt" (UID: "ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:18.599290 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:18.599254 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:18.599473 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:18.599395 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:18.599811 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:18.599790 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:18.600067 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:18.599888 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:18.600067 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:18.599948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:18.600067 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:18.600023 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:20.598898 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:20.598870 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:20.598898 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:20.598897 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:20.599498 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:20.598999 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:20.599550 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:20.599513 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:20.599634 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:20.599588 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:20.599689 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:20.599670 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:22.165768 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:22.165225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs\") pod \"network-metrics-daemon-p8bxj\" (UID: \"616b8d16-1b94-4015-bd70-d3f891934cc0\") " pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:22.165768 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:22.165399 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:22.165768 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:22.165455 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs podName:616b8d16-1b94-4015-bd70-d3f891934cc0 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:30.165433819 +0000 UTC m=+17.088674000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs") pod "network-metrics-daemon-p8bxj" (UID: "616b8d16-1b94-4015-bd70-d3f891934cc0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:22.266913 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:22.266132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8sn\" (UniqueName: \"kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn\") pod \"network-check-target-2ltgt\" (UID: \"ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54\") " pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:22.266913 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:22.266184 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:22.266913 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:22.266322 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:22.266913 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:22.266381 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret podName:affdec92-dfd2-49b0-878a-4ef13cc5bfa0 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:30.266364414 +0000 UTC m=+17.189604596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret") pod "global-pull-secret-syncer-k4c97" (UID: "affdec92-dfd2-49b0-878a-4ef13cc5bfa0") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:22.266913 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:22.266765 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:22.266913 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:22.266783 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:22.266913 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:22.266795 2563 projected.go:196] Error preparing data for projected volume kube-api-access-5g8sn for pod openshift-network-diagnostics/network-check-target-2ltgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:22.266913 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:22.266840 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn podName:ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:30.266826329 +0000 UTC m=+17.190066511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5g8sn" (UniqueName: "kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn") pod "network-check-target-2ltgt" (UID: "ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:22.600406 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:22.599680 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:22.600406 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:22.599795 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:22.600406 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:22.600126 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:22.600406 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:22.600211 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:22.600406 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:22.600263 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:22.600406 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:22.600330 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:24.599592 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:24.599337 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:24.600019 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:24.599370 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:24.600019 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:24.599713 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:24.600019 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:24.599378 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:24.600019 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:24.599789 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:24.600019 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:24.599865 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:26.598964 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:26.598927 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:26.599332 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:26.598964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:26.599332 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:26.598964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:26.599332 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:26.599067 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:26.599332 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:26.599124 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:26.599332 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:26.599186 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:28.598920 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:28.598879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:28.598920 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:28.598914 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:28.599408 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:28.598879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:28.599408 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:28.599078 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:28.599495 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:28.599459 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:28.599530 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:28.599517 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:30.222229 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:30.222173 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs\") pod \"network-metrics-daemon-p8bxj\" (UID: \"616b8d16-1b94-4015-bd70-d3f891934cc0\") " pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:30.222699 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:30.222305 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:30.222699 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:30.222374 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs podName:616b8d16-1b94-4015-bd70-d3f891934cc0 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:46.222355014 +0000 UTC m=+33.145595198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs") pod "network-metrics-daemon-p8bxj" (UID: "616b8d16-1b94-4015-bd70-d3f891934cc0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:30.323219 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:30.323181 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8sn\" (UniqueName: \"kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn\") pod \"network-check-target-2ltgt\" (UID: \"ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54\") " pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:30.323383 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:30.323231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:30.323383 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:30.323361 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:30.323383 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:30.323368 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:30.323556 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:30.323388 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:30.323556 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:30.323399 2563 projected.go:196] Error preparing data for projected volume kube-api-access-5g8sn for pod openshift-network-diagnostics/network-check-target-2ltgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:30.323556 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:30.323427 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret podName:affdec92-dfd2-49b0-878a-4ef13cc5bfa0 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:46.323407212 +0000 UTC m=+33.246647379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret") pod "global-pull-secret-syncer-k4c97" (UID: "affdec92-dfd2-49b0-878a-4ef13cc5bfa0") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:30.323556 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:30.323447 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn podName:ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:46.323437626 +0000 UTC m=+33.246677808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5g8sn" (UniqueName: "kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn") pod "network-check-target-2ltgt" (UID: "ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:30.599539 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:30.599409 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:30.599539 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:30.599525 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:30.599805 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:30.599638 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:30.599805 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:30.599527 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:30.599805 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:30.599532 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:30.599805 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:30.599775 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:32.599281 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:32.599253 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:32.599778 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:32.599253 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:32.599778 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:32.599379 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:32.599778 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:32.599422 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:32.599778 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:32.599506 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:32.599778 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:32.599608 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:34.598818 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:34.598778 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:34.599270 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:34.598912 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:34.599270 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:34.598914 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:34.599270 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:34.598916 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:34.599270 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:34.599020 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:34.599270 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:34.599111 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:36.599412 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.599246 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:36.599970 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.599291 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:36.599970 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:36.599494 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:36.599970 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:36.599632 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:36.599970 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.599316 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:36.599970 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:36.599752 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:36.718095 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.718060 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" event={"ID":"5c90a46431eae6b3cdd7f5745d0d2187","Type":"ContainerStarted","Data":"b4b4a50ec110c9271d481c93c050466fff0fde504a0c071e3714672010dafe6f"} Jul 16 16:52:36.720423 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.720382 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kpdjj" event={"ID":"2d717853-81cb-4975-8c68-fea79c880f46","Type":"ContainerStarted","Data":"0fc07bdfefc84053031443e3507ea445a14e59bea5103e56778417bf337a1ea5"} Jul 16 16:52:36.722393 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.722368 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" event={"ID":"eb57aa64-5197-46a7-ae33-4b2f8e9817de","Type":"ContainerStarted","Data":"73a5322d4cebc2cb83699ac5f0fd18d3bc503c2f5b26d0c7e09964b9d8b5dfc7"} Jul 16 16:52:36.725435 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.725414 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/ovn-acl-logging/0.log" Jul 16 16:52:36.725867 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.725850 2563 generic.go:356] "Generic (PLEG): container finished" podID="fb69eacb-ddea-492f-93e0-91625661c1e3" containerID="52aed996f03c69ba8825ffe85734b4903c639023c368a32abf32303fe9c8e492" exitCode=1 Jul 16 16:52:36.725944 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.725879 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" event={"ID":"fb69eacb-ddea-492f-93e0-91625661c1e3","Type":"ContainerStarted","Data":"16dcfcd72273d4d2b7b0ba372a0307e7fc3abc249dad75a67b2b2f0395b5831d"} Jul 16 16:52:36.725944 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.725923 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" event={"ID":"fb69eacb-ddea-492f-93e0-91625661c1e3","Type":"ContainerStarted","Data":"b43c6ae318b81d3c285a5840a0e2f17c5b87094333c74fd1887d8832012a587d"} Jul 16 16:52:36.726017 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.725951 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" event={"ID":"fb69eacb-ddea-492f-93e0-91625661c1e3","Type":"ContainerStarted","Data":"fc05d22258ea0ca9221fe1e0ee92f537c105dec372c1d97cf054a0a9de09c69b"} Jul 16 16:52:36.726017 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.725979 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" event={"ID":"fb69eacb-ddea-492f-93e0-91625661c1e3","Type":"ContainerStarted","Data":"385c6dca75d47803592c6876c5f4d3260bce98b79cea82354eec9557d24d7201"} Jul 16 16:52:36.726017 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.726006 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" event={"ID":"fb69eacb-ddea-492f-93e0-91625661c1e3","Type":"ContainerDied","Data":"52aed996f03c69ba8825ffe85734b4903c639023c368a32abf32303fe9c8e492"} Jul 16 16:52:36.726117 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.726034 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" event={"ID":"fb69eacb-ddea-492f-93e0-91625661c1e3","Type":"ContainerStarted","Data":"6990a354fa002da9712f2532ebf011c24a2263229f05e05f83feec3e779715ff"} Jul 16 16:52:36.732332 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.732225 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" podStartSLOduration=22.73221371 podStartE2EDuration="22.73221371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:52:36.731656416 +0000 UTC m=+23.654896606" watchObservedRunningTime="2026-07-16 16:52:36.73221371 +0000 UTC m=+23.655453899" Jul 16 16:52:36.748044 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.747906 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kpdjj" podStartSLOduration=2.800967413 podStartE2EDuration="23.747889817s" totalImagesPullingTime="20.946922404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:52:36.747640811 +0000 UTC m=+23.670881001" watchObservedRunningTime="2026-07-16 16:52:36.747889817 +0000 UTC m=+23.671130008" Jul 16 16:52:36.763482 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:36.763428 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zxjhw" podStartSLOduration=3.128982466 podStartE2EDuration="23.763418663s" totalImagesPullingTime="20.634436197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:52:36.763050871 +0000 UTC m=+23.686291080" watchObservedRunningTime="2026-07-16 16:52:36.763418663 +0000 UTC m=+23.686658863" Jul 16 16:52:37.601896 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:37.601720 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:37.602343 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:37.601964 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:37.729248 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:37.729212 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" event={"ID":"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63","Type":"ContainerStarted","Data":"8c04722cc6cdb232c05400006fc63d16f4a6622fb40948952ec84d907ec05389"} Jul 16 16:52:37.730630 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:37.730606 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zr6qr" event={"ID":"3e99c497-e769-4773-8777-6643fafc9bb6","Type":"ContainerStarted","Data":"e647636bd4b246b1b4a3c289b7bc127dae57bf9e2ea23985023b64474c1208d7"} Jul 16 16:52:37.732019 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:37.731994 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2hd8z" event={"ID":"abaee616-fc40-40a2-8415-6c253b3e0c89","Type":"ContainerStarted","Data":"6ff5cc9c3d8991081cfb9c34dcb96e08a84da1ec0c3971e91487e9558052d9fd"} Jul 16 16:52:37.733218 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:37.733197 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6fwnq" event={"ID":"e6be25c0-d3f1-449a-9a74-5915c0ac7965","Type":"ContainerStarted","Data":"4ed9ad099a05453695f1d7f4b238349ed8fc0a300c5c44b64ce8a531029daebd"} Jul 16 16:52:37.734635 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:37.734613 2563 generic.go:356] "Generic (PLEG): container finished" podID="a8749d82-f357-4897-82e5-7a4a02e757f0" containerID="6035b34a5737be433ef19c94ccbab5814f8c8c614dcc97e8da746905b80edad6" exitCode=0 Jul 16 16:52:37.734723 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:37.734681 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdn2" event={"ID":"a8749d82-f357-4897-82e5-7a4a02e757f0","Type":"ContainerDied","Data":"6035b34a5737be433ef19c94ccbab5814f8c8c614dcc97e8da746905b80edad6"} Jul 16 16:52:37.736173 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:37.736152 2563 generic.go:356] "Generic (PLEG): container finished" podID="4bc0c7a3681d7c042fbc0dd13cac7333" containerID="c82da40f99c221cd39d2a29b20c7196e9cf2a99699d525bb3d911e1612f4701d" exitCode=0 Jul 16 16:52:37.736248 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:37.736228 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" event={"ID":"4bc0c7a3681d7c042fbc0dd13cac7333","Type":"ContainerDied","Data":"c82da40f99c221cd39d2a29b20c7196e9cf2a99699d525bb3d911e1612f4701d"} Jul 16 16:52:37.737634 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:37.737606 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6mpfx" event={"ID":"f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a","Type":"ContainerStarted","Data":"d57013b9aee1fa9a6ac51280a4faa43c0d3543aad80921701b57323ac8142c2a"} Jul 16 16:52:37.745811 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:37.745774 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zr6qr" podStartSLOduration=4.048923742 podStartE2EDuration="24.745762235s" totalImagesPullingTime="20.696838493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:52:37.745532671 +0000 UTC m=+24.668772859" watchObservedRunningTime="2026-07-16 16:52:37.745762235 +0000 UTC m=+24.669002415" Jul 16 16:52:37.766268 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:37.766235 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6fwnq" podStartSLOduration=4.043577873 podStartE2EDuration="24.766222598s" totalImagesPullingTime="20.722644725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:52:37.765606552 +0000 UTC m=+24.688846743" watchObservedRunningTime="2026-07-16 16:52:37.766222598 +0000 UTC m=+24.689462787" Jul 16 16:52:37.779979 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:37.779913 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2hd8z" podStartSLOduration=7.891998264 podStartE2EDuration="24.779897263s" totalImagesPullingTime="16.887898999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:52:37.779855767 +0000 UTC m=+24.703095956" watchObservedRunningTime="2026-07-16 16:52:37.779897263 +0000 UTC m=+24.703137454" Jul 16 16:52:37.835848 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:37.835809 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6mpfx" podStartSLOduration=3.231180557 podStartE2EDuration="23.835797052s" totalImagesPullingTime="20.604616495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:52:37.835438186 +0000 UTC m=+24.758678375" watchObservedRunningTime="2026-07-16 16:52:37.835797052 +0000 UTC m=+24.759037241" Jul 16 16:52:38.599344 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:38.599318 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:38.599624 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:38.599400 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:38.599624 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:38.599320 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:38.599624 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:38.599473 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:38.741275 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:38.741248 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" event={"ID":"4bc0c7a3681d7c042fbc0dd13cac7333","Type":"ContainerStarted","Data":"88f464e88aff044e0be3a6baad54130b24c8c8bb3ba3a5101f2828e5a9f188ab"} Jul 16 16:52:38.756840 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:38.756800 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" podStartSLOduration=24.756785268 podStartE2EDuration="24.756785268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:52:38.756273011 +0000 UTC m=+25.679513194" watchObservedRunningTime="2026-07-16 16:52:38.756785268 +0000 UTC m=+25.680025456" Jul 16 16:52:39.599285 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:39.599255 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:39.599431 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:39.599358 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:39.746009 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:39.745985 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/ovn-acl-logging/0.log" Jul 16 16:52:39.746340 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:39.746307 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" event={"ID":"fb69eacb-ddea-492f-93e0-91625661c1e3","Type":"ContainerStarted","Data":"2f451329ea083867f445c3f688bfaa9c32db218c3d792f3af39aac71241d444c"} Jul 16 16:52:39.774198 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:39.774179 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 16:52:40.568376 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:40.568257 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T16:52:39.774194679Z","UUID":"dd864058-66d6-452a-aa9e-b0073c94422e","Handler":null,"Name":"","Endpoint":""} Jul 16 16:52:40.570310 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:40.570057 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 16:52:40.570310 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:40.570102 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 16:52:40.599612 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:40.599561 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:40.599768 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:40.599709 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:40.599768 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:40.599722 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:40.599846 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:40.599817 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:40.751127 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:40.751082 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" event={"ID":"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63","Type":"ContainerStarted","Data":"77e4a8be82d8a484c4b05d9c951fa0acdb7faa2f79df8a71837bde2b069fbc1a"} Jul 16 16:52:41.150362 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.150097 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2hd8z" Jul 16 16:52:41.150733 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.150710 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2hd8z" Jul 16 16:52:41.599350 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.599312 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:41.599540 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:41.599454 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:41.757010 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.756985 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/ovn-acl-logging/0.log" Jul 16 16:52:41.757715 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.757334 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" event={"ID":"fb69eacb-ddea-492f-93e0-91625661c1e3","Type":"ContainerStarted","Data":"e11be1df9436b21cdf9d02686bf939431b3d0dbb8f0590942221e7850884c306"} Jul 16 16:52:41.758129 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.758106 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:41.758251 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.758238 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:41.758326 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.758313 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:41.758401 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.758381 2563 scope.go:117] "RemoveContainer" containerID="52aed996f03c69ba8825ffe85734b4903c639023c368a32abf32303fe9c8e492" Jul 16 16:52:41.763284 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.763251 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" event={"ID":"0c7b31dc-aa4a-41be-b3b6-b1878fd02f63","Type":"ContainerStarted","Data":"460f0cc3a8f7cb8ac0a2b9ec86594020e6aff08a754126aba4ceee4691ef4a92"} Jul 16 16:52:41.763629 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.763607 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2hd8z" Jul 16 16:52:41.764245 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.764224 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2hd8z" Jul 16 16:52:41.777183 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.777165 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:41.779599 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.779557 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:52:41.809769 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:41.809731 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gbsf7" podStartSLOduration=4.341579645 podStartE2EDuration="28.809715931s" totalImagesPullingTime="24.468136286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:52:41.809308936 +0000 UTC m=+28.732549127" watchObservedRunningTime="2026-07-16 16:52:41.809715931 +0000 UTC m=+28.732956120" Jul 16 16:52:42.599759 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:42.599723 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:42.599914 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:42.599778 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:42.599984 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:42.599898 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:42.600066 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:42.600039 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:42.770349 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:42.770322 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/ovn-acl-logging/0.log" Jul 16 16:52:42.771505 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:42.770867 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" event={"ID":"fb69eacb-ddea-492f-93e0-91625661c1e3","Type":"ContainerStarted","Data":"a3b79ff29e515269b2c35062c31d1e0a547154e1626ad9e8639ca0ea0215b7b4"} Jul 16 16:52:42.797145 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:42.797096 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" podStartSLOduration=8.77338303 podStartE2EDuration="29.797076031s" totalImagesPullingTime="21.023693001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:52:42.79439963 +0000 UTC m=+29.717639839" watchObservedRunningTime="2026-07-16 16:52:42.797076031 +0000 UTC m=+29.720316223" Jul 16 16:52:43.155522 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:43.155493 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k4c97"] Jul 16 16:52:43.155737 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:43.155692 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:43.155835 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:43.155813 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:43.158864 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:43.158818 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p8bxj"] Jul 16 16:52:43.159003 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:43.158919 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:43.159080 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:43.159019 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:43.159636 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:43.159611 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2ltgt"] Jul 16 16:52:43.159746 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:43.159714 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:43.160278 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:43.159805 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:44.599204 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:44.599174 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:44.599556 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:44.599274 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:44.599556 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:44.599279 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:44.599556 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:44.599299 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:44.599556 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:44.599367 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:44.599556 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:44.599420 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:44.777133 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:44.777103 2563 generic.go:356] "Generic (PLEG): container finished" podID="a8749d82-f357-4897-82e5-7a4a02e757f0" containerID="146c98caeda7d668bac88e52d9ecb4f89b7b5fd8340bb608b27142e00ceb80fb" exitCode=0 Jul 16 16:52:44.777251 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:44.777147 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdn2" event={"ID":"a8749d82-f357-4897-82e5-7a4a02e757f0","Type":"ContainerDied","Data":"146c98caeda7d668bac88e52d9ecb4f89b7b5fd8340bb608b27142e00ceb80fb"} Jul 16 16:52:46.237839 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:46.237810 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs\") pod \"network-metrics-daemon-p8bxj\" (UID: \"616b8d16-1b94-4015-bd70-d3f891934cc0\") " pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:46.238280 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:46.237907 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:46.238280 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:46.237954 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs podName:616b8d16-1b94-4015-bd70-d3f891934cc0 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:18.237940597 +0000 UTC m=+65.161180763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs") pod "network-metrics-daemon-p8bxj" (UID: "616b8d16-1b94-4015-bd70-d3f891934cc0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:46.338548 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:46.338516 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8sn\" (UniqueName: \"kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn\") pod \"network-check-target-2ltgt\" (UID: \"ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54\") " pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:46.338548 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:46.338548 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:46.338856 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:46.338664 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:46.338856 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:46.338690 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:46.338856 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:46.338713 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:46.338856 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:46.338718 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret podName:affdec92-dfd2-49b0-878a-4ef13cc5bfa0 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:18.338699709 +0000 UTC m=+65.261939896 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret") pod "global-pull-secret-syncer-k4c97" (UID: "affdec92-dfd2-49b0-878a-4ef13cc5bfa0") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:46.338856 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:46.338726 2563 projected.go:196] Error preparing data for projected volume kube-api-access-5g8sn for pod openshift-network-diagnostics/network-check-target-2ltgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:46.338856 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:46.338777 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn podName:ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:18.338761997 +0000 UTC m=+65.262002170 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5g8sn" (UniqueName: "kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn") pod "network-check-target-2ltgt" (UID: "ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:46.598900 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:46.598827 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:46.599030 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:46.598921 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:46.599030 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:46.598923 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:46.599030 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:46.598931 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:46.599030 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:46.599001 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:46.599237 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:46.599071 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:47.784483 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:47.784445 2563 generic.go:356] "Generic (PLEG): container finished" podID="a8749d82-f357-4897-82e5-7a4a02e757f0" containerID="d60592df2936051ccea572685966c81a88c56f790979eb6a557cd3f035ddc4e4" exitCode=0 Jul 16 16:52:47.784912 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:47.784510 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdn2" event={"ID":"a8749d82-f357-4897-82e5-7a4a02e757f0","Type":"ContainerDied","Data":"d60592df2936051ccea572685966c81a88c56f790979eb6a557cd3f035ddc4e4"} Jul 16 16:52:48.599330 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.599292 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:48.599494 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.599423 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:48.599494 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:48.599447 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4c97" podUID="affdec92-dfd2-49b0-878a-4ef13cc5bfa0" Jul 16 16:52:48.599559 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:48.599546 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ltgt" podUID="ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54" Jul 16 16:52:48.599633 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.599620 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:48.599751 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:48.599721 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bxj" podUID="616b8d16-1b94-4015-bd70-d3f891934cc0" Jul 16 16:52:48.852955 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.852883 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeReady" Jul 16 16:52:48.853290 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.853018 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 16:52:48.884906 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.884875 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x7x28"] Jul 16 16:52:48.908126 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.907263 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f876f5f4-k2v6v"] Jul 16 16:52:48.909597 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.908788 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x7x28" Jul 16 16:52:48.913972 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.913887 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4wrrm\"" Jul 16 16:52:48.913972 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.913970 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 16 16:52:48.914146 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.914136 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:52:48.927408 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.927388 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj"] Jul 16 16:52:48.927552 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.927533 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:48.929534 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.929485 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 16:52:48.929671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.929555 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 16:52:48.930095 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.929854 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7vjt2\"" Jul 16 16:52:48.930175 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.929806 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 16:52:48.941070 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.941040 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 16:52:48.949517 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.949495 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ghtrx"] Jul 16 16:52:48.949721 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.949646 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:52:48.951354 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.951332 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 16 16:52:48.951474 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.951402 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 16:52:48.951474 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.951429 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 16:52:48.951474 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.951453 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-k4dtf\"" Jul 16 16:52:48.951474 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.951469 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 16 16:52:48.973611 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.973582 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49"] Jul 16 16:52:48.973730 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.973661 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:48.975429 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.975407 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 16 16:52:48.975547 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.975431 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 16 16:52:48.975547 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.975500 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 16:52:48.975547 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.975531 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 16:52:48.975980 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.975963 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rkcbp\"" Jul 16 16:52:48.979531 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.979509 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 16 16:52:48.995935 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.995742 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-68f9b9d6bd-m9kzh"] Jul 16 16:52:48.996049 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.995859 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" Jul 16 16:52:48.998177 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.998156 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 16 16:52:48.998287 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.998182 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dhmc8\"" Jul 16 16:52:48.998287 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.998264 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 16 16:52:48.998475 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:48.998462 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:52:49.029997 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.029971 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-txmzt"] Jul 16 16:52:49.030123 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.030094 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.031938 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.031912 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 16 16:52:49.031938 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.031929 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wpt7l\"" Jul 16 16:52:49.032077 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.032045 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 16 16:52:49.032341 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.032324 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 16 16:52:49.032417 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.032404 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 16 16:52:49.032640 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.032619 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 16:52:49.032918 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.032905 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 16:52:49.050479 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.050456 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk"] Jul 16 16:52:49.050689 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.050638 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:52:49.052187 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.052166 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 16 16:52:49.052284 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.052209 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5xbfk\"" Jul 16 16:52:49.052430 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.052417 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:52:49.052487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.052456 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 16 16:52:49.052487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.052456 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 16 16:52:49.057924 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.057901 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 16 16:52:49.060685 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8d96\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-kube-api-access-b8d96\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.060685 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0aba567-5292-4d1f-8588-c65d1d31da4a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.060685 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmwx8\" (UniqueName: \"kubernetes.io/projected/82f2686c-d513-41f0-aa83-24d31354bba3-kube-api-access-jmwx8\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:52:49.060685 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.060685 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060493 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-certificates\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.060685 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060514 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5124d017-734a-44d8-b483-58b92f4bd8eb-installation-pull-secrets\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.060685 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060540 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0aba567-5292-4d1f-8588-c65d1d31da4a-serving-cert\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.060685 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060585 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5124d017-734a-44d8-b483-58b92f4bd8eb-image-registry-private-configuration\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.060685 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0aba567-5292-4d1f-8588-c65d1d31da4a-tmp\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.060685 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfwjl\" (UniqueName: \"kubernetes.io/projected/b0aba567-5292-4d1f-8588-c65d1d31da4a-kube-api-access-mfwjl\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.060685 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060664 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/82f2686c-d513-41f0-aa83-24d31354bba3-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:52:49.061207 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:52:49.061207 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060749 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b0aba567-5292-4d1f-8588-c65d1d31da4a-snapshots\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.061207 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5124d017-734a-44d8-b483-58b92f4bd8eb-trusted-ca\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.061207 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4vtp\" (UniqueName: \"kubernetes.io/projected/ba7a0d6f-5c2f-4ba1-989c-36718a369e34-kube-api-access-x4vtp\") pod \"volume-data-source-validator-78495597f6-x7x28\" (UID: \"ba7a0d6f-5c2f-4ba1-989c-36718a369e34\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x7x28" Jul 16 16:52:49.061207 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5124d017-734a-44d8-b483-58b92f4bd8eb-ca-trust-extracted\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.061207 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0aba567-5292-4d1f-8588-c65d1d31da4a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.061207 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060949 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-bound-sa-token\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.061207 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g2b49\" (UID: \"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" Jul 16 16:52:49.061207 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.060999 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmblt\" (UniqueName: \"kubernetes.io/projected/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-kube-api-access-lmblt\") pod \"cluster-samples-operator-65db858894-g2b49\" (UID: \"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" Jul 16 16:52:49.074616 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.074580 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:49.074767 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.074652 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg"] Jul 16 16:52:49.074827 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.074797 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" Jul 16 16:52:49.076608 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.076584 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 16 16:52:49.076608 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.076591 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 16 16:52:49.076870 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.076853 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5wh67\"" Jul 16 16:52:49.076914 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.076901 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:52:49.076955 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.076904 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 16 16:52:49.085319 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.085291 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x7x28"] Jul 16 16:52:49.085430 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.085328 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-4vknj"] Jul 16 16:52:49.085430 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.085418 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" Jul 16 16:52:49.087256 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.087230 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:52:49.087350 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.087243 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bhkrb\"" Jul 16 16:52:49.087419 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.087370 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 16 16:52:49.087419 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.087410 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 16 16:52:49.087677 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.087662 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 16 16:52:49.100010 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.099977 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj"] Jul 16 16:52:49.100137 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.100018 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49"] Jul 16 16:52:49.100137 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.100045 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg"] Jul 16 16:52:49.100137 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.100065 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wks9k"] Jul 16 16:52:49.100137 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.100120 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4vknj" Jul 16 16:52:49.102035 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.102011 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 16:52:49.102172 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.102053 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-g2bkt\"" Jul 16 16:52:49.102172 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.102062 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 16:52:49.112781 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.112761 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ghtrx"] Jul 16 16:52:49.112884 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.112791 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk"] Jul 16 16:52:49.112884 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.112806 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f876f5f4-k2v6v"] Jul 16 16:52:49.112884 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.112823 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68f9b9d6bd-m9kzh"] Jul 16 16:52:49.112884 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.112838 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w5lkh"] Jul 16 16:52:49.113011 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.112904 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wks9k" Jul 16 16:52:49.114770 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.114740 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 16:52:49.114770 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.114756 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kcmcp\"" Jul 16 16:52:49.114770 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.114742 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 16:52:49.114953 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.114788 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 16:52:49.123931 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.123909 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-4vknj"] Jul 16 16:52:49.123931 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.123941 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-txmzt"] Jul 16 16:52:49.124078 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.123964 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wks9k"] Jul 16 16:52:49.124078 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.123985 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w5lkh"] Jul 16 16:52:49.124078 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.124024 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:49.125646 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.125629 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 16:52:49.125646 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.125638 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 16:52:49.125792 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.125678 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2f6zt\"" Jul 16 16:52:49.159552 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.159518 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:49.161430 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.161408 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4vtp\" (UniqueName: \"kubernetes.io/projected/ba7a0d6f-5c2f-4ba1-989c-36718a369e34-kube-api-access-x4vtp\") pod \"volume-data-source-validator-78495597f6-x7x28\" (UID: \"ba7a0d6f-5c2f-4ba1-989c-36718a369e34\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x7x28" Jul 16 16:52:49.161532 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.161448 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b1ce2c6-8921-4e94-908f-b1f88eafa433-trusted-ca\") pod \"console-operator-7866497494-txmzt\" (UID: \"7b1ce2c6-8921-4e94-908f-b1f88eafa433\") " pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:52:49.161532 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.161487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d15f86ba-0811-47e9-9079-242e244226d4-config\") pod \"service-ca-operator-7695fc6c8c-jfpxg\" (UID: \"d15f86ba-0811-47e9-9079-242e244226d4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" Jul 16 16:52:49.161532 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.161509 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b1ce2c6-8921-4e94-908f-b1f88eafa433-serving-cert\") pod \"console-operator-7866497494-txmzt\" (UID: \"7b1ce2c6-8921-4e94-908f-b1f88eafa433\") " pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:52:49.161683 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.161539 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5124d017-734a-44d8-b483-58b92f4bd8eb-installation-pull-secrets\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.161683 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.161584 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0aba567-5292-4d1f-8588-c65d1d31da4a-serving-cert\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.161683 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.161630 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.161791 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.161703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0aba567-5292-4d1f-8588-c65d1d31da4a-tmp\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.161791 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.161728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfwjl\" (UniqueName: \"kubernetes.io/projected/b0aba567-5292-4d1f-8588-c65d1d31da4a-kube-api-access-mfwjl\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.161791 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.161752 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:52:49.161791 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.161705 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:52:49.161791 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.161777 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.161791 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.161784 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f876f5f4-k2v6v: secret "image-registry-tls" not found Jul 16 16:52:49.162056 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.161804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b0aba567-5292-4d1f-8588-c65d1d31da4a-snapshots\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.162056 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.161829 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.162056 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.161848 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls podName:5124d017-734a-44d8-b483-58b92f4bd8eb nodeName:}" failed. No retries permitted until 2026-07-16 16:52:49.661826737 +0000 UTC m=+36.585066923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls") pod "image-registry-7f876f5f4-k2v6v" (UID: "5124d017-734a-44d8-b483-58b92f4bd8eb") : secret "image-registry-tls" not found Jul 16 16:52:49.162056 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.161865 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 16:52:49.162056 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.161895 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5124d017-734a-44d8-b483-58b92f4bd8eb-trusted-ca\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.162056 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.161916 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls podName:82f2686c-d513-41f0-aa83-24d31354bba3 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:49.661899913 +0000 UTC m=+36.585140080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ll8zj" (UID: "82f2686c-d513-41f0-aa83-24d31354bba3") : secret "cluster-monitoring-operator-tls" not found Jul 16 16:52:49.162056 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8txw\" (UniqueName: \"kubernetes.io/projected/ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2-kube-api-access-d8txw\") pod \"kube-storage-version-migrator-operator-799cb7f958-7jrgk\" (UID: \"ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" Jul 16 16:52:49.162402 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162080 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwqmd\" (UniqueName: \"kubernetes.io/projected/d15f86ba-0811-47e9-9079-242e244226d4-kube-api-access-pwqmd\") pod \"service-ca-operator-7695fc6c8c-jfpxg\" (UID: \"d15f86ba-0811-47e9-9079-242e244226d4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" Jul 16 16:52:49.162402 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-stats-auth\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.162402 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5124d017-734a-44d8-b483-58b92f4bd8eb-ca-trust-extracted\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.162402 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162181 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0aba567-5292-4d1f-8588-c65d1d31da4a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.162402 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162216 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-bound-sa-token\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.162402 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162242 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g2b49\" (UID: \"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" Jul 16 16:52:49.162402 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmblt\" (UniqueName: \"kubernetes.io/projected/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-kube-api-access-lmblt\") pod \"cluster-samples-operator-65db858894-g2b49\" (UID: \"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" Jul 16 16:52:49.162402 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrpbg\" (UniqueName: \"kubernetes.io/projected/7b1ce2c6-8921-4e94-908f-b1f88eafa433-kube-api-access-lrpbg\") pod \"console-operator-7866497494-txmzt\" (UID: \"7b1ce2c6-8921-4e94-908f-b1f88eafa433\") " pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:52:49.162402 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d15f86ba-0811-47e9-9079-242e244226d4-serving-cert\") pod \"service-ca-operator-7695fc6c8c-jfpxg\" (UID: \"d15f86ba-0811-47e9-9079-242e244226d4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" Jul 16 16:52:49.162402 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162362 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8d96\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-kube-api-access-b8d96\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.162402 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162385 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0aba567-5292-4d1f-8588-c65d1d31da4a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.162402 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162395 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b0aba567-5292-4d1f-8588-c65d1d31da4a-snapshots\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.162971 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162411 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmwx8\" (UniqueName: \"kubernetes.io/projected/82f2686c-d513-41f0-aa83-24d31354bba3-kube-api-access-jmwx8\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:52:49.162971 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162438 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-598mz\" (UniqueName: \"kubernetes.io/projected/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-kube-api-access-598mz\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.162971 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5124d017-734a-44d8-b483-58b92f4bd8eb-ca-trust-extracted\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.162971 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162618 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7jrgk\" (UID: \"ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" Jul 16 16:52:49.162971 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162649 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7jrgk\" (UID: \"ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" Jul 16 16:52:49.162971 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162705 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-certificates\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.162971 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162734 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/82f2686c-d513-41f0-aa83-24d31354bba3-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:52:49.162971 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.162807 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 16:52:49.162971 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.162847 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls podName:b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e nodeName:}" failed. No retries permitted until 2026-07-16 16:52:49.662834321 +0000 UTC m=+36.586074498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls") pod "cluster-samples-operator-65db858894-g2b49" (UID: "b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e") : secret "samples-operator-tls" not found Jul 16 16:52:49.162971 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.162889 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5124d017-734a-44d8-b483-58b92f4bd8eb-trusted-ca\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.163446 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.163036 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0aba567-5292-4d1f-8588-c65d1d31da4a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.163446 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.163077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5124d017-734a-44d8-b483-58b92f4bd8eb-image-registry-private-configuration\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.163446 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.163112 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-default-certificate\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.163446 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.163160 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b1ce2c6-8921-4e94-908f-b1f88eafa433-config\") pod \"console-operator-7866497494-txmzt\" (UID: \"7b1ce2c6-8921-4e94-908f-b1f88eafa433\") " pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:52:49.163446 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.163186 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz6wr\" (UniqueName: \"kubernetes.io/projected/5bd4a1b4-0c76-460c-9b8c-069f9242dd29-kube-api-access-sz6wr\") pod \"network-check-source-869dcfcdcd-4vknj\" (UID: \"5bd4a1b4-0c76-460c-9b8c-069f9242dd29\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4vknj" Jul 16 16:52:49.163446 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.163223 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0aba567-5292-4d1f-8588-c65d1d31da4a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.163446 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.163268 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-certificates\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.163752 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.163554 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0aba567-5292-4d1f-8588-c65d1d31da4a-tmp\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.163752 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.163629 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/82f2686c-d513-41f0-aa83-24d31354bba3-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:52:49.166156 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.166136 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0aba567-5292-4d1f-8588-c65d1d31da4a-serving-cert\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.166239 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.166158 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5124d017-734a-44d8-b483-58b92f4bd8eb-installation-pull-secrets\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.166239 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.166139 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5124d017-734a-44d8-b483-58b92f4bd8eb-image-registry-private-configuration\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.169725 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.169707 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfwjl\" (UniqueName: \"kubernetes.io/projected/b0aba567-5292-4d1f-8588-c65d1d31da4a-kube-api-access-mfwjl\") pod \"insights-operator-68d9dd94cf-ghtrx\" (UID: \"b0aba567-5292-4d1f-8588-c65d1d31da4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.169928 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.169912 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4vtp\" (UniqueName: \"kubernetes.io/projected/ba7a0d6f-5c2f-4ba1-989c-36718a369e34-kube-api-access-x4vtp\") pod \"volume-data-source-validator-78495597f6-x7x28\" (UID: \"ba7a0d6f-5c2f-4ba1-989c-36718a369e34\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x7x28" Jul 16 16:52:49.174679 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.174659 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmwx8\" (UniqueName: \"kubernetes.io/projected/82f2686c-d513-41f0-aa83-24d31354bba3-kube-api-access-jmwx8\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:52:49.174931 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.174911 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-bound-sa-token\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.175352 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.175337 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8d96\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-kube-api-access-b8d96\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.175971 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.175955 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmblt\" (UniqueName: \"kubernetes.io/projected/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-kube-api-access-lmblt\") pod \"cluster-samples-operator-65db858894-g2b49\" (UID: \"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" Jul 16 16:52:49.223947 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.223897 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x7x28" Jul 16 16:52:49.264492 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.264454 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrpbg\" (UniqueName: \"kubernetes.io/projected/7b1ce2c6-8921-4e94-908f-b1f88eafa433-kube-api-access-lrpbg\") pod \"console-operator-7866497494-txmzt\" (UID: \"7b1ce2c6-8921-4e94-908f-b1f88eafa433\") " pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:52:49.264492 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.264490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d15f86ba-0811-47e9-9079-242e244226d4-serving-cert\") pod \"service-ca-operator-7695fc6c8c-jfpxg\" (UID: \"d15f86ba-0811-47e9-9079-242e244226d4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" Jul 16 16:52:49.264699 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.264515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrs46\" (UniqueName: \"kubernetes.io/projected/03ee3d74-6c5d-43fc-acec-8310503383ba-kube-api-access-wrs46\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:49.264699 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.264538 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-598mz\" (UniqueName: \"kubernetes.io/projected/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-kube-api-access-598mz\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.264699 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.264645 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7jrgk\" (UID: \"ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" Jul 16 16:52:49.264699 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.264677 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7jrgk\" (UID: \"ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" Jul 16 16:52:49.264885 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.264701 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03ee3d74-6c5d-43fc-acec-8310503383ba-tmp-dir\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:49.264885 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.264733 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-default-certificate\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.264885 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.264769 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03ee3d74-6c5d-43fc-acec-8310503383ba-config-volume\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:49.264885 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.264820 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b1ce2c6-8921-4e94-908f-b1f88eafa433-config\") pod \"console-operator-7866497494-txmzt\" (UID: \"7b1ce2c6-8921-4e94-908f-b1f88eafa433\") " pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:52:49.265073 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.264901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz6wr\" (UniqueName: \"kubernetes.io/projected/5bd4a1b4-0c76-460c-9b8c-069f9242dd29-kube-api-access-sz6wr\") pod \"network-check-source-869dcfcdcd-4vknj\" (UID: \"5bd4a1b4-0c76-460c-9b8c-069f9242dd29\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4vknj" Jul 16 16:52:49.265073 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.264937 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b1ce2c6-8921-4e94-908f-b1f88eafa433-trusted-ca\") pod \"console-operator-7866497494-txmzt\" (UID: \"7b1ce2c6-8921-4e94-908f-b1f88eafa433\") " pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:52:49.265073 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.264982 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d15f86ba-0811-47e9-9079-242e244226d4-config\") pod \"service-ca-operator-7695fc6c8c-jfpxg\" (UID: \"d15f86ba-0811-47e9-9079-242e244226d4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" Jul 16 16:52:49.265073 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.265006 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:49.265073 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.265035 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/926ee6a5-b8a8-4fe0-b4ea-603be40e3d91-cert\") pod \"ingress-canary-wks9k\" (UID: \"926ee6a5-b8a8-4fe0-b4ea-603be40e3d91\") " pod="openshift-ingress-canary/ingress-canary-wks9k" Jul 16 16:52:49.265073 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.265066 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b1ce2c6-8921-4e94-908f-b1f88eafa433-serving-cert\") pod \"console-operator-7866497494-txmzt\" (UID: \"7b1ce2c6-8921-4e94-908f-b1f88eafa433\") " pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:52:49.265525 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.265090 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbdsb\" (UniqueName: \"kubernetes.io/projected/926ee6a5-b8a8-4fe0-b4ea-603be40e3d91-kube-api-access-dbdsb\") pod \"ingress-canary-wks9k\" (UID: \"926ee6a5-b8a8-4fe0-b4ea-603be40e3d91\") " pod="openshift-ingress-canary/ingress-canary-wks9k" Jul 16 16:52:49.265525 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.265168 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.265525 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.265199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.265525 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.265228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8txw\" (UniqueName: \"kubernetes.io/projected/ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2-kube-api-access-d8txw\") pod \"kube-storage-version-migrator-operator-799cb7f958-7jrgk\" (UID: \"ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" Jul 16 16:52:49.265525 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.265257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwqmd\" (UniqueName: \"kubernetes.io/projected/d15f86ba-0811-47e9-9079-242e244226d4-kube-api-access-pwqmd\") pod \"service-ca-operator-7695fc6c8c-jfpxg\" (UID: \"d15f86ba-0811-47e9-9079-242e244226d4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" Jul 16 16:52:49.265525 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.265293 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-stats-auth\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.265824 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.265613 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b1ce2c6-8921-4e94-908f-b1f88eafa433-config\") pod \"console-operator-7866497494-txmzt\" (UID: \"7b1ce2c6-8921-4e94-908f-b1f88eafa433\") " pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:52:49.265824 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.265710 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7jrgk\" (UID: \"ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" Jul 16 16:52:49.265824 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.265784 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle podName:f90ab8e7-db12-47c5-8ef2-fb10b74128b6 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:49.765766296 +0000 UTC m=+36.689006478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle") pod "router-default-68f9b9d6bd-m9kzh" (UID: "f90ab8e7-db12-47c5-8ef2-fb10b74128b6") : configmap references non-existent config key: service-ca.crt Jul 16 16:52:49.266158 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.266131 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d15f86ba-0811-47e9-9079-242e244226d4-config\") pod \"service-ca-operator-7695fc6c8c-jfpxg\" (UID: \"d15f86ba-0811-47e9-9079-242e244226d4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" Jul 16 16:52:49.266252 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.266226 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 16:52:49.266307 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.266270 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs podName:f90ab8e7-db12-47c5-8ef2-fb10b74128b6 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:49.766255594 +0000 UTC m=+36.689495763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs") pod "router-default-68f9b9d6bd-m9kzh" (UID: "f90ab8e7-db12-47c5-8ef2-fb10b74128b6") : secret "router-metrics-certs-default" not found Jul 16 16:52:49.266393 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.266365 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b1ce2c6-8921-4e94-908f-b1f88eafa433-trusted-ca\") pod \"console-operator-7866497494-txmzt\" (UID: \"7b1ce2c6-8921-4e94-908f-b1f88eafa433\") " pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:52:49.267379 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.267353 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7jrgk\" (UID: \"ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" Jul 16 16:52:49.267958 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.267934 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d15f86ba-0811-47e9-9079-242e244226d4-serving-cert\") pod \"service-ca-operator-7695fc6c8c-jfpxg\" (UID: \"d15f86ba-0811-47e9-9079-242e244226d4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" Jul 16 16:52:49.268350 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.268319 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b1ce2c6-8921-4e94-908f-b1f88eafa433-serving-cert\") pod \"console-operator-7866497494-txmzt\" (UID: \"7b1ce2c6-8921-4e94-908f-b1f88eafa433\") " pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:52:49.268583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.268552 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-stats-auth\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.268769 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.268752 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-default-certificate\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.272845 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.272817 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz6wr\" (UniqueName: \"kubernetes.io/projected/5bd4a1b4-0c76-460c-9b8c-069f9242dd29-kube-api-access-sz6wr\") pod \"network-check-source-869dcfcdcd-4vknj\" (UID: \"5bd4a1b4-0c76-460c-9b8c-069f9242dd29\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4vknj" Jul 16 16:52:49.274080 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.274056 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8txw\" (UniqueName: \"kubernetes.io/projected/ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2-kube-api-access-d8txw\") pod \"kube-storage-version-migrator-operator-799cb7f958-7jrgk\" (UID: \"ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" Jul 16 16:52:49.274234 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.274216 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrpbg\" (UniqueName: \"kubernetes.io/projected/7b1ce2c6-8921-4e94-908f-b1f88eafa433-kube-api-access-lrpbg\") pod \"console-operator-7866497494-txmzt\" (UID: \"7b1ce2c6-8921-4e94-908f-b1f88eafa433\") " pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:52:49.274295 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.274226 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-598mz\" (UniqueName: \"kubernetes.io/projected/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-kube-api-access-598mz\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.274427 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.274411 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwqmd\" (UniqueName: \"kubernetes.io/projected/d15f86ba-0811-47e9-9079-242e244226d4-kube-api-access-pwqmd\") pod \"service-ca-operator-7695fc6c8c-jfpxg\" (UID: \"d15f86ba-0811-47e9-9079-242e244226d4\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" Jul 16 16:52:49.300112 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.300073 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" Jul 16 16:52:49.360879 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.360847 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:52:49.366374 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.366228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrs46\" (UniqueName: \"kubernetes.io/projected/03ee3d74-6c5d-43fc-acec-8310503383ba-kube-api-access-wrs46\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:49.366374 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.366267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03ee3d74-6c5d-43fc-acec-8310503383ba-tmp-dir\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:49.366374 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.366297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03ee3d74-6c5d-43fc-acec-8310503383ba-config-volume\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:49.366374 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.366366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:49.366792 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.366392 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/926ee6a5-b8a8-4fe0-b4ea-603be40e3d91-cert\") pod \"ingress-canary-wks9k\" (UID: \"926ee6a5-b8a8-4fe0-b4ea-603be40e3d91\") " pod="openshift-ingress-canary/ingress-canary-wks9k" Jul 16 16:52:49.366792 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.366418 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbdsb\" (UniqueName: \"kubernetes.io/projected/926ee6a5-b8a8-4fe0-b4ea-603be40e3d91-kube-api-access-dbdsb\") pod \"ingress-canary-wks9k\" (UID: \"926ee6a5-b8a8-4fe0-b4ea-603be40e3d91\") " pod="openshift-ingress-canary/ingress-canary-wks9k" Jul 16 16:52:49.366792 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.366544 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:52:49.366792 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.366615 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03ee3d74-6c5d-43fc-acec-8310503383ba-tmp-dir\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:49.366792 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.366662 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls podName:03ee3d74-6c5d-43fc-acec-8310503383ba nodeName:}" failed. No retries permitted until 2026-07-16 16:52:49.86664227 +0000 UTC m=+36.789882439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls") pod "dns-default-w5lkh" (UID: "03ee3d74-6c5d-43fc-acec-8310503383ba") : secret "dns-default-metrics-tls" not found Jul 16 16:52:49.367277 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.367255 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03ee3d74-6c5d-43fc-acec-8310503383ba-config-volume\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:49.370817 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.370758 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/926ee6a5-b8a8-4fe0-b4ea-603be40e3d91-cert\") pod \"ingress-canary-wks9k\" (UID: \"926ee6a5-b8a8-4fe0-b4ea-603be40e3d91\") " pod="openshift-ingress-canary/ingress-canary-wks9k" Jul 16 16:52:49.377784 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.377738 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbdsb\" (UniqueName: \"kubernetes.io/projected/926ee6a5-b8a8-4fe0-b4ea-603be40e3d91-kube-api-access-dbdsb\") pod \"ingress-canary-wks9k\" (UID: \"926ee6a5-b8a8-4fe0-b4ea-603be40e3d91\") " pod="openshift-ingress-canary/ingress-canary-wks9k" Jul 16 16:52:49.377922 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.377904 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrs46\" (UniqueName: \"kubernetes.io/projected/03ee3d74-6c5d-43fc-acec-8310503383ba-kube-api-access-wrs46\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:49.409288 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.409249 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" Jul 16 16:52:49.415636 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.415601 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" Jul 16 16:52:49.417806 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.417776 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x7x28"] Jul 16 16:52:49.423624 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.422998 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4vknj" Jul 16 16:52:49.424967 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:49.424915 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7a0d6f_5c2f_4ba1_989c_36718a369e34.slice/crio-1f34ad522ca3d56e876f91a5ddc2a6a0ac907e2921c04f01adacb24dd72f3fe0 WatchSource:0}: Error finding container 1f34ad522ca3d56e876f91a5ddc2a6a0ac907e2921c04f01adacb24dd72f3fe0: Status 404 returned error can't find the container with id 1f34ad522ca3d56e876f91a5ddc2a6a0ac907e2921c04f01adacb24dd72f3fe0 Jul 16 16:52:49.427426 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.427363 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wks9k" Jul 16 16:52:49.482141 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.481699 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ghtrx"] Jul 16 16:52:49.531520 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.531454 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:49.547851 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.546049 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-txmzt"] Jul 16 16:52:49.633369 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.633260 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:49.638092 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.638065 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk"] Jul 16 16:52:49.641707 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:49.641678 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb5a58e_8679_42d3_a3ea_d4023bf5ccc2.slice/crio-56c98e77fd3f112b01d7ffdbb271b79dfb2213eb5c6298d40e98699baa21633f WatchSource:0}: Error finding container 56c98e77fd3f112b01d7ffdbb271b79dfb2213eb5c6298d40e98699baa21633f: Status 404 returned error can't find the container with id 56c98e77fd3f112b01d7ffdbb271b79dfb2213eb5c6298d40e98699baa21633f Jul 16 16:52:49.649412 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.649389 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg"] Jul 16 16:52:49.651922 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:49.651898 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd15f86ba_0811_47e9_9079_242e244226d4.slice/crio-bee5058e56438f00d647e669066ddcb1281865751bbf687c0077ecd208caf34c WatchSource:0}: Error finding container bee5058e56438f00d647e669066ddcb1281865751bbf687c0077ecd208caf34c: Status 404 returned error can't find the container with id bee5058e56438f00d647e669066ddcb1281865751bbf687c0077ecd208caf34c Jul 16 16:52:49.663663 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.663638 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wks9k"] Jul 16 16:52:49.666811 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:49.666788 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod926ee6a5_b8a8_4fe0_b4ea_603be40e3d91.slice/crio-67332ad250591ad2e200eded8c7e9c1c54055494ff98ab72993ad3135301dc32 WatchSource:0}: Error finding container 67332ad250591ad2e200eded8c7e9c1c54055494ff98ab72993ad3135301dc32: Status 404 returned error can't find the container with id 67332ad250591ad2e200eded8c7e9c1c54055494ff98ab72993ad3135301dc32 Jul 16 16:52:49.670664 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.670627 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:49.670753 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.670683 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:52:49.670790 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.670751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g2b49\" (UID: \"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" Jul 16 16:52:49.670790 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.670773 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:52:49.670790 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.670786 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f876f5f4-k2v6v: secret "image-registry-tls" not found Jul 16 16:52:49.670881 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.670824 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 16:52:49.670881 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.670826 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls podName:5124d017-734a-44d8-b483-58b92f4bd8eb nodeName:}" failed. No retries permitted until 2026-07-16 16:52:50.670812897 +0000 UTC m=+37.594053067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls") pod "image-registry-7f876f5f4-k2v6v" (UID: "5124d017-734a-44d8-b483-58b92f4bd8eb") : secret "image-registry-tls" not found Jul 16 16:52:49.670881 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.670871 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 16:52:49.670972 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.670909 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls podName:82f2686c-d513-41f0-aa83-24d31354bba3 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:50.670897194 +0000 UTC m=+37.594137361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ll8zj" (UID: "82f2686c-d513-41f0-aa83-24d31354bba3") : secret "cluster-monitoring-operator-tls" not found Jul 16 16:52:49.670972 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.670921 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls podName:b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e nodeName:}" failed. No retries permitted until 2026-07-16 16:52:50.670915525 +0000 UTC m=+37.594155692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls") pod "cluster-samples-operator-65db858894-g2b49" (UID: "b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e") : secret "samples-operator-tls" not found Jul 16 16:52:49.686211 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.686179 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-4vknj"] Jul 16 16:52:49.689471 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:52:49.689432 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd4a1b4_0c76_460c_9b8c_069f9242dd29.slice/crio-a7197434c51d9879d7fe62e43d7c7f8763c8cafbcb38a3bba1540e7f61b38853 WatchSource:0}: Error finding container a7197434c51d9879d7fe62e43d7c7f8763c8cafbcb38a3bba1540e7f61b38853: Status 404 returned error can't find the container with id a7197434c51d9879d7fe62e43d7c7f8763c8cafbcb38a3bba1540e7f61b38853 Jul 16 16:52:49.771750 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.771702 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.771750 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.771751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:49.771966 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.771861 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 16:52:49.771966 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.771873 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle podName:f90ab8e7-db12-47c5-8ef2-fb10b74128b6 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:50.771856238 +0000 UTC m=+37.695096405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle") pod "router-default-68f9b9d6bd-m9kzh" (UID: "f90ab8e7-db12-47c5-8ef2-fb10b74128b6") : configmap references non-existent config key: service-ca.crt Jul 16 16:52:49.771966 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.771898 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs podName:f90ab8e7-db12-47c5-8ef2-fb10b74128b6 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:50.771888018 +0000 UTC m=+37.695128185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs") pod "router-default-68f9b9d6bd-m9kzh" (UID: "f90ab8e7-db12-47c5-8ef2-fb10b74128b6") : secret "router-metrics-certs-default" not found Jul 16 16:52:49.790818 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.790785 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4vknj" event={"ID":"5bd4a1b4-0c76-460c-9b8c-069f9242dd29","Type":"ContainerStarted","Data":"a7197434c51d9879d7fe62e43d7c7f8763c8cafbcb38a3bba1540e7f61b38853"} Jul 16 16:52:49.793117 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.793082 2563 generic.go:356] "Generic (PLEG): container finished" podID="a8749d82-f357-4897-82e5-7a4a02e757f0" containerID="12e5ad1822ca65e02a1bce707846d0c60b313ee04aa61290feb50be45daa3dff" exitCode=0 Jul 16 16:52:49.793246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.793175 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdn2" event={"ID":"a8749d82-f357-4897-82e5-7a4a02e757f0","Type":"ContainerDied","Data":"12e5ad1822ca65e02a1bce707846d0c60b313ee04aa61290feb50be45daa3dff"} Jul 16 16:52:49.794507 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.794351 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" event={"ID":"ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2","Type":"ContainerStarted","Data":"56c98e77fd3f112b01d7ffdbb271b79dfb2213eb5c6298d40e98699baa21633f"} Jul 16 16:52:49.795604 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.795582 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x7x28" event={"ID":"ba7a0d6f-5c2f-4ba1-989c-36718a369e34","Type":"ContainerStarted","Data":"1f34ad522ca3d56e876f91a5ddc2a6a0ac907e2921c04f01adacb24dd72f3fe0"} Jul 16 16:52:49.796932 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.796907 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wks9k" event={"ID":"926ee6a5-b8a8-4fe0-b4ea-603be40e3d91","Type":"ContainerStarted","Data":"67332ad250591ad2e200eded8c7e9c1c54055494ff98ab72993ad3135301dc32"} Jul 16 16:52:49.798008 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.797984 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" event={"ID":"d15f86ba-0811-47e9-9079-242e244226d4","Type":"ContainerStarted","Data":"bee5058e56438f00d647e669066ddcb1281865751bbf687c0077ecd208caf34c"} Jul 16 16:52:49.799124 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.799101 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-txmzt" event={"ID":"7b1ce2c6-8921-4e94-908f-b1f88eafa433","Type":"ContainerStarted","Data":"ca7a1a86d889aca426add1c09a83204c7775629a927cb4fddb25eb20739f15be"} Jul 16 16:52:49.800737 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.800719 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" event={"ID":"b0aba567-5292-4d1f-8588-c65d1d31da4a","Type":"ContainerStarted","Data":"73e316d7df89cfe01d9b465600c42c1b27e090ff9de5aaa625ab8b2adc4034d5"} Jul 16 16:52:49.872537 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:49.872488 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:49.873270 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.872638 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:52:49.873270 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:49.872709 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls podName:03ee3d74-6c5d-43fc-acec-8310503383ba nodeName:}" failed. No retries permitted until 2026-07-16 16:52:50.872689644 +0000 UTC m=+37.795929812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls") pod "dns-default-w5lkh" (UID: "03ee3d74-6c5d-43fc-acec-8310503383ba") : secret "dns-default-metrics-tls" not found Jul 16 16:52:50.568479 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.568291 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:50.599748 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.599712 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:52:50.600240 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.600222 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:52:50.600826 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.600447 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:52:50.602062 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.602043 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 16:52:50.602545 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.602430 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 16:52:50.603134 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.602711 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jk78d\"" Jul 16 16:52:50.603134 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.602980 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2v6vk\"" Jul 16 16:52:50.624059 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.623966 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:50.681505 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.680052 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:50.681505 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.680103 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:52:50.681505 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.680191 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g2b49\" (UID: \"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" Jul 16 16:52:50.681505 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:50.680345 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 16:52:50.681505 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:50.680410 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls podName:b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e nodeName:}" failed. No retries permitted until 2026-07-16 16:52:52.680392566 +0000 UTC m=+39.603632755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls") pod "cluster-samples-operator-65db858894-g2b49" (UID: "b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e") : secret "samples-operator-tls" not found Jul 16 16:52:50.681505 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:50.681300 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:52:50.681505 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:50.681316 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f876f5f4-k2v6v: secret "image-registry-tls" not found Jul 16 16:52:50.681505 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:50.681363 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls podName:5124d017-734a-44d8-b483-58b92f4bd8eb nodeName:}" failed. No retries permitted until 2026-07-16 16:52:52.68134648 +0000 UTC m=+39.604586665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls") pod "image-registry-7f876f5f4-k2v6v" (UID: "5124d017-734a-44d8-b483-58b92f4bd8eb") : secret "image-registry-tls" not found Jul 16 16:52:50.681505 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:50.681422 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 16:52:50.681505 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:50.681471 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls podName:82f2686c-d513-41f0-aa83-24d31354bba3 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:52.68145792 +0000 UTC m=+39.604698094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ll8zj" (UID: "82f2686c-d513-41f0-aa83-24d31354bba3") : secret "cluster-monitoring-operator-tls" not found Jul 16 16:52:50.781860 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.781009 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:50.781860 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.781058 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:50.781860 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:50.781338 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 16:52:50.781860 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:50.781400 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs podName:f90ab8e7-db12-47c5-8ef2-fb10b74128b6 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:52.781381068 +0000 UTC m=+39.704621245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs") pod "router-default-68f9b9d6bd-m9kzh" (UID: "f90ab8e7-db12-47c5-8ef2-fb10b74128b6") : secret "router-metrics-certs-default" not found Jul 16 16:52:50.781860 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:50.781486 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle podName:f90ab8e7-db12-47c5-8ef2-fb10b74128b6 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:52.781475054 +0000 UTC m=+39.704715236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle") pod "router-default-68f9b9d6bd-m9kzh" (UID: "f90ab8e7-db12-47c5-8ef2-fb10b74128b6") : configmap references non-existent config key: service-ca.crt Jul 16 16:52:50.883088 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:50.882361 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:50.883088 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:50.882673 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:52:50.883088 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:50.882736 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls podName:03ee3d74-6c5d-43fc-acec-8310503383ba nodeName:}" failed. No retries permitted until 2026-07-16 16:52:52.882716108 +0000 UTC m=+39.805956280 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls") pod "dns-default-w5lkh" (UID: "03ee3d74-6c5d-43fc-acec-8310503383ba") : secret "dns-default-metrics-tls" not found Jul 16 16:52:51.818876 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:51.818794 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x7x28" event={"ID":"ba7a0d6f-5c2f-4ba1-989c-36718a369e34","Type":"ContainerStarted","Data":"ec64a36b26af2f5ec836115800a17d667f63642e08076b3842286e1ff019fedb"} Jul 16 16:52:51.919745 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:51.919684 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:52.026765 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:52.026727 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:52.363444 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:52.363411 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:52.702785 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:52.701831 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:52.702785 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:52.701881 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:52:52.702785 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:52.701957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g2b49\" (UID: \"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" Jul 16 16:52:52.702785 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:52.702122 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 16:52:52.702785 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:52.702184 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls podName:b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e nodeName:}" failed. No retries permitted until 2026-07-16 16:52:56.702166101 +0000 UTC m=+43.625406276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls") pod "cluster-samples-operator-65db858894-g2b49" (UID: "b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e") : secret "samples-operator-tls" not found Jul 16 16:52:52.702785 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:52.702601 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:52:52.702785 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:52.702616 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f876f5f4-k2v6v: secret "image-registry-tls" not found Jul 16 16:52:52.702785 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:52.702661 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls podName:5124d017-734a-44d8-b483-58b92f4bd8eb nodeName:}" failed. No retries permitted until 2026-07-16 16:52:56.702645323 +0000 UTC m=+43.625885496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls") pod "image-registry-7f876f5f4-k2v6v" (UID: "5124d017-734a-44d8-b483-58b92f4bd8eb") : secret "image-registry-tls" not found Jul 16 16:52:52.702785 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:52.702719 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 16:52:52.702785 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:52.702755 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls podName:82f2686c-d513-41f0-aa83-24d31354bba3 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:56.702743827 +0000 UTC m=+43.625983998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ll8zj" (UID: "82f2686c-d513-41f0-aa83-24d31354bba3") : secret "cluster-monitoring-operator-tls" not found Jul 16 16:52:52.802968 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:52.802932 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:52.802968 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:52.802969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:52.803246 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:52.803185 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle podName:f90ab8e7-db12-47c5-8ef2-fb10b74128b6 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:56.803161144 +0000 UTC m=+43.726401326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle") pod "router-default-68f9b9d6bd-m9kzh" (UID: "f90ab8e7-db12-47c5-8ef2-fb10b74128b6") : configmap references non-existent config key: service-ca.crt Jul 16 16:52:52.803246 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:52.803188 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 16:52:52.803363 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:52.803271 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs podName:f90ab8e7-db12-47c5-8ef2-fb10b74128b6 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:56.803240799 +0000 UTC m=+43.726480975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs") pod "router-default-68f9b9d6bd-m9kzh" (UID: "f90ab8e7-db12-47c5-8ef2-fb10b74128b6") : secret "router-metrics-certs-default" not found Jul 16 16:52:52.904414 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:52.904369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:52.904630 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:52.904602 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:52:52.904740 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:52.904672 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls podName:03ee3d74-6c5d-43fc-acec-8310503383ba nodeName:}" failed. No retries permitted until 2026-07-16 16:52:56.904652421 +0000 UTC m=+43.827892590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls") pod "dns-default-w5lkh" (UID: "03ee3d74-6c5d-43fc-acec-8310503383ba") : secret "dns-default-metrics-tls" not found Jul 16 16:52:53.495878 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:53.495842 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:54.468001 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:54.467822 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:54.561742 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:54.561701 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:56.737082 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:56.737032 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g2b49\" (UID: \"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" Jul 16 16:52:56.737498 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:56.737171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:52:56.737498 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:56.737190 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 16:52:56.737498 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:56.737199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:52:56.737498 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:56.737255 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls podName:b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e nodeName:}" failed. No retries permitted until 2026-07-16 16:53:04.73723427 +0000 UTC m=+51.660474438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls") pod "cluster-samples-operator-65db858894-g2b49" (UID: "b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e") : secret "samples-operator-tls" not found Jul 16 16:52:56.737498 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:56.737314 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 16:52:56.737498 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:56.737319 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:52:56.737498 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:56.737335 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f876f5f4-k2v6v: secret "image-registry-tls" not found Jul 16 16:52:56.737498 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:56.737373 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls podName:82f2686c-d513-41f0-aa83-24d31354bba3 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:04.737358071 +0000 UTC m=+51.660598269 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ll8zj" (UID: "82f2686c-d513-41f0-aa83-24d31354bba3") : secret "cluster-monitoring-operator-tls" not found Jul 16 16:52:56.737498 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:56.737388 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls podName:5124d017-734a-44d8-b483-58b92f4bd8eb nodeName:}" failed. No retries permitted until 2026-07-16 16:53:04.737381 +0000 UTC m=+51.660621167 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls") pod "image-registry-7f876f5f4-k2v6v" (UID: "5124d017-734a-44d8-b483-58b92f4bd8eb") : secret "image-registry-tls" not found Jul 16 16:52:56.837704 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:56.837673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:56.837881 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:56.837713 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:52:56.837881 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:56.837877 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 16:52:56.838015 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:56.837895 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle podName:f90ab8e7-db12-47c5-8ef2-fb10b74128b6 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:04.837869795 +0000 UTC m=+51.761109986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle") pod "router-default-68f9b9d6bd-m9kzh" (UID: "f90ab8e7-db12-47c5-8ef2-fb10b74128b6") : configmap references non-existent config key: service-ca.crt Jul 16 16:52:56.838015 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:56.837922 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs podName:f90ab8e7-db12-47c5-8ef2-fb10b74128b6 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:04.837911354 +0000 UTC m=+51.761151521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs") pod "router-default-68f9b9d6bd-m9kzh" (UID: "f90ab8e7-db12-47c5-8ef2-fb10b74128b6") : secret "router-metrics-certs-default" not found Jul 16 16:52:56.938262 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:56.938226 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:52:56.938428 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:56.938375 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:52:56.938480 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:52:56.938456 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls podName:03ee3d74-6c5d-43fc-acec-8310503383ba nodeName:}" failed. No retries permitted until 2026-07-16 16:53:04.938432579 +0000 UTC m=+51.861672751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls") pod "dns-default-w5lkh" (UID: "03ee3d74-6c5d-43fc-acec-8310503383ba") : secret "dns-default-metrics-tls" not found Jul 16 16:52:58.484411 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:58.484375 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:58.545687 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:58.545656 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:59.417999 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:59.417957 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:52:59.841591 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:59.841553 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" event={"ID":"b0aba567-5292-4d1f-8588-c65d1d31da4a","Type":"ContainerStarted","Data":"674fc73f5984acccf609f4023fe3e6f2845f1fb024c8929842a37602000573c6"} Jul 16 16:52:59.857605 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:59.857540 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x7x28" podStartSLOduration=19.778573408 podStartE2EDuration="21.85752333s" totalImagesPullingTime="2.078949922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:52:51.838938877 +0000 UTC m=+38.762179066" watchObservedRunningTime="2026-07-16 16:52:59.85752333 +0000 UTC m=+46.780763517" Jul 16 16:52:59.858093 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:52:59.858061 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" podStartSLOduration=17.740287811 podStartE2EDuration="27.858052707s" totalImagesPullingTime="10.117764896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:52:59.856724618 +0000 UTC m=+46.779964821" watchObservedRunningTime="2026-07-16 16:52:59.858052707 +0000 UTC m=+46.781292895" Jul 16 16:53:00.849194 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:00.849158 2563 generic.go:356] "Generic (PLEG): container finished" podID="a8749d82-f357-4897-82e5-7a4a02e757f0" containerID="d5e5ba93a261e7723601e428976b820bb8a0d8f0b97fca1f2d05839bc152d76c" exitCode=0 Jul 16 16:53:00.849639 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:00.849237 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdn2" event={"ID":"a8749d82-f357-4897-82e5-7a4a02e757f0","Type":"ContainerDied","Data":"d5e5ba93a261e7723601e428976b820bb8a0d8f0b97fca1f2d05839bc152d76c"} Jul 16 16:53:00.852676 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:00.852647 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" event={"ID":"ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2","Type":"ContainerStarted","Data":"30333c97ab47fb7cbe51d1fc375358814ce8269ef962c0695cc3a69c1f43fc81"} Jul 16 16:53:00.855207 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:00.854720 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wks9k" event={"ID":"926ee6a5-b8a8-4fe0-b4ea-603be40e3d91","Type":"ContainerStarted","Data":"2555b54ddc5f6a165a7f6ac79c60dbe963ef873f63b056b30feffb4ae6d1cc8c"} Jul 16 16:53:00.856437 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:00.856411 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" event={"ID":"d15f86ba-0811-47e9-9079-242e244226d4","Type":"ContainerStarted","Data":"4a9bbb8cd2c2c2d54df5ecbc1c7f1fdbb2db48b318ab83505b8206e4a27cb81a"} Jul 16 16:53:00.858542 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:00.858516 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-txmzt_7b1ce2c6-8921-4e94-908f-b1f88eafa433/console-operator/0.log" Jul 16 16:53:00.858661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:00.858555 2563 generic.go:356] "Generic (PLEG): container finished" podID="7b1ce2c6-8921-4e94-908f-b1f88eafa433" containerID="1dfab1762b6d8dd0f593dbcb18a531a1f47945ac440d44978ab71ef55a5d707a" exitCode=255 Jul 16 16:53:00.858661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:00.858610 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-txmzt" event={"ID":"7b1ce2c6-8921-4e94-908f-b1f88eafa433","Type":"ContainerDied","Data":"1dfab1762b6d8dd0f593dbcb18a531a1f47945ac440d44978ab71ef55a5d707a"} Jul 16 16:53:00.858847 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:00.858833 2563 scope.go:117] "RemoveContainer" containerID="1dfab1762b6d8dd0f593dbcb18a531a1f47945ac440d44978ab71ef55a5d707a" Jul 16 16:53:00.860916 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:00.860894 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4vknj" event={"ID":"5bd4a1b4-0c76-460c-9b8c-069f9242dd29","Type":"ContainerStarted","Data":"9bdb7e1fb51d085625748a45821a51bf44da0580333965feab8ebc2ab79504ae"} Jul 16 16:53:00.886272 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:00.885754 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" podStartSLOduration=8.858172531 podStartE2EDuration="18.885737138s" totalImagesPullingTime="10.027564607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:00.884648987 +0000 UTC m=+47.807889178" watchObservedRunningTime="2026-07-16 16:53:00.885737138 +0000 UTC m=+47.808977328" Jul 16 16:53:00.909529 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:00.909481 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wks9k" podStartSLOduration=2.896729375 podStartE2EDuration="12.909453626s" totalImagesPullingTime="10.012724251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:00.907075386 +0000 UTC m=+47.830315578" watchObservedRunningTime="2026-07-16 16:53:00.909453626 +0000 UTC m=+47.832693816" Jul 16 16:53:00.927582 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:00.924280 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" podStartSLOduration=8.891019362 podStartE2EDuration="18.924264152s" totalImagesPullingTime="10.03324479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:00.923821946 +0000 UTC m=+47.847062138" watchObservedRunningTime="2026-07-16 16:53:00.924264152 +0000 UTC m=+47.847504342" Jul 16 16:53:00.969970 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:00.969925 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4vknj" podStartSLOduration=6.969742577 podStartE2EDuration="16.9698995s" totalImagesPullingTime="10.000156923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:00.968969383 +0000 UTC m=+47.892209572" watchObservedRunningTime="2026-07-16 16:53:00.9698995 +0000 UTC m=+47.893139692" Jul 16 16:53:01.002893 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.002102 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xgjjg"] Jul 16 16:53:01.025480 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.025418 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xgjjg"] Jul 16 16:53:01.025618 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.025586 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.029582 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.027471 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 16:53:01.029582 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.027785 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f9x7d\"" Jul 16 16:53:01.029582 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.027981 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 16:53:01.052232 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.052197 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:01.166346 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.166314 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:01.180233 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.180206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.180334 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.180235 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wggx\" (UniqueName: \"kubernetes.io/projected/2ca12e5e-8790-4541-853b-747c59b63992-kube-api-access-5wggx\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.180412 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.180373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2ca12e5e-8790-4541-853b-747c59b63992-crio-socket\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.180498 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.180408 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ca12e5e-8790-4541-853b-747c59b63992-data-volume\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.180498 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.180441 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.228438 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.228382 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:01.281601 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.281558 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.281706 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.281613 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wggx\" (UniqueName: \"kubernetes.io/projected/2ca12e5e-8790-4541-853b-747c59b63992-kube-api-access-5wggx\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.281706 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:01.281650 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:53:01.281785 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:01.281726 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm podName:2ca12e5e-8790-4541-853b-747c59b63992 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:01.781706543 +0000 UTC m=+48.704946722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xgjjg" (UID: "2ca12e5e-8790-4541-853b-747c59b63992") : configmap "kube-rbac-proxy" not found Jul 16 16:53:01.281840 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.281803 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2ca12e5e-8790-4541-853b-747c59b63992-crio-socket\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.281889 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.281854 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ca12e5e-8790-4541-853b-747c59b63992-data-volume\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.281949 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.281889 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.281949 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.281918 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2ca12e5e-8790-4541-853b-747c59b63992-crio-socket\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.282051 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:01.282025 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:53:01.282112 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:01.282101 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls podName:2ca12e5e-8790-4541-853b-747c59b63992 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:01.782084664 +0000 UTC m=+48.705324838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xgjjg" (UID: "2ca12e5e-8790-4541-853b-747c59b63992") : secret "insights-runtime-extractor-tls" not found Jul 16 16:53:01.282148 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.282135 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ca12e5e-8790-4541-853b-747c59b63992-data-volume\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.293649 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.293630 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wggx\" (UniqueName: \"kubernetes.io/projected/2ca12e5e-8790-4541-853b-747c59b63992-kube-api-access-5wggx\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.304507 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.304480 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:01.575755 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.575666 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:01.681326 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.681297 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:01.764181 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.764144 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:01.786706 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.786683 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.786834 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.786735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:01.786882 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:01.786834 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:53:01.786882 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:01.786868 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:53:01.786947 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:01.786895 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls podName:2ca12e5e-8790-4541-853b-747c59b63992 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:02.786878553 +0000 UTC m=+49.710118724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xgjjg" (UID: "2ca12e5e-8790-4541-853b-747c59b63992") : secret "insights-runtime-extractor-tls" not found Jul 16 16:53:01.786947 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:01.786917 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm podName:2ca12e5e-8790-4541-853b-747c59b63992 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:02.786903509 +0000 UTC m=+49.710143680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xgjjg" (UID: "2ca12e5e-8790-4541-853b-747c59b63992") : configmap "kube-rbac-proxy" not found Jul 16 16:53:01.842763 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.842678 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:01.865832 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.865812 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-txmzt_7b1ce2c6-8921-4e94-908f-b1f88eafa433/console-operator/1.log" Jul 16 16:53:01.866251 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.866184 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-txmzt_7b1ce2c6-8921-4e94-908f-b1f88eafa433/console-operator/0.log" Jul 16 16:53:01.866251 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.866214 2563 generic.go:356] "Generic (PLEG): container finished" podID="7b1ce2c6-8921-4e94-908f-b1f88eafa433" containerID="b8389fc6065a5dc3c101fdb7b8efca73aed567ac5bbeaa5a5a58262c45ca1697" exitCode=255 Jul 16 16:53:01.866356 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.866293 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-txmzt" event={"ID":"7b1ce2c6-8921-4e94-908f-b1f88eafa433","Type":"ContainerDied","Data":"b8389fc6065a5dc3c101fdb7b8efca73aed567ac5bbeaa5a5a58262c45ca1697"} Jul 16 16:53:01.866409 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.866355 2563 scope.go:117] "RemoveContainer" containerID="1dfab1762b6d8dd0f593dbcb18a531a1f47945ac440d44978ab71ef55a5d707a" Jul 16 16:53:01.866599 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.866557 2563 scope.go:117] "RemoveContainer" containerID="b8389fc6065a5dc3c101fdb7b8efca73aed567ac5bbeaa5a5a58262c45ca1697" Jul 16 16:53:01.866766 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:01.866740 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-txmzt_openshift-console-operator(7b1ce2c6-8921-4e94-908f-b1f88eafa433)\"" pod="openshift-console-operator/console-operator-7866497494-txmzt" podUID="7b1ce2c6-8921-4e94-908f-b1f88eafa433" Jul 16 16:53:01.869379 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.869359 2563 generic.go:356] "Generic (PLEG): container finished" podID="a8749d82-f357-4897-82e5-7a4a02e757f0" containerID="1c92b649823963e3d27a22e4d5b1805c70e2dc9e1e312834433319a5f5f6463c" exitCode=0 Jul 16 16:53:01.869489 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.869451 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdn2" event={"ID":"a8749d82-f357-4897-82e5-7a4a02e757f0","Type":"ContainerDied","Data":"1c92b649823963e3d27a22e4d5b1805c70e2dc9e1e312834433319a5f5f6463c"} Jul 16 16:53:01.910218 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:01.910182 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:02.400014 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:02.399984 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6mpfx_f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a/dns-node-resolver/0.log" Jul 16 16:53:02.797429 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:02.797395 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:02.797615 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:02.797526 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:53:02.797615 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:02.797527 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:02.797615 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:02.797612 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm podName:2ca12e5e-8790-4541-853b-747c59b63992 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:04.797591904 +0000 UTC m=+51.720832071 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xgjjg" (UID: "2ca12e5e-8790-4541-853b-747c59b63992") : configmap "kube-rbac-proxy" not found Jul 16 16:53:02.797737 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:02.797629 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:53:02.797737 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:02.797671 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls podName:2ca12e5e-8790-4541-853b-747c59b63992 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:04.797659346 +0000 UTC m=+51.720899517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xgjjg" (UID: "2ca12e5e-8790-4541-853b-747c59b63992") : secret "insights-runtime-extractor-tls" not found Jul 16 16:53:02.874093 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:02.874069 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-txmzt_7b1ce2c6-8921-4e94-908f-b1f88eafa433/console-operator/1.log" Jul 16 16:53:02.874539 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:02.874427 2563 scope.go:117] "RemoveContainer" containerID="b8389fc6065a5dc3c101fdb7b8efca73aed567ac5bbeaa5a5a58262c45ca1697" Jul 16 16:53:02.874656 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:02.874628 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-txmzt_openshift-console-operator(7b1ce2c6-8921-4e94-908f-b1f88eafa433)\"" pod="openshift-console-operator/console-operator-7866497494-txmzt" podUID="7b1ce2c6-8921-4e94-908f-b1f88eafa433" Jul 16 16:53:02.877351 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:02.877324 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdn2" event={"ID":"a8749d82-f357-4897-82e5-7a4a02e757f0","Type":"ContainerStarted","Data":"dd57c84a6f777683907d8b81292015319e449a42252d16cd0c8047ff08322ad3"} Jul 16 16:53:02.923287 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:02.923242 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qfdn2" podStartSLOduration=8.339644592 podStartE2EDuration="48.923226231s" totalImagesPullingTime="40.583581639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:02.921903811 +0000 UTC m=+49.845144000" watchObservedRunningTime="2026-07-16 16:53:02.923226231 +0000 UTC m=+49.846466421" Jul 16 16:53:03.067595 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:03.067501 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:03.144158 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:03.144127 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:03.401078 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:03.401006 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6fwnq_e6be25c0-d3f1-449a-9a74-5915c0ac7965/node-ca/0.log" Jul 16 16:53:03.497069 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:03.497035 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:03.594054 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:03.594028 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:04.281398 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:04.281360 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:04.335812 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:04.335774 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:04.400447 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:04.400417 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wks9k_926ee6a5-b8a8-4fe0-b4ea-603be40e3d91/serve-healthcheck-canary/0.log" Jul 16 16:53:04.814239 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:04.814205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:04.814414 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:04.814260 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:04.814414 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:04.814317 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:53:04.814414 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:04.814336 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:53:04.814414 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:04.814360 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:53:04.814414 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:04.814407 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:53:04.814624 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:04.814428 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls podName:2ca12e5e-8790-4541-853b-747c59b63992 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:08.814409512 +0000 UTC m=+55.737649681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xgjjg" (UID: "2ca12e5e-8790-4541-853b-747c59b63992") : secret "insights-runtime-extractor-tls" not found Jul 16 16:53:04.814624 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:04.814435 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:53:04.814624 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:04.814450 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f876f5f4-k2v6v: secret "image-registry-tls" not found Jul 16 16:53:04.814624 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:04.814459 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm podName:2ca12e5e-8790-4541-853b-747c59b63992 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:08.814443584 +0000 UTC m=+55.737683753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xgjjg" (UID: "2ca12e5e-8790-4541-853b-747c59b63992") : configmap "kube-rbac-proxy" not found Jul 16 16:53:04.814624 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:04.814409 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g2b49\" (UID: \"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" Jul 16 16:53:04.814624 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:04.814479 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 16:53:04.814624 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:04.814491 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls podName:5124d017-734a-44d8-b483-58b92f4bd8eb nodeName:}" failed. No retries permitted until 2026-07-16 16:53:20.814474264 +0000 UTC m=+67.737714432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls") pod "image-registry-7f876f5f4-k2v6v" (UID: "5124d017-734a-44d8-b483-58b92f4bd8eb") : secret "image-registry-tls" not found Jul 16 16:53:04.814624 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:04.814520 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls podName:b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e nodeName:}" failed. No retries permitted until 2026-07-16 16:53:20.814508478 +0000 UTC m=+67.737748648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls") pod "cluster-samples-operator-65db858894-g2b49" (UID: "b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e") : secret "samples-operator-tls" not found Jul 16 16:53:04.814624 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:04.814520 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 16:53:04.814624 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:04.814592 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls podName:82f2686c-d513-41f0-aa83-24d31354bba3 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:20.81455625 +0000 UTC m=+67.737796431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ll8zj" (UID: "82f2686c-d513-41f0-aa83-24d31354bba3") : secret "cluster-monitoring-operator-tls" not found Jul 16 16:53:04.915387 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:04.915352 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:53:04.915387 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:04.915392 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:53:04.915543 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:04.915500 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle podName:f90ab8e7-db12-47c5-8ef2-fb10b74128b6 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:20.915481918 +0000 UTC m=+67.838722088 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle") pod "router-default-68f9b9d6bd-m9kzh" (UID: "f90ab8e7-db12-47c5-8ef2-fb10b74128b6") : configmap references non-existent config key: service-ca.crt Jul 16 16:53:04.915602 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:04.915544 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 16:53:04.915646 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:04.915602 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs podName:f90ab8e7-db12-47c5-8ef2-fb10b74128b6 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:20.915590382 +0000 UTC m=+67.838830550 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs") pod "router-default-68f9b9d6bd-m9kzh" (UID: "f90ab8e7-db12-47c5-8ef2-fb10b74128b6") : secret "router-metrics-certs-default" not found Jul 16 16:53:05.015915 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:05.015885 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:53:05.016058 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:05.016014 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:53:05.016092 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:05.016065 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls podName:03ee3d74-6c5d-43fc-acec-8310503383ba nodeName:}" failed. No retries permitted until 2026-07-16 16:53:21.016052074 +0000 UTC m=+67.939292241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls") pod "dns-default-w5lkh" (UID: "03ee3d74-6c5d-43fc-acec-8310503383ba") : secret "dns-default-metrics-tls" not found Jul 16 16:53:06.534729 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:06.534692 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:06.599149 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:06.599121 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:07.064527 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:07.064495 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:08.455674 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:08.455641 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:08.716541 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:08.716451 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:08.820945 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:08.820908 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:08.847603 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:08.847553 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:08.847763 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:08.847744 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:08.847896 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:08.847879 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:53:08.847952 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:08.847943 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls podName:2ca12e5e-8790-4541-853b-747c59b63992 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:16.84792737 +0000 UTC m=+63.771167540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xgjjg" (UID: "2ca12e5e-8790-4541-853b-747c59b63992") : secret "insights-runtime-extractor-tls" not found Jul 16 16:53:08.848023 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:08.848006 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ca12e5e-8790-4541-853b-747c59b63992-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:08.924758 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:08.924729 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:09.018399 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:09.018313 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:09.158855 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:09.158826 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:09.258974 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:09.258941 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:09.361031 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:09.360956 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:53:09.361152 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:09.361041 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:53:09.361325 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:09.361312 2563 scope.go:117] "RemoveContainer" containerID="b8389fc6065a5dc3c101fdb7b8efca73aed567ac5bbeaa5a5a58262c45ca1697" Jul 16 16:53:09.361462 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:09.361445 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-txmzt_openshift-console-operator(7b1ce2c6-8921-4e94-908f-b1f88eafa433)\"" pod="openshift-console-operator/console-operator-7866497494-txmzt" podUID="7b1ce2c6-8921-4e94-908f-b1f88eafa433" Jul 16 16:53:09.460061 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:09.460034 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:09.560008 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:09.559976 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:09.636121 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:09.636050 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:09.900031 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:09.899960 2563 scope.go:117] "RemoveContainer" containerID="b8389fc6065a5dc3c101fdb7b8efca73aed567ac5bbeaa5a5a58262c45ca1697" Jul 16 16:53:09.900151 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:53:09.900105 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-txmzt_openshift-console-operator(7b1ce2c6-8921-4e94-908f-b1f88eafa433)\"" pod="openshift-console-operator/console-operator-7866497494-txmzt" podUID="7b1ce2c6-8921-4e94-908f-b1f88eafa433" Jul 16 16:53:10.557671 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:10.557631 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:10.953437 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:10.953405 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:11.163181 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:11.163148 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:11.364311 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:11.364224 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:11.752979 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:11.752947 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:12.146765 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:12.146682 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:12.343213 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:12.343180 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:12.398554 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:12.398485 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:12.751323 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:12.751292 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:12.960280 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:12.960249 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:13.061128 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:13.061058 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:13.353600 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:13.353505 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:13.478595 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:13.478551 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:13.578082 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:13.578053 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:13.783958 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:13.783934 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8z9j" Jul 16 16:53:13.954263 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:13.954226 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:14.381483 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:14.381445 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:14.657176 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:14.657089 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:14.775700 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:14.775670 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:14.972718 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:14.972682 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:15.551471 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:15.551433 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:16.158206 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:16.158170 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:16.349059 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:16.349022 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:16.751759 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:16.751724 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:16.913762 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:16.913725 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:16.916097 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:16.916078 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ca12e5e-8790-4541-853b-747c59b63992-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xgjjg\" (UID: \"2ca12e5e-8790-4541-853b-747c59b63992\") " pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:16.941969 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:16.941947 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f9x7d\"" Jul 16 16:53:16.951137 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:16.951123 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xgjjg" Jul 16 16:53:16.954138 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:16.954109 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:17.084937 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:17.084778 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xgjjg"] Jul 16 16:53:17.087447 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:53:17.087421 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca12e5e_8790_4541_853b_747c59b63992.slice/crio-794f321a6a64561f2e918c7fb8fc7c6a0524c80f22539163ce8ca3f9b3279e70 WatchSource:0}: Error finding container 794f321a6a64561f2e918c7fb8fc7c6a0524c80f22539163ce8ca3f9b3279e70: Status 404 returned error can't find the container with id 794f321a6a64561f2e918c7fb8fc7c6a0524c80f22539163ce8ca3f9b3279e70 Jul 16 16:53:17.924545 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:17.924508 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xgjjg" event={"ID":"2ca12e5e-8790-4541-853b-747c59b63992","Type":"ContainerStarted","Data":"794f321a6a64561f2e918c7fb8fc7c6a0524c80f22539163ce8ca3f9b3279e70"} Jul 16 16:53:18.325148 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.325108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs\") pod \"network-metrics-daemon-p8bxj\" (UID: \"616b8d16-1b94-4015-bd70-d3f891934cc0\") " pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:53:18.327129 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.327114 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 16:53:18.337645 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.337539 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/616b8d16-1b94-4015-bd70-d3f891934cc0-metrics-certs\") pod \"network-metrics-daemon-p8bxj\" (UID: \"616b8d16-1b94-4015-bd70-d3f891934cc0\") " pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:53:18.425535 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.425484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:53:18.425715 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.425656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8sn\" (UniqueName: \"kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn\") pod \"network-check-target-2ltgt\" (UID: \"ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54\") " pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:53:18.427535 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.427511 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 16:53:18.428185 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.428161 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g8sn\" (UniqueName: \"kubernetes.io/projected/ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54-kube-api-access-5g8sn\") pod \"network-check-target-2ltgt\" (UID: \"ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54\") " pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:53:18.437860 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.437832 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/affdec92-dfd2-49b0-878a-4ef13cc5bfa0-original-pull-secret\") pod \"global-pull-secret-syncer-k4c97\" (UID: \"affdec92-dfd2-49b0-878a-4ef13cc5bfa0\") " pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:53:18.517332 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.517300 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2v6vk\"" Jul 16 16:53:18.526531 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.526504 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bxj" Jul 16 16:53:18.527722 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.527705 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4c97" Jul 16 16:53:18.538492 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.538470 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jk78d\"" Jul 16 16:53:18.546880 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.546859 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:53:18.679708 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.679669 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p8bxj"] Jul 16 16:53:18.683092 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:53:18.683064 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616b8d16_1b94_4015_bd70_d3f891934cc0.slice/crio-5bbb00a2fb275581fb96ca1c9d7aa97f9cc19d287b9f1d1b6ab949e84f9b08fa WatchSource:0}: Error finding container 5bbb00a2fb275581fb96ca1c9d7aa97f9cc19d287b9f1d1b6ab949e84f9b08fa: Status 404 returned error can't find the container with id 5bbb00a2fb275581fb96ca1c9d7aa97f9cc19d287b9f1d1b6ab949e84f9b08fa Jul 16 16:53:18.695981 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.695952 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k4c97"] Jul 16 16:53:18.699768 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:53:18.699736 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaffdec92_dfd2_49b0_878a_4ef13cc5bfa0.slice/crio-7be5ff86007c1b8f9f3cd403c5646ad8cc6ae98ec5a00689147c73ffe5c0a6ba WatchSource:0}: Error finding container 7be5ff86007c1b8f9f3cd403c5646ad8cc6ae98ec5a00689147c73ffe5c0a6ba: Status 404 returned error can't find the container with id 7be5ff86007c1b8f9f3cd403c5646ad8cc6ae98ec5a00689147c73ffe5c0a6ba Jul 16 16:53:18.717811 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.717599 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2ltgt"] Jul 16 16:53:18.720939 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:53:18.720911 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca5e32e7_3eaa_4aa2_80b2_aff9c2fd3d54.slice/crio-f462327709aee180bbdcddc1aad007c4ed014fe02651430e04d3be5057c4b836 WatchSource:0}: Error finding container f462327709aee180bbdcddc1aad007c4ed014fe02651430e04d3be5057c4b836: Status 404 returned error can't find the container with id f462327709aee180bbdcddc1aad007c4ed014fe02651430e04d3be5057c4b836 Jul 16 16:53:18.795919 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.795863 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:18.892356 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.892247 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:18.939426 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.939318 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8bxj" event={"ID":"616b8d16-1b94-4015-bd70-d3f891934cc0","Type":"ContainerStarted","Data":"5bbb00a2fb275581fb96ca1c9d7aa97f9cc19d287b9f1d1b6ab949e84f9b08fa"} Jul 16 16:53:18.942400 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.942364 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k4c97" event={"ID":"affdec92-dfd2-49b0-878a-4ef13cc5bfa0","Type":"ContainerStarted","Data":"7be5ff86007c1b8f9f3cd403c5646ad8cc6ae98ec5a00689147c73ffe5c0a6ba"} Jul 16 16:53:18.946622 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.946139 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2ltgt" event={"ID":"ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54","Type":"ContainerStarted","Data":"1bfdada9c901507b084797b7137ba064084e30d070ce5a3e73b7dd3e31cb6d11"} Jul 16 16:53:18.946622 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.946171 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2ltgt" event={"ID":"ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54","Type":"ContainerStarted","Data":"f462327709aee180bbdcddc1aad007c4ed014fe02651430e04d3be5057c4b836"} Jul 16 16:53:18.946622 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.946334 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:53:18.962344 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.962287 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2ltgt" podStartSLOduration=65.96226902 podStartE2EDuration="1m5.96226902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:18.960769068 +0000 UTC m=+65.884009259" watchObservedRunningTime="2026-07-16 16:53:18.96226902 +0000 UTC m=+65.885509211" Jul 16 16:53:18.967226 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:18.967190 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:19.149046 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:19.148963 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:19.208450 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:19.208298 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:20.599791 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.599756 2563 scope.go:117] "RemoveContainer" containerID="b8389fc6065a5dc3c101fdb7b8efca73aed567ac5bbeaa5a5a58262c45ca1697" Jul 16 16:53:20.852139 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.852068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:53:20.852139 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.852119 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:53:20.852345 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.852325 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g2b49\" (UID: \"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" Jul 16 16:53:20.855877 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.855046 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/82f2686c-d513-41f0-aa83-24d31354bba3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ll8zj\" (UID: \"82f2686c-d513-41f0-aa83-24d31354bba3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:53:20.855877 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.855168 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-g2b49\" (UID: \"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" Jul 16 16:53:20.855877 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.855441 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls\") pod \"image-registry-7f876f5f4-k2v6v\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:53:20.952993 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.952955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:53:20.952993 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.953007 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:53:20.953692 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.953665 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-service-ca-bundle\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:53:20.956155 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.956134 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f90ab8e7-db12-47c5-8ef2-fb10b74128b6-metrics-certs\") pod \"router-default-68f9b9d6bd-m9kzh\" (UID: \"f90ab8e7-db12-47c5-8ef2-fb10b74128b6\") " pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:53:20.959408 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.959382 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8bxj" event={"ID":"616b8d16-1b94-4015-bd70-d3f891934cc0","Type":"ContainerStarted","Data":"a39bc5c682c723f3c46dd1294711d2bdfadbf20a71cc3e01f7c330dc45d8cf32"} Jul 16 16:53:20.959524 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.959440 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8bxj" event={"ID":"616b8d16-1b94-4015-bd70-d3f891934cc0","Type":"ContainerStarted","Data":"d2237f2f4b08af75b3093edd56965c9e9922ba6558360c65f17b5093d9de10a1"} Jul 16 16:53:20.965539 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.965510 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-txmzt_7b1ce2c6-8921-4e94-908f-b1f88eafa433/console-operator/1.log" Jul 16 16:53:20.965682 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.965605 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-txmzt" event={"ID":"7b1ce2c6-8921-4e94-908f-b1f88eafa433","Type":"ContainerStarted","Data":"df1d3857603206f194b7ab1eda063bab52b12c8cd712bc4f2dcc1298999cb58d"} Jul 16 16:53:20.965904 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.965881 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:53:20.975820 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.975772 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p8bxj" podStartSLOduration=66.816810232 podStartE2EDuration="1m7.975732235s" totalImagesPullingTime="1.158922003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:20.975074064 +0000 UTC m=+67.898314254" watchObservedRunningTime="2026-07-16 16:53:20.975732235 +0000 UTC m=+67.898972427" Jul 16 16:53:20.991841 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:20.991768 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-txmzt" podStartSLOduration=31.870863002 podStartE2EDuration="41.99175424s" totalImagesPullingTime="10.120891238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:20.990803797 +0000 UTC m=+67.914043986" watchObservedRunningTime="2026-07-16 16:53:20.99175424 +0000 UTC m=+67.914994429" Jul 16 16:53:21.044233 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:21.044201 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7vjt2\"" Jul 16 16:53:21.053897 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:21.053864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:53:21.054288 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:21.054269 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:53:21.057309 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:21.057280 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03ee3d74-6c5d-43fc-acec-8310503383ba-metrics-tls\") pod \"dns-default-w5lkh\" (UID: \"03ee3d74-6c5d-43fc-acec-8310503383ba\") " pod="openshift-dns/dns-default-w5lkh" Jul 16 16:53:21.075596 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:21.075550 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-k4dtf\"" Jul 16 16:53:21.083946 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:21.083918 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" Jul 16 16:53:21.109480 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:21.109416 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dhmc8\"" Jul 16 16:53:21.116070 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:21.116045 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" Jul 16 16:53:21.142401 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:21.142379 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wpt7l\"" Jul 16 16:53:21.150975 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:21.150938 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:53:21.235632 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:21.235598 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2f6zt\"" Jul 16 16:53:21.244886 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:21.244703 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w5lkh" Jul 16 16:53:21.950024 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:21.949994 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-txmzt" Jul 16 16:53:22.137445 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:22.137407 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:22.373842 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:22.373728 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:22.428075 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:22.428036 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:22.806893 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:22.806856 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:22.869018 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:22.868926 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:23.207633 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:23.207586 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:23.268824 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:23.268789 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:23.404776 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:23.404744 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:23.505893 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:23.505789 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:24.030764 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:24.030729 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:24.139698 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:24.139657 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:24.239608 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:24.239552 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:24.445057 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:24.445020 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:25.385665 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:25.385626 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68f9b9d6bd-m9kzh"] Jul 16 16:53:25.411750 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:53:25.411718 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf90ab8e7_db12_47c5_8ef2_fb10b74128b6.slice/crio-6e8b6b4ef288afdd505617b7acc94d21a474674a29665418cfcf58bdb4f8c3f3 WatchSource:0}: Error finding container 6e8b6b4ef288afdd505617b7acc94d21a474674a29665418cfcf58bdb4f8c3f3: Status 404 returned error can't find the container with id 6e8b6b4ef288afdd505617b7acc94d21a474674a29665418cfcf58bdb4f8c3f3 Jul 16 16:53:25.604873 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:25.604845 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w5lkh"] Jul 16 16:53:25.608340 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:53:25.608310 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ee3d74_6c5d_43fc_acec_8310503383ba.slice/crio-c4488029dd42e188be2306add8d5e28590cb0f2c683d5938658839fead08c87b WatchSource:0}: Error finding container c4488029dd42e188be2306add8d5e28590cb0f2c683d5938658839fead08c87b: Status 404 returned error can't find the container with id c4488029dd42e188be2306add8d5e28590cb0f2c683d5938658839fead08c87b Jul 16 16:53:25.611335 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:25.611311 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f876f5f4-k2v6v"] Jul 16 16:53:25.615112 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:53:25.615086 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5124d017_734a_44d8_b483_58b92f4bd8eb.slice/crio-0982f1d53577c27a22f238a7b5170cf47aa6bfd185b5cf87b61f8cfaaf808529 WatchSource:0}: Error finding container 0982f1d53577c27a22f238a7b5170cf47aa6bfd185b5cf87b61f8cfaaf808529: Status 404 returned error can't find the container with id 0982f1d53577c27a22f238a7b5170cf47aa6bfd185b5cf87b61f8cfaaf808529 Jul 16 16:53:25.643195 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:25.643153 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49"] Jul 16 16:53:25.644082 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:25.644030 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj"] Jul 16 16:53:25.647027 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:53:25.646999 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f2686c_d513_41f0_aa83_24d31354bba3.slice/crio-ff4a8f94d3391e3e969cbf423341faf5fb105d705aa354e4097ee275c7c56b3e WatchSource:0}: Error finding container ff4a8f94d3391e3e969cbf423341faf5fb105d705aa354e4097ee275c7c56b3e: Status 404 returned error can't find the container with id ff4a8f94d3391e3e969cbf423341faf5fb105d705aa354e4097ee275c7c56b3e Jul 16 16:53:25.856118 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:25.856083 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:25.992975 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:25.992937 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" event={"ID":"5124d017-734a-44d8-b483-58b92f4bd8eb","Type":"ContainerStarted","Data":"030463efd6510ea9f2e5f29b775502e1142b3e67c12a2007f7b623ef7879789e"} Jul 16 16:53:25.993164 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:25.992995 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" event={"ID":"5124d017-734a-44d8-b483-58b92f4bd8eb","Type":"ContainerStarted","Data":"0982f1d53577c27a22f238a7b5170cf47aa6bfd185b5cf87b61f8cfaaf808529"} Jul 16 16:53:25.993164 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:25.993047 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:53:25.994817 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:25.994788 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w5lkh" event={"ID":"03ee3d74-6c5d-43fc-acec-8310503383ba","Type":"ContainerStarted","Data":"c4488029dd42e188be2306add8d5e28590cb0f2c683d5938658839fead08c87b"} Jul 16 16:53:25.998040 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:25.998008 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" event={"ID":"f90ab8e7-db12-47c5-8ef2-fb10b74128b6","Type":"ContainerStarted","Data":"80bee7585e010cae6d24a200e1449b4c76490570334e8d7148f6587a0e72f088"} Jul 16 16:53:25.998162 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:25.998092 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" event={"ID":"f90ab8e7-db12-47c5-8ef2-fb10b74128b6","Type":"ContainerStarted","Data":"6e8b6b4ef288afdd505617b7acc94d21a474674a29665418cfcf58bdb4f8c3f3"} Jul 16 16:53:25.999542 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:25.999515 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" event={"ID":"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e","Type":"ContainerStarted","Data":"de949fdbcdbced953cb630dfdbda701e82b3490c247483e98615e1b3390c5c0d"} Jul 16 16:53:26.001996 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:26.001657 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k4c97" event={"ID":"affdec92-dfd2-49b0-878a-4ef13cc5bfa0","Type":"ContainerStarted","Data":"9088db08ea4bf149f8539c4a2af098b93712255518ada9ea7cc76349f64bf357"} Jul 16 16:53:26.003925 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:26.003896 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" event={"ID":"82f2686c-d513-41f0-aa83-24d31354bba3","Type":"ContainerStarted","Data":"ff4a8f94d3391e3e969cbf423341faf5fb105d705aa354e4097ee275c7c56b3e"} Jul 16 16:53:26.006171 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:26.006147 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xgjjg" event={"ID":"2ca12e5e-8790-4541-853b-747c59b63992","Type":"ContainerStarted","Data":"369c848acaf5adfee008de1d21a91a9e314cb8071057b5f2314c83eac2aed032"} Jul 16 16:53:26.011439 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:26.011400 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" podStartSLOduration=72.011386005 podStartE2EDuration="1m12.011386005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:26.009742875 +0000 UTC m=+72.932983089" watchObservedRunningTime="2026-07-16 16:53:26.011386005 +0000 UTC m=+72.934626195" Jul 16 16:53:26.027257 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:26.027195 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" podStartSLOduration=54.027175584 podStartE2EDuration="54.027175584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:26.025981571 +0000 UTC m=+72.949221767" watchObservedRunningTime="2026-07-16 16:53:26.027175584 +0000 UTC m=+72.950415774" Jul 16 16:53:26.046352 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:26.046008 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k4c97" podStartSLOduration=65.529544156 podStartE2EDuration="1m12.045989056s" totalImagesPullingTime="6.5164449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:26.04524934 +0000 UTC m=+72.968489530" watchObservedRunningTime="2026-07-16 16:53:26.045989056 +0000 UTC m=+72.969229246" Jul 16 16:53:26.151581 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:26.151490 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:53:26.154939 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:26.154709 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:53:27.012537 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:27.012496 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:53:27.014219 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:27.013983 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-68f9b9d6bd-m9kzh" Jul 16 16:53:27.358724 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:27.358541 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:27.605764 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:27.605731 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:27.663414 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:27.663321 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:27.724634 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:27.724595 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:28.316482 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:28.316442 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:28.376865 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:28.376829 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:28.473941 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:28.473908 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:28.532404 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:28.532363 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:30.640821 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.640740 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:30.658857 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.658825 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c97785b4b-jzbsm"] Jul 16 16:53:30.739461 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.739419 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:30.753553 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.753528 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c97785b4b-jzbsm"] Jul 16 16:53:30.753694 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.753663 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.755830 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.755804 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 16:53:30.755968 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.755832 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 16:53:30.756101 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.756085 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 16:53:30.756194 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.756153 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 16:53:30.756194 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.756170 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 16:53:30.756415 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.756396 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 16:53:30.756415 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.756407 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 16:53:30.756553 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.756455 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5gqfc\"" Jul 16 16:53:30.840618 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.840585 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkjgj\" (UniqueName: \"kubernetes.io/projected/dee395c3-ca2d-42cc-9108-3785f83a223b-kube-api-access-hkjgj\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.840770 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.840675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-oauth-serving-cert\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.840770 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.840708 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-service-ca\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.840770 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.840736 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dee395c3-ca2d-42cc-9108-3785f83a223b-console-oauth-config\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.840770 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.840765 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-console-config\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.840953 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.840822 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dee395c3-ca2d-42cc-9108-3785f83a223b-console-serving-cert\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.942249 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.942182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkjgj\" (UniqueName: \"kubernetes.io/projected/dee395c3-ca2d-42cc-9108-3785f83a223b-kube-api-access-hkjgj\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.942399 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.942376 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-oauth-serving-cert\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.942461 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.942408 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-service-ca\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.942461 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.942433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dee395c3-ca2d-42cc-9108-3785f83a223b-console-oauth-config\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.942614 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.942466 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-console-config\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.942614 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.942497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dee395c3-ca2d-42cc-9108-3785f83a223b-console-serving-cert\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.943227 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.943147 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-oauth-serving-cert\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.943442 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.943289 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-service-ca\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.943442 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.943302 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-console-config\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.945140 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.945115 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dee395c3-ca2d-42cc-9108-3785f83a223b-console-oauth-config\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.945281 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.945263 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dee395c3-ca2d-42cc-9108-3785f83a223b-console-serving-cert\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:30.950705 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:30.950681 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkjgj\" (UniqueName: \"kubernetes.io/projected/dee395c3-ca2d-42cc-9108-3785f83a223b-kube-api-access-hkjgj\") pod \"console-5c97785b4b-jzbsm\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:31.064393 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:31.064368 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:31.534492 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:31.534432 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c97785b4b-jzbsm"] Jul 16 16:53:31.536962 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:53:31.536942 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee395c3_ca2d_42cc_9108_3785f83a223b.slice/crio-d421c9c8ffd0b6a476957f3da7ee534daf34b0e0a682d40a568ab6797594148c WatchSource:0}: Error finding container d421c9c8ffd0b6a476957f3da7ee534daf34b0e0a682d40a568ab6797594148c: Status 404 returned error can't find the container with id d421c9c8ffd0b6a476957f3da7ee534daf34b0e0a682d40a568ab6797594148c Jul 16 16:53:31.843799 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:31.843770 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:31.943385 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:31.943351 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:32.027993 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:32.027911 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:32.031669 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:32.031642 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" event={"ID":"82f2686c-d513-41f0-aa83-24d31354bba3","Type":"ContainerStarted","Data":"814eb846a7b02773a7cc612cd0b87680d767c8bcf79c07c46f77c2af896a63af"} Jul 16 16:53:32.033487 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:32.033460 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xgjjg" event={"ID":"2ca12e5e-8790-4541-853b-747c59b63992","Type":"ContainerStarted","Data":"32e89a6ba4914d7b1b65229089393282bdb361e10f652e12f16a557378aef2fc"} Jul 16 16:53:32.035389 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:32.035365 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w5lkh" event={"ID":"03ee3d74-6c5d-43fc-acec-8310503383ba","Type":"ContainerStarted","Data":"48a69658ddd994c2d66a4f3ba05e78e0667c2d83c056a69010402bcaffa90883"} Jul 16 16:53:32.035515 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:32.035412 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w5lkh" event={"ID":"03ee3d74-6c5d-43fc-acec-8310503383ba","Type":"ContainerStarted","Data":"bd8fcb57d5974376725fa09a28df404185b3dcffee5e4bca388341c994c6aed6"} Jul 16 16:53:32.035515 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:32.035443 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w5lkh" Jul 16 16:53:32.036668 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:32.036648 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c97785b4b-jzbsm" event={"ID":"dee395c3-ca2d-42cc-9108-3785f83a223b","Type":"ContainerStarted","Data":"d421c9c8ffd0b6a476957f3da7ee534daf34b0e0a682d40a568ab6797594148c"} Jul 16 16:53:32.038379 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:32.038360 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" event={"ID":"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e","Type":"ContainerStarted","Data":"6c3ad7a844046d69c3c8d8caf000865ffefd6fc1aa812e9e278fa447f2497f54"} Jul 16 16:53:32.038459 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:32.038404 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" event={"ID":"b2d24d8c-dfd8-4bac-bd3f-c83fd7b22a9e","Type":"ContainerStarted","Data":"f0edbe714931a3b9d4dbbde45e60a37115635614a3076b5a8e5746fc43dfaa5c"} Jul 16 16:53:32.047976 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:32.047937 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ll8zj" podStartSLOduration=54.297460983 podStartE2EDuration="1m0.047920773s" totalImagesPullingTime="5.75045979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:32.047268054 +0000 UTC m=+78.970508246" watchObservedRunningTime="2026-07-16 16:53:32.047920773 +0000 UTC m=+78.971160963" Jul 16 16:53:32.066747 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:32.066710 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w5lkh" podStartSLOduration=38.281253895 podStartE2EDuration="44.066696109s" totalImagesPullingTime="5.785442214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:32.06623332 +0000 UTC m=+78.989473509" watchObservedRunningTime="2026-07-16 16:53:32.066696109 +0000 UTC m=+78.989936476" Jul 16 16:53:32.084114 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:32.084076 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-g2b49" podStartSLOduration=48.387943956 podStartE2EDuration="54.084064132s" totalImagesPullingTime="5.696120176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:32.08326246 +0000 UTC m=+79.006502663" watchObservedRunningTime="2026-07-16 16:53:32.084064132 +0000 UTC m=+79.007304321" Jul 16 16:53:32.853943 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:32.853881 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:33.444197 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:33.444145 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:34.725365 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:34.725231 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:34.784684 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:34.784650 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:34.888612 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:34.888560 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:36.404011 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:36.403965 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:37.060643 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:37.060601 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xgjjg" event={"ID":"2ca12e5e-8790-4541-853b-747c59b63992","Type":"ContainerStarted","Data":"6dbac8c3e7ca11d8f7f91bad695208ffdc85ac0bc799db6d1f4d2ba31e650bd0"} Jul 16 16:53:37.062140 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:37.062118 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c97785b4b-jzbsm" event={"ID":"dee395c3-ca2d-42cc-9108-3785f83a223b","Type":"ContainerStarted","Data":"238fb3facb8d9f416faafcf4b2b7fa7e8a61be0560d897c32548f49e4ab5197a"} Jul 16 16:53:37.079934 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:37.079887 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xgjjg" podStartSLOduration=17.798150582 podStartE2EDuration="37.079874443s" totalImagesPullingTime="19.281723861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:53:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:37.079064252 +0000 UTC m=+84.002304444" watchObservedRunningTime="2026-07-16 16:53:37.079874443 +0000 UTC m=+84.003114631" Jul 16 16:53:37.098457 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:37.098412 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c97785b4b-jzbsm" podStartSLOduration=1.9977781079999999 podStartE2EDuration="7.098399565s" totalImagesPullingTime="5.100621457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:37.096937575 +0000 UTC m=+84.020177764" watchObservedRunningTime="2026-07-16 16:53:37.098399565 +0000 UTC m=+84.021639753" Jul 16 16:53:38.324203 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:38.324172 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:38.427178 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:38.427134 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:38.644278 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:38.644189 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:41.064662 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:41.064625 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:41.065094 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:41.064674 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:41.069276 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:41.069254 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:41.080086 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:41.080066 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:53:42.045590 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:42.045545 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w5lkh" Jul 16 16:53:42.173196 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:42.173147 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:42.460148 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:42.460116 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:42.514037 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:42.514008 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:43.963711 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:43.963656 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:44.063575 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:44.063532 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:47.017054 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:47.017026 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:53:47.258832 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:47.258798 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f876f5f4-k2v6v"] Jul 16 16:53:47.335496 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:47.335413 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:47.390301 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:47.390272 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:47.749029 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:47.748997 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:47.813439 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:47.813410 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:48.493626 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:48.493587 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:48.550579 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:48.550540 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:48.607461 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:48.607425 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:49.058774 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:49.058735 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:49.161435 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:49.161398 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:49.221239 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:49.221210 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:49.955025 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:49.954999 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2ltgt" Jul 16 16:53:50.248668 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:50.248589 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:50.825662 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:50.825625 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:50.929752 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:50.929714 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:51.095465 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:51.095370 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:51.888642 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:51.888606 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:52.852553 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:52.852466 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:52.952878 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:52.952851 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:53.395249 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:53.395221 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c97785b4b-jzbsm"] Jul 16 16:53:54.289799 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.289765 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:54.410025 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.409991 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:54.508332 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.508300 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:54.538906 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.538879 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ngfqh"] Jul 16 16:53:54.583630 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.583531 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:54.678316 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.678288 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:54.711620 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.711595 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-7kgbv"] Jul 16 16:53:54.711756 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.711704 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.713930 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.713904 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 16:53:54.714057 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.713971 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 16:53:54.714057 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.714003 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 16:53:54.714326 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.714306 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 16:53:54.714365 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.714313 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-298gc\"" Jul 16 16:53:54.734264 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.734235 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-7kgbv"] Jul 16 16:53:54.734400 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.734351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.736334 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.736312 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 16 16:53:54.736473 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.736357 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 16 16:53:54.736473 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.736463 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5pkzd\"" Jul 16 16:53:54.736616 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.736512 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 16 16:53:54.778299 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.778262 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:54.831767 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.831737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-tls\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.831946 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.831778 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/397d19fc-89cc-44cc-a138-5e6370deb80e-root\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.831946 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.831831 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.831946 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.831861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.831946 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.831899 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.831946 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.831922 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.832252 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.832003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/397d19fc-89cc-44cc-a138-5e6370deb80e-metrics-client-ca\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.832252 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.832043 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.832252 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.832085 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-textfile\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.832252 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.832129 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjxpg\" (UniqueName: \"kubernetes.io/projected/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-kube-api-access-mjxpg\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.832252 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.832207 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/397d19fc-89cc-44cc-a138-5e6370deb80e-sys\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.832252 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.832233 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-wtmp\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.832491 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.832257 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.832491 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.832291 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st9bx\" (UniqueName: \"kubernetes.io/projected/397d19fc-89cc-44cc-a138-5e6370deb80e-kube-api-access-st9bx\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.832491 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.832376 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.879194 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.879117 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:54.932864 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.932836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/397d19fc-89cc-44cc-a138-5e6370deb80e-sys\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.932864 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.932864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-wtmp\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.933077 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.932884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.933077 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.932903 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st9bx\" (UniqueName: \"kubernetes.io/projected/397d19fc-89cc-44cc-a138-5e6370deb80e-kube-api-access-st9bx\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.933077 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.932932 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.933077 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.932943 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/397d19fc-89cc-44cc-a138-5e6370deb80e-sys\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.933077 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.933029 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-wtmp\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.933077 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.933040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-tls\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.933077 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.933073 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/397d19fc-89cc-44cc-a138-5e6370deb80e-root\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.933413 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.933100 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.933413 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.933131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.933413 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.933160 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/397d19fc-89cc-44cc-a138-5e6370deb80e-root\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.933413 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.933174 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.933413 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.933203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.933413 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.933248 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/397d19fc-89cc-44cc-a138-5e6370deb80e-metrics-client-ca\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.933413 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.933277 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.933413 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.933319 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-textfile\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.933413 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.933341 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxpg\" (UniqueName: \"kubernetes.io/projected/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-kube-api-access-mjxpg\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.934024 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.933513 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.934024 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.933760 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.934126 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.934025 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-textfile\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.934205 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.934144 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.934484 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.934460 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/397d19fc-89cc-44cc-a138-5e6370deb80e-metrics-client-ca\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.934608 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.934535 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.935944 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.935907 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.936026 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.935984 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.936236 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.936217 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/397d19fc-89cc-44cc-a138-5e6370deb80e-node-exporter-tls\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.936694 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.936672 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.940742 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.940719 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st9bx\" (UniqueName: \"kubernetes.io/projected/397d19fc-89cc-44cc-a138-5e6370deb80e-kube-api-access-st9bx\") pod \"node-exporter-ngfqh\" (UID: \"397d19fc-89cc-44cc-a138-5e6370deb80e\") " pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:54.941036 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.941018 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjxpg\" (UniqueName: \"kubernetes.io/projected/aa69d716-f6c9-4dc4-8d12-a7d9846a7072-kube-api-access-mjxpg\") pod \"kube-state-metrics-785778ff74-7kgbv\" (UID: \"aa69d716-f6c9-4dc4-8d12-a7d9846a7072\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:54.979063 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:54.979041 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:55.020611 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:55.020587 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ngfqh" Jul 16 16:53:55.042813 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:55.042793 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" Jul 16 16:53:55.059295 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:53:55.059269 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397d19fc_89cc_44cc_a138_5e6370deb80e.slice/crio-0e98d8d5cf5a90cae2b35f02b9999cffa6b9f491e34b60dd87a5287663f2a0d2 WatchSource:0}: Error finding container 0e98d8d5cf5a90cae2b35f02b9999cffa6b9f491e34b60dd87a5287663f2a0d2: Status 404 returned error can't find the container with id 0e98d8d5cf5a90cae2b35f02b9999cffa6b9f491e34b60dd87a5287663f2a0d2 Jul 16 16:53:55.130784 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:55.130708 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ngfqh" event={"ID":"397d19fc-89cc-44cc-a138-5e6370deb80e","Type":"ContainerStarted","Data":"0e98d8d5cf5a90cae2b35f02b9999cffa6b9f491e34b60dd87a5287663f2a0d2"} Jul 16 16:53:55.201418 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:55.201386 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-7kgbv"] Jul 16 16:53:55.204232 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:53:55.204200 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa69d716_f6c9_4dc4_8d12_a7d9846a7072.slice/crio-d2cf1b371b108305b46fe34868748cf348f3c9af1093ff86ab3b65437f446088 WatchSource:0}: Error finding container d2cf1b371b108305b46fe34868748cf348f3c9af1093ff86ab3b65437f446088: Status 404 returned error can't find the container with id d2cf1b371b108305b46fe34868748cf348f3c9af1093ff86ab3b65437f446088 Jul 16 16:53:55.342446 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:55.342413 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:55.494291 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:55.494258 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:55.592821 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:55.592739 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:55.666024 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:55.665989 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:55.953040 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:55.953005 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:56.137486 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:56.137447 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" event={"ID":"aa69d716-f6c9-4dc4-8d12-a7d9846a7072","Type":"ContainerStarted","Data":"d2cf1b371b108305b46fe34868748cf348f3c9af1093ff86ab3b65437f446088"} Jul 16 16:53:56.330613 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:56.330489 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:56.427408 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:56.427372 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:57.140005 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.139966 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:57.240320 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.240294 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:57.455452 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.455425 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:57.555756 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.555718 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:57.592187 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.592122 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-dcfbccd5d-b52gz"] Jul 16 16:53:57.603962 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.603937 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.606028 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.606007 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 16 16:53:57.606908 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.606307 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 16 16:53:57.606908 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.606530 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-m5jxf\"" Jul 16 16:53:57.606908 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.606749 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 16 16:53:57.607111 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.607040 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 16 16:53:57.607321 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.607275 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 16 16:53:57.607389 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.607376 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-91jbbpanltdvt\"" Jul 16 16:53:57.610610 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.610591 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-dcfbccd5d-b52gz"] Jul 16 16:53:57.655832 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.655807 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:57.710512 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.710490 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:57.756600 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.756552 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-tls\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.756714 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.756608 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.756714 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.756694 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-grpc-tls\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.756817 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.756730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.756817 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.756751 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.756888 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.756824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b9a13f6-156c-4bad-b2d5-e436438d28cb-metrics-client-ca\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.756888 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.756872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpjjs\" (UniqueName: \"kubernetes.io/projected/2b9a13f6-156c-4bad-b2d5-e436438d28cb-kube-api-access-fpjjs\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.756946 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.756898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.857593 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.857509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b9a13f6-156c-4bad-b2d5-e436438d28cb-metrics-client-ca\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.857593 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.857546 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpjjs\" (UniqueName: \"kubernetes.io/projected/2b9a13f6-156c-4bad-b2d5-e436438d28cb-kube-api-access-fpjjs\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.857748 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.857598 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.857748 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.857626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-tls\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.857748 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.857648 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.857748 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.857681 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-grpc-tls\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.857748 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.857715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.857748 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.857743 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.858388 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.858363 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b9a13f6-156c-4bad-b2d5-e436438d28cb-metrics-client-ca\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.860407 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.860381 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-tls\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.860491 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.860410 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.860842 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.860821 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.860842 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.860831 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-grpc-tls\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.860949 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.860878 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.860949 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.860897 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b9a13f6-156c-4bad-b2d5-e436438d28cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.865369 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.865353 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpjjs\" (UniqueName: \"kubernetes.io/projected/2b9a13f6-156c-4bad-b2d5-e436438d28cb-kube-api-access-fpjjs\") pod \"thanos-querier-dcfbccd5d-b52gz\" (UID: \"2b9a13f6-156c-4bad-b2d5-e436438d28cb\") " pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:57.915391 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:57.915370 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:53:58.081659 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.081629 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-dcfbccd5d-b52gz"] Jul 16 16:53:58.084618 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:53:58.084594 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9a13f6_156c_4bad_b2d5_e436438d28cb.slice/crio-cf2b1eb24df4ad8a47d0b8110da46fdb676868d4a9c09ae4026f06692e2bec7d WatchSource:0}: Error finding container cf2b1eb24df4ad8a47d0b8110da46fdb676868d4a9c09ae4026f06692e2bec7d: Status 404 returned error can't find the container with id cf2b1eb24df4ad8a47d0b8110da46fdb676868d4a9c09ae4026f06692e2bec7d Jul 16 16:53:58.151192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.151117 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" event={"ID":"2b9a13f6-156c-4bad-b2d5-e436438d28cb","Type":"ContainerStarted","Data":"cf2b1eb24df4ad8a47d0b8110da46fdb676868d4a9c09ae4026f06692e2bec7d"} Jul 16 16:53:58.152934 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.152910 2563 generic.go:356] "Generic (PLEG): container finished" podID="397d19fc-89cc-44cc-a138-5e6370deb80e" containerID="88c56f5205051e78b41bdc9253a4eb2167e0ac54960164087470865767292321" exitCode=0 Jul 16 16:53:58.153017 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.152995 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ngfqh" event={"ID":"397d19fc-89cc-44cc-a138-5e6370deb80e","Type":"ContainerDied","Data":"88c56f5205051e78b41bdc9253a4eb2167e0ac54960164087470865767292321"} Jul 16 16:53:58.155041 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.155018 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" event={"ID":"aa69d716-f6c9-4dc4-8d12-a7d9846a7072","Type":"ContainerStarted","Data":"dbb50d424bf18b28c8f12d154d115ccbe1a27189d771af8411379573b572bd04"} Jul 16 16:53:58.155155 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.155069 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" event={"ID":"aa69d716-f6c9-4dc4-8d12-a7d9846a7072","Type":"ContainerStarted","Data":"7c91218a2a82269243c02221b214a871f1d00c3bd4b1ce57d1cef390279a3b3d"} Jul 16 16:53:58.155155 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.155120 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" event={"ID":"aa69d716-f6c9-4dc4-8d12-a7d9846a7072","Type":"ContainerStarted","Data":"ce269ce9a7e8dd98125f801cabf805abcdad8ff9d6ee8bc9f35f933bb699ad0a"} Jul 16 16:53:58.186774 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.186737 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-7kgbv" podStartSLOduration=2.291877785 podStartE2EDuration="4.186724333s" totalImagesPullingTime="1.894846548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:58.185728528 +0000 UTC m=+105.108968741" watchObservedRunningTime="2026-07-16 16:53:58.186724333 +0000 UTC m=+105.109964522" Jul 16 16:53:58.479077 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.479025 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:58.581484 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.581456 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:58.945997 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.945959 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-868d7b44c7-gnccp"] Jul 16 16:53:58.981301 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.981261 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-868d7b44c7-gnccp"] Jul 16 16:53:58.981478 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.981400 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:58.984347 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.984308 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 16:53:58.984480 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.984432 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 16 16:53:58.984543 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.984479 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 16 16:53:58.984543 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.984508 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 16 16:53:58.984543 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.984520 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-22kkl1c4h0kjb\"" Jul 16 16:53:58.984543 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:58.984432 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mdbgr\"" Jul 16 16:53:59.160963 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.160914 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ngfqh" event={"ID":"397d19fc-89cc-44cc-a138-5e6370deb80e","Type":"ContainerStarted","Data":"7c120686570dc3a3340bfb631eb66d66bb897ea78a17d04e04e1d3405ab33592"} Jul 16 16:53:59.161147 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.160977 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ngfqh" event={"ID":"397d19fc-89cc-44cc-a138-5e6370deb80e","Type":"ContainerStarted","Data":"c120e833647d1cb0656a397138513238f4fa547c4a70292117b9b458e6a570d3"} Jul 16 16:53:59.169622 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.169594 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d74f47d8-8a86-483b-8654-287101e9b491-metrics-server-audit-profiles\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.169768 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.169649 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d74f47d8-8a86-483b-8654-287101e9b491-secret-metrics-server-tls\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.169768 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.169696 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d74f47d8-8a86-483b-8654-287101e9b491-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.169768 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.169723 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d74f47d8-8a86-483b-8654-287101e9b491-client-ca-bundle\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.169768 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.169747 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d74f47d8-8a86-483b-8654-287101e9b491-secret-metrics-server-client-certs\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.169898 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.169769 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4jql\" (UniqueName: \"kubernetes.io/projected/d74f47d8-8a86-483b-8654-287101e9b491-kube-api-access-t4jql\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.169898 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.169800 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d74f47d8-8a86-483b-8654-287101e9b491-audit-log\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.179430 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.179375 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ngfqh" podStartSLOduration=3.01541451 podStartE2EDuration="5.179359026s" totalImagesPullingTime="2.03741792s" totalInitContainerRuntime="126.526596ms" isStatefulPod=true podCreationTimestamp="2026-07-16 16:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:59.178679467 +0000 UTC m=+106.101919653" watchObservedRunningTime="2026-07-16 16:53:59.179359026 +0000 UTC m=+106.102599214" Jul 16 16:53:59.244917 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.244833 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:59.262312 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.262265 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs"] Jul 16 16:53:59.271175 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.271111 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4jql\" (UniqueName: \"kubernetes.io/projected/d74f47d8-8a86-483b-8654-287101e9b491-kube-api-access-t4jql\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.271379 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.271234 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d74f47d8-8a86-483b-8654-287101e9b491-audit-log\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.271379 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.271291 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d74f47d8-8a86-483b-8654-287101e9b491-metrics-server-audit-profiles\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.271507 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.271413 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d74f47d8-8a86-483b-8654-287101e9b491-secret-metrics-server-tls\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.271507 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.271488 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d74f47d8-8a86-483b-8654-287101e9b491-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.271708 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.271543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d74f47d8-8a86-483b-8654-287101e9b491-client-ca-bundle\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.271708 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.271605 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d74f47d8-8a86-483b-8654-287101e9b491-secret-metrics-server-client-certs\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.272383 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.272342 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d74f47d8-8a86-483b-8654-287101e9b491-audit-log\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.273404 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.273351 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d74f47d8-8a86-483b-8654-287101e9b491-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.273550 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.273456 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d74f47d8-8a86-483b-8654-287101e9b491-metrics-server-audit-profiles\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.274994 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.274952 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d74f47d8-8a86-483b-8654-287101e9b491-secret-metrics-server-client-certs\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.275947 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.275919 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d74f47d8-8a86-483b-8654-287101e9b491-client-ca-bundle\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.276231 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.276210 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d74f47d8-8a86-483b-8654-287101e9b491-secret-metrics-server-tls\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.278160 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.278112 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs"] Jul 16 16:53:59.278259 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.278222 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs" Jul 16 16:53:59.279994 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.279973 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 16 16:53:59.280175 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.279974 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-x748m\"" Jul 16 16:53:59.282192 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.282170 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4jql\" (UniqueName: \"kubernetes.io/projected/d74f47d8-8a86-483b-8654-287101e9b491-kube-api-access-t4jql\") pod \"metrics-server-868d7b44c7-gnccp\" (UID: \"d74f47d8-8a86-483b-8654-287101e9b491\") " pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.292468 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.292444 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:53:59.306766 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.306711 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:59.430250 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.430215 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:53:59.459987 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.459960 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-868d7b44c7-gnccp"] Jul 16 16:53:59.462487 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:53:59.462457 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74f47d8_8a86_483b_8654_287101e9b491.slice/crio-5c94fc2868f4d6eec58ecaf7af00113583421c3316c6a6acb84c07066ca60c77 WatchSource:0}: Error finding container 5c94fc2868f4d6eec58ecaf7af00113583421c3316c6a6acb84c07066ca60c77: Status 404 returned error can't find the container with id 5c94fc2868f4d6eec58ecaf7af00113583421c3316c6a6acb84c07066ca60c77 Jul 16 16:53:59.473476 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.473454 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1317aca-0b0c-49a2-b48a-53b8e54b3a2b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-wqnhs\" (UID: \"b1317aca-0b0c-49a2-b48a-53b8e54b3a2b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs" Jul 16 16:53:59.473588 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.473487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml2qw\" (UniqueName: \"kubernetes.io/projected/b1317aca-0b0c-49a2-b48a-53b8e54b3a2b-kube-api-access-ml2qw\") pod \"monitoring-plugin-5f68df7f58-wqnhs\" (UID: \"b1317aca-0b0c-49a2-b48a-53b8e54b3a2b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs" Jul 16 16:53:59.574003 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.573919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1317aca-0b0c-49a2-b48a-53b8e54b3a2b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-wqnhs\" (UID: \"b1317aca-0b0c-49a2-b48a-53b8e54b3a2b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs" Jul 16 16:53:59.574003 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.573960 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml2qw\" (UniqueName: \"kubernetes.io/projected/b1317aca-0b0c-49a2-b48a-53b8e54b3a2b-kube-api-access-ml2qw\") pod \"monitoring-plugin-5f68df7f58-wqnhs\" (UID: \"b1317aca-0b0c-49a2-b48a-53b8e54b3a2b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs" Jul 16 16:53:59.576916 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.576892 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1317aca-0b0c-49a2-b48a-53b8e54b3a2b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-wqnhs\" (UID: \"b1317aca-0b0c-49a2-b48a-53b8e54b3a2b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs" Jul 16 16:53:59.583028 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.583003 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml2qw\" (UniqueName: \"kubernetes.io/projected/b1317aca-0b0c-49a2-b48a-53b8e54b3a2b-kube-api-access-ml2qw\") pod \"monitoring-plugin-5f68df7f58-wqnhs\" (UID: \"b1317aca-0b0c-49a2-b48a-53b8e54b3a2b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs" Jul 16 16:53:59.601810 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:53:59.601775 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs" Jul 16 16:54:00.073068 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:00.073031 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:54:00.131389 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:00.131358 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:54:00.166476 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:00.166446 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" event={"ID":"d74f47d8-8a86-483b-8654-287101e9b491","Type":"ContainerStarted","Data":"5c94fc2868f4d6eec58ecaf7af00113583421c3316c6a6acb84c07066ca60c77"} Jul 16 16:54:00.217552 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:00.217515 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:54:00.303940 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:00.303889 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs"] Jul 16 16:54:00.382619 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:54:00.382526 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1317aca_0b0c_49a2_b48a_53b8e54b3a2b.slice/crio-e10e492c36ece3290cfc21b11b497183df2647d298c0bc1f97d57120b7c18cbb WatchSource:0}: Error finding container e10e492c36ece3290cfc21b11b497183df2647d298c0bc1f97d57120b7c18cbb: Status 404 returned error can't find the container with id e10e492c36ece3290cfc21b11b497183df2647d298c0bc1f97d57120b7c18cbb Jul 16 16:54:00.756242 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:00.756209 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:54:01.174626 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:01.174553 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" event={"ID":"2b9a13f6-156c-4bad-b2d5-e436438d28cb","Type":"ContainerStarted","Data":"6e8fea5aabd1459394862484977c0f73f0f891a73fb917899f87df8a8611a31f"} Jul 16 16:54:01.174819 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:01.174704 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" event={"ID":"2b9a13f6-156c-4bad-b2d5-e436438d28cb","Type":"ContainerStarted","Data":"477ffd8c14418f49db1d6ab9fbfd3004be7ef48bffd122985d9d2c86322aad49"} Jul 16 16:54:01.174819 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:01.174749 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" event={"ID":"2b9a13f6-156c-4bad-b2d5-e436438d28cb","Type":"ContainerStarted","Data":"870f0bb45c910bed812cb54f46804252d60e965498bc5335d94366404f517b40"} Jul 16 16:54:01.176065 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:01.176030 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs" event={"ID":"b1317aca-0b0c-49a2-b48a-53b8e54b3a2b","Type":"ContainerStarted","Data":"e10e492c36ece3290cfc21b11b497183df2647d298c0bc1f97d57120b7c18cbb"} Jul 16 16:54:03.187007 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:03.186967 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" event={"ID":"d74f47d8-8a86-483b-8654-287101e9b491","Type":"ContainerStarted","Data":"43cd1a88747afce58b2f4fee88da5a001e7d5f466215046f40ae3c80517454d3"} Jul 16 16:54:03.190055 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:03.190023 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" event={"ID":"2b9a13f6-156c-4bad-b2d5-e436438d28cb","Type":"ContainerStarted","Data":"2ed1981e7594c4a663fbb45dc7b5a1a76d3296947fd19b9cc7d4721fffa172fb"} Jul 16 16:54:03.190206 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:03.190127 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" event={"ID":"2b9a13f6-156c-4bad-b2d5-e436438d28cb","Type":"ContainerStarted","Data":"f80ef37a5b9655e77eb04fc1215853186f957547d6e092e320f37e838d031dd2"} Jul 16 16:54:03.190206 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:03.190174 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" event={"ID":"2b9a13f6-156c-4bad-b2d5-e436438d28cb","Type":"ContainerStarted","Data":"5363ba3f7afe5869535c0831a3321ec706c7f356011a5f93b6086770981c7e8b"} Jul 16 16:54:03.190305 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:03.190222 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:54:03.191757 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:03.191737 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs" event={"ID":"b1317aca-0b0c-49a2-b48a-53b8e54b3a2b","Type":"ContainerStarted","Data":"90182323401f59bee72280d8e02530bfb81b5f58f21812135d3ccf7556ef6972"} Jul 16 16:54:03.191930 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:03.191910 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs" Jul 16 16:54:03.197319 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:03.197300 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs" Jul 16 16:54:03.206385 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:03.206347 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" podStartSLOduration=2.333834457 podStartE2EDuration="5.206334887s" totalImagesPullingTime="2.87250043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:54:03.205710524 +0000 UTC m=+110.128950730" watchObservedRunningTime="2026-07-16 16:54:03.206334887 +0000 UTC m=+110.129575076" Jul 16 16:54:03.220107 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:03.220069 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wqnhs" podStartSLOduration=2.270784415 podStartE2EDuration="4.220052611s" totalImagesPullingTime="1.949268196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:54:03.219025195 +0000 UTC m=+110.142265385" watchObservedRunningTime="2026-07-16 16:54:03.220052611 +0000 UTC m=+110.143292802" Jul 16 16:54:03.243031 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:03.242981 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" podStartSLOduration=2.29283561 podStartE2EDuration="6.242964524s" totalImagesPullingTime="3.950128914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:54:03.241011578 +0000 UTC m=+110.164251767" watchObservedRunningTime="2026-07-16 16:54:03.242964524 +0000 UTC m=+110.166204710" Jul 16 16:54:09.202909 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:09.202874 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-dcfbccd5d-b52gz" Jul 16 16:54:10.618202 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:10.618171 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:54:10.718420 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:10.718384 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:54:10.772533 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:10.772502 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:54:12.279387 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.279327 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" podUID="5124d017-734a-44d8-b483-58b92f4bd8eb" containerName="registry" containerID="cri-o://030463efd6510ea9f2e5f29b775502e1142b3e67c12a2007f7b623ef7879789e" gracePeriod=30 Jul 16 16:54:12.520480 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.520457 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:54:12.581829 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.581749 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls\") pod \"5124d017-734a-44d8-b483-58b92f4bd8eb\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " Jul 16 16:54:12.581829 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.581796 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8d96\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-kube-api-access-b8d96\") pod \"5124d017-734a-44d8-b483-58b92f4bd8eb\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " Jul 16 16:54:12.581829 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.581820 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5124d017-734a-44d8-b483-58b92f4bd8eb-image-registry-private-configuration\") pod \"5124d017-734a-44d8-b483-58b92f4bd8eb\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " Jul 16 16:54:12.582089 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.581845 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-bound-sa-token\") pod \"5124d017-734a-44d8-b483-58b92f4bd8eb\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " Jul 16 16:54:12.582089 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.581946 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5124d017-734a-44d8-b483-58b92f4bd8eb-trusted-ca\") pod \"5124d017-734a-44d8-b483-58b92f4bd8eb\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " Jul 16 16:54:12.582089 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.582060 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5124d017-734a-44d8-b483-58b92f4bd8eb-ca-trust-extracted\") pod \"5124d017-734a-44d8-b483-58b92f4bd8eb\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " Jul 16 16:54:12.582268 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.582098 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-certificates\") pod \"5124d017-734a-44d8-b483-58b92f4bd8eb\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " Jul 16 16:54:12.582268 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.582139 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5124d017-734a-44d8-b483-58b92f4bd8eb-installation-pull-secrets\") pod \"5124d017-734a-44d8-b483-58b92f4bd8eb\" (UID: \"5124d017-734a-44d8-b483-58b92f4bd8eb\") " Jul 16 16:54:12.582460 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.582425 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5124d017-734a-44d8-b483-58b92f4bd8eb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5124d017-734a-44d8-b483-58b92f4bd8eb" (UID: "5124d017-734a-44d8-b483-58b92f4bd8eb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:54:12.583439 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.582841 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5124d017-734a-44d8-b483-58b92f4bd8eb" (UID: "5124d017-734a-44d8-b483-58b92f4bd8eb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:54:12.585044 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.585012 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5124d017-734a-44d8-b483-58b92f4bd8eb" (UID: "5124d017-734a-44d8-b483-58b92f4bd8eb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:54:12.585155 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.585047 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5124d017-734a-44d8-b483-58b92f4bd8eb" (UID: "5124d017-734a-44d8-b483-58b92f4bd8eb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:54:12.585226 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.585154 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5124d017-734a-44d8-b483-58b92f4bd8eb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5124d017-734a-44d8-b483-58b92f4bd8eb" (UID: "5124d017-734a-44d8-b483-58b92f4bd8eb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:54:12.585283 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.585235 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-kube-api-access-b8d96" (OuterVolumeSpecName: "kube-api-access-b8d96") pod "5124d017-734a-44d8-b483-58b92f4bd8eb" (UID: "5124d017-734a-44d8-b483-58b92f4bd8eb"). InnerVolumeSpecName "kube-api-access-b8d96". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:54:12.585283 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.585256 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5124d017-734a-44d8-b483-58b92f4bd8eb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5124d017-734a-44d8-b483-58b92f4bd8eb" (UID: "5124d017-734a-44d8-b483-58b92f4bd8eb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:54:12.591579 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.591543 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5124d017-734a-44d8-b483-58b92f4bd8eb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5124d017-734a-44d8-b483-58b92f4bd8eb" (UID: "5124d017-734a-44d8-b483-58b92f4bd8eb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:54:12.683229 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.683201 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5124d017-734a-44d8-b483-58b92f4bd8eb-installation-pull-secrets\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:54:12.683229 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.683226 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:54:12.683229 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.683236 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8d96\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-kube-api-access-b8d96\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:54:12.683410 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.683244 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5124d017-734a-44d8-b483-58b92f4bd8eb-image-registry-private-configuration\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:54:12.683410 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.683253 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5124d017-734a-44d8-b483-58b92f4bd8eb-bound-sa-token\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:54:12.683410 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.683261 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5124d017-734a-44d8-b483-58b92f4bd8eb-trusted-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:54:12.683410 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.683269 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5124d017-734a-44d8-b483-58b92f4bd8eb-ca-trust-extracted\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:54:12.683410 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:12.683277 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5124d017-734a-44d8-b483-58b92f4bd8eb-registry-certificates\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:54:13.232925 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:13.232895 2563 generic.go:356] "Generic (PLEG): container finished" podID="5124d017-734a-44d8-b483-58b92f4bd8eb" containerID="030463efd6510ea9f2e5f29b775502e1142b3e67c12a2007f7b623ef7879789e" exitCode=0 Jul 16 16:54:13.233097 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:13.232943 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" Jul 16 16:54:13.233097 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:13.232992 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" event={"ID":"5124d017-734a-44d8-b483-58b92f4bd8eb","Type":"ContainerDied","Data":"030463efd6510ea9f2e5f29b775502e1142b3e67c12a2007f7b623ef7879789e"} Jul 16 16:54:13.233097 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:13.233044 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f876f5f4-k2v6v" event={"ID":"5124d017-734a-44d8-b483-58b92f4bd8eb","Type":"ContainerDied","Data":"0982f1d53577c27a22f238a7b5170cf47aa6bfd185b5cf87b61f8cfaaf808529"} Jul 16 16:54:13.233097 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:13.233065 2563 scope.go:117] "RemoveContainer" containerID="030463efd6510ea9f2e5f29b775502e1142b3e67c12a2007f7b623ef7879789e" Jul 16 16:54:13.241838 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:13.241820 2563 scope.go:117] "RemoveContainer" containerID="030463efd6510ea9f2e5f29b775502e1142b3e67c12a2007f7b623ef7879789e" Jul 16 16:54:13.242092 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:54:13.242073 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"030463efd6510ea9f2e5f29b775502e1142b3e67c12a2007f7b623ef7879789e\": container with ID starting with 030463efd6510ea9f2e5f29b775502e1142b3e67c12a2007f7b623ef7879789e not found: ID does not exist" containerID="030463efd6510ea9f2e5f29b775502e1142b3e67c12a2007f7b623ef7879789e" Jul 16 16:54:13.242149 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:13.242100 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"030463efd6510ea9f2e5f29b775502e1142b3e67c12a2007f7b623ef7879789e"} err="failed to get container status \"030463efd6510ea9f2e5f29b775502e1142b3e67c12a2007f7b623ef7879789e\": rpc error: code = NotFound desc = could not find container \"030463efd6510ea9f2e5f29b775502e1142b3e67c12a2007f7b623ef7879789e\": container with ID starting with 030463efd6510ea9f2e5f29b775502e1142b3e67c12a2007f7b623ef7879789e not found: ID does not exist" Jul 16 16:54:13.258901 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:13.258871 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f876f5f4-k2v6v"] Jul 16 16:54:13.261319 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:13.261295 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f876f5f4-k2v6v"] Jul 16 16:54:13.484088 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:13.483999 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:54:13.537184 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:13.537159 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:54:13.603948 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:13.603921 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5124d017-734a-44d8-b483-58b92f4bd8eb" path="/var/lib/kubelet/pods/5124d017-734a-44d8-b483-58b92f4bd8eb/volumes" Jul 16 16:54:18.419985 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.419923 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c97785b4b-jzbsm" podUID="dee395c3-ca2d-42cc-9108-3785f83a223b" containerName="console" containerID="cri-o://238fb3facb8d9f416faafcf4b2b7fa7e8a61be0560d897c32548f49e4ab5197a" gracePeriod=15 Jul 16 16:54:18.658325 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.658300 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:54:18.733932 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.733909 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dee395c3-ca2d-42cc-9108-3785f83a223b-console-serving-cert\") pod \"dee395c3-ca2d-42cc-9108-3785f83a223b\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " Jul 16 16:54:18.734079 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.733969 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-oauth-serving-cert\") pod \"dee395c3-ca2d-42cc-9108-3785f83a223b\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " Jul 16 16:54:18.734079 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.734002 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkjgj\" (UniqueName: \"kubernetes.io/projected/dee395c3-ca2d-42cc-9108-3785f83a223b-kube-api-access-hkjgj\") pod \"dee395c3-ca2d-42cc-9108-3785f83a223b\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " Jul 16 16:54:18.734079 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.734022 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-service-ca\") pod \"dee395c3-ca2d-42cc-9108-3785f83a223b\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " Jul 16 16:54:18.734079 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.734049 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dee395c3-ca2d-42cc-9108-3785f83a223b-console-oauth-config\") pod \"dee395c3-ca2d-42cc-9108-3785f83a223b\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " Jul 16 16:54:18.734288 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.734100 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-console-config\") pod \"dee395c3-ca2d-42cc-9108-3785f83a223b\" (UID: \"dee395c3-ca2d-42cc-9108-3785f83a223b\") " Jul 16 16:54:18.734437 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.734407 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-service-ca" (OuterVolumeSpecName: "service-ca") pod "dee395c3-ca2d-42cc-9108-3785f83a223b" (UID: "dee395c3-ca2d-42cc-9108-3785f83a223b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:54:18.734509 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.734409 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dee395c3-ca2d-42cc-9108-3785f83a223b" (UID: "dee395c3-ca2d-42cc-9108-3785f83a223b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:54:18.734509 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.734464 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-console-config" (OuterVolumeSpecName: "console-config") pod "dee395c3-ca2d-42cc-9108-3785f83a223b" (UID: "dee395c3-ca2d-42cc-9108-3785f83a223b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:54:18.736265 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.736235 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee395c3-ca2d-42cc-9108-3785f83a223b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dee395c3-ca2d-42cc-9108-3785f83a223b" (UID: "dee395c3-ca2d-42cc-9108-3785f83a223b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:54:18.736358 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.736278 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dee395c3-ca2d-42cc-9108-3785f83a223b-kube-api-access-hkjgj" (OuterVolumeSpecName: "kube-api-access-hkjgj") pod "dee395c3-ca2d-42cc-9108-3785f83a223b" (UID: "dee395c3-ca2d-42cc-9108-3785f83a223b"). InnerVolumeSpecName "kube-api-access-hkjgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:54:18.736358 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.736348 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee395c3-ca2d-42cc-9108-3785f83a223b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dee395c3-ca2d-42cc-9108-3785f83a223b" (UID: "dee395c3-ca2d-42cc-9108-3785f83a223b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:54:18.835031 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.835003 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-oauth-serving-cert\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:54:18.835031 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.835030 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkjgj\" (UniqueName: \"kubernetes.io/projected/dee395c3-ca2d-42cc-9108-3785f83a223b-kube-api-access-hkjgj\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:54:18.835174 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.835045 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:54:18.835174 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.835057 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dee395c3-ca2d-42cc-9108-3785f83a223b-console-oauth-config\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:54:18.835174 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.835069 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dee395c3-ca2d-42cc-9108-3785f83a223b-console-config\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:54:18.835174 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:18.835080 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dee395c3-ca2d-42cc-9108-3785f83a223b-console-serving-cert\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:54:19.259959 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:19.259923 2563 generic.go:356] "Generic (PLEG): container finished" podID="dee395c3-ca2d-42cc-9108-3785f83a223b" containerID="238fb3facb8d9f416faafcf4b2b7fa7e8a61be0560d897c32548f49e4ab5197a" exitCode=0 Jul 16 16:54:19.260087 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:19.259966 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c97785b4b-jzbsm" event={"ID":"dee395c3-ca2d-42cc-9108-3785f83a223b","Type":"ContainerDied","Data":"238fb3facb8d9f416faafcf4b2b7fa7e8a61be0560d897c32548f49e4ab5197a"} Jul 16 16:54:19.260087 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:19.259971 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c97785b4b-jzbsm" Jul 16 16:54:19.260087 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:19.260016 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c97785b4b-jzbsm" event={"ID":"dee395c3-ca2d-42cc-9108-3785f83a223b","Type":"ContainerDied","Data":"d421c9c8ffd0b6a476957f3da7ee534daf34b0e0a682d40a568ab6797594148c"} Jul 16 16:54:19.260087 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:19.260043 2563 scope.go:117] "RemoveContainer" containerID="238fb3facb8d9f416faafcf4b2b7fa7e8a61be0560d897c32548f49e4ab5197a" Jul 16 16:54:19.268911 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:19.268891 2563 scope.go:117] "RemoveContainer" containerID="238fb3facb8d9f416faafcf4b2b7fa7e8a61be0560d897c32548f49e4ab5197a" Jul 16 16:54:19.269177 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:54:19.269158 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"238fb3facb8d9f416faafcf4b2b7fa7e8a61be0560d897c32548f49e4ab5197a\": container with ID starting with 238fb3facb8d9f416faafcf4b2b7fa7e8a61be0560d897c32548f49e4ab5197a not found: ID does not exist" containerID="238fb3facb8d9f416faafcf4b2b7fa7e8a61be0560d897c32548f49e4ab5197a" Jul 16 16:54:19.269229 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:19.269186 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"238fb3facb8d9f416faafcf4b2b7fa7e8a61be0560d897c32548f49e4ab5197a"} err="failed to get container status \"238fb3facb8d9f416faafcf4b2b7fa7e8a61be0560d897c32548f49e4ab5197a\": rpc error: code = NotFound desc = could not find container \"238fb3facb8d9f416faafcf4b2b7fa7e8a61be0560d897c32548f49e4ab5197a\": container with ID starting with 238fb3facb8d9f416faafcf4b2b7fa7e8a61be0560d897c32548f49e4ab5197a not found: ID does not exist" Jul 16 16:54:19.280848 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:19.280829 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c97785b4b-jzbsm"] Jul 16 16:54:19.284968 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:19.284947 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c97785b4b-jzbsm"] Jul 16 16:54:19.292577 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:19.292546 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:54:19.292646 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:19.292606 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:54:19.607855 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:19.607774 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dee395c3-ca2d-42cc-9108-3785f83a223b" path="/var/lib/kubelet/pods/dee395c3-ca2d-42cc-9108-3785f83a223b/volumes" Jul 16 16:54:26.290194 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:26.290162 2563 generic.go:356] "Generic (PLEG): container finished" podID="ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2" containerID="30333c97ab47fb7cbe51d1fc375358814ce8269ef962c0695cc3a69c1f43fc81" exitCode=0 Jul 16 16:54:26.290580 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:26.290240 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" event={"ID":"ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2","Type":"ContainerDied","Data":"30333c97ab47fb7cbe51d1fc375358814ce8269ef962c0695cc3a69c1f43fc81"} Jul 16 16:54:26.290644 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:26.290624 2563 scope.go:117] "RemoveContainer" containerID="30333c97ab47fb7cbe51d1fc375358814ce8269ef962c0695cc3a69c1f43fc81" Jul 16 16:54:26.291717 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:26.291694 2563 generic.go:356] "Generic (PLEG): container finished" podID="d15f86ba-0811-47e9-9079-242e244226d4" containerID="4a9bbb8cd2c2c2d54df5ecbc1c7f1fdbb2db48b318ab83505b8206e4a27cb81a" exitCode=0 Jul 16 16:54:26.291829 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:26.291765 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" event={"ID":"d15f86ba-0811-47e9-9079-242e244226d4","Type":"ContainerDied","Data":"4a9bbb8cd2c2c2d54df5ecbc1c7f1fdbb2db48b318ab83505b8206e4a27cb81a"} Jul 16 16:54:26.292050 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:26.292036 2563 scope.go:117] "RemoveContainer" containerID="4a9bbb8cd2c2c2d54df5ecbc1c7f1fdbb2db48b318ab83505b8206e4a27cb81a" Jul 16 16:54:26.293219 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:26.293201 2563 generic.go:356] "Generic (PLEG): container finished" podID="b0aba567-5292-4d1f-8588-c65d1d31da4a" containerID="674fc73f5984acccf609f4023fe3e6f2845f1fb024c8929842a37602000573c6" exitCode=0 Jul 16 16:54:26.293277 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:26.293262 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" event={"ID":"b0aba567-5292-4d1f-8588-c65d1d31da4a","Type":"ContainerDied","Data":"674fc73f5984acccf609f4023fe3e6f2845f1fb024c8929842a37602000573c6"} Jul 16 16:54:26.293521 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:26.293510 2563 scope.go:117] "RemoveContainer" containerID="674fc73f5984acccf609f4023fe3e6f2845f1fb024c8929842a37602000573c6" Jul 16 16:54:27.300083 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:27.300052 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jfpxg" event={"ID":"d15f86ba-0811-47e9-9079-242e244226d4","Type":"ContainerStarted","Data":"67c2c35663fe604b2495e614c314f4c8703a33f3198f76cf6a73f3796cee7558"} Jul 16 16:54:27.301790 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:27.301765 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ghtrx" event={"ID":"b0aba567-5292-4d1f-8588-c65d1d31da4a","Type":"ContainerStarted","Data":"c78e837b230257a4311023beb1881dedf871b3d605c6fe9a215cb95a10898590"} Jul 16 16:54:27.303628 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:27.303599 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7jrgk" event={"ID":"ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2","Type":"ContainerStarted","Data":"5b1d18a0b7b2e1752705694dcba2158072d36c893e18e637285ee54546255acf"} Jul 16 16:54:30.711031 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:30.710984 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:54:30.772621 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:30.772590 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:54:39.298887 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:39.298852 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:54:39.304134 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:54:39.304100 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-868d7b44c7-gnccp" Jul 16 16:55:13.800442 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:13.800361 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:14.085629 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:14.085520 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:18.922644 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.922602 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd"] Jul 16 16:55:18.923144 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.923122 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5124d017-734a-44d8-b483-58b92f4bd8eb" containerName="registry" Jul 16 16:55:18.923216 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.923148 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5124d017-734a-44d8-b483-58b92f4bd8eb" containerName="registry" Jul 16 16:55:18.923216 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.923176 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee395c3-ca2d-42cc-9108-3785f83a223b" containerName="console" Jul 16 16:55:18.923216 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.923185 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee395c3-ca2d-42cc-9108-3785f83a223b" containerName="console" Jul 16 16:55:18.923361 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.923291 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5124d017-734a-44d8-b483-58b92f4bd8eb" containerName="registry" Jul 16 16:55:18.923361 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.923302 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dee395c3-ca2d-42cc-9108-3785f83a223b" containerName="console" Jul 16 16:55:18.927672 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.927647 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:18.929391 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.929364 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 16 16:55:18.929526 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.929487 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 16 16:55:18.929610 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.929551 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 16 16:55:18.929610 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.929597 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hcdfx\"" Jul 16 16:55:18.929724 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.929597 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 16 16:55:18.929724 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.929650 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 16 16:55:18.934090 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.934071 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 16 16:55:18.942142 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:18.942111 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd"] Jul 16 16:55:19.002855 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.002819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/712f4548-5663-452d-a69c-6a60e5456526-federate-client-tls\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.002855 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.002869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/712f4548-5663-452d-a69c-6a60e5456526-serving-certs-ca-bundle\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.003190 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.002899 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/712f4548-5663-452d-a69c-6a60e5456526-metrics-client-ca\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.003190 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.002992 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/712f4548-5663-452d-a69c-6a60e5456526-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.003190 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.003026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/712f4548-5663-452d-a69c-6a60e5456526-telemeter-client-tls\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.003190 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.003053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/712f4548-5663-452d-a69c-6a60e5456526-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.003190 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.003107 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/712f4548-5663-452d-a69c-6a60e5456526-secret-telemeter-client\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.003190 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.003151 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dhj6\" (UniqueName: \"kubernetes.io/projected/712f4548-5663-452d-a69c-6a60e5456526-kube-api-access-2dhj6\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.104437 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.104392 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/712f4548-5663-452d-a69c-6a60e5456526-metrics-client-ca\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.104437 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.104436 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/712f4548-5663-452d-a69c-6a60e5456526-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.104747 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.104461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/712f4548-5663-452d-a69c-6a60e5456526-telemeter-client-tls\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.104747 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.104494 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/712f4548-5663-452d-a69c-6a60e5456526-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.104747 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.104526 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/712f4548-5663-452d-a69c-6a60e5456526-secret-telemeter-client\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.104747 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.104591 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dhj6\" (UniqueName: \"kubernetes.io/projected/712f4548-5663-452d-a69c-6a60e5456526-kube-api-access-2dhj6\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.104747 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.104635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/712f4548-5663-452d-a69c-6a60e5456526-federate-client-tls\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.104747 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.104700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/712f4548-5663-452d-a69c-6a60e5456526-serving-certs-ca-bundle\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.105313 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.105283 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/712f4548-5663-452d-a69c-6a60e5456526-metrics-client-ca\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.105459 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.105421 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/712f4548-5663-452d-a69c-6a60e5456526-serving-certs-ca-bundle\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.105955 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.105926 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/712f4548-5663-452d-a69c-6a60e5456526-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.107373 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.107347 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/712f4548-5663-452d-a69c-6a60e5456526-telemeter-client-tls\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.107628 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.107605 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/712f4548-5663-452d-a69c-6a60e5456526-federate-client-tls\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.107677 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.107636 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/712f4548-5663-452d-a69c-6a60e5456526-secret-telemeter-client\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.107677 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.107654 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/712f4548-5663-452d-a69c-6a60e5456526-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.115598 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.115552 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dhj6\" (UniqueName: \"kubernetes.io/projected/712f4548-5663-452d-a69c-6a60e5456526-kube-api-access-2dhj6\") pod \"telemeter-client-5dcf46ddc4-n4hqd\" (UID: \"712f4548-5663-452d-a69c-6a60e5456526\") " pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.237778 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.237740 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" Jul 16 16:55:19.382174 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.382154 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd"] Jul 16 16:55:19.384441 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:55:19.384412 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod712f4548_5663_452d_a69c_6a60e5456526.slice/crio-9f8bb630c4711bf0b95c631f697bc8e1a5fc72be2e6310efb155f1af143f1c19 WatchSource:0}: Error finding container 9f8bb630c4711bf0b95c631f697bc8e1a5fc72be2e6310efb155f1af143f1c19: Status 404 returned error can't find the container with id 9f8bb630c4711bf0b95c631f697bc8e1a5fc72be2e6310efb155f1af143f1c19 Jul 16 16:55:19.507334 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:19.507268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" event={"ID":"712f4548-5663-452d-a69c-6a60e5456526","Type":"ContainerStarted","Data":"9f8bb630c4711bf0b95c631f697bc8e1a5fc72be2e6310efb155f1af143f1c19"} Jul 16 16:55:21.517333 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:21.517301 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" event={"ID":"712f4548-5663-452d-a69c-6a60e5456526","Type":"ContainerStarted","Data":"1d1f97a7e8ade5225ba86ad83c6ce85be8233d9a526900293cd97aba87e4e69d"} Jul 16 16:55:23.526797 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:23.526754 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" event={"ID":"712f4548-5663-452d-a69c-6a60e5456526","Type":"ContainerStarted","Data":"ebc41a474ce209607832ff1dec364c43380921ec33b32cdd11143a860def48f5"} Jul 16 16:55:23.527246 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:23.526817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" event={"ID":"712f4548-5663-452d-a69c-6a60e5456526","Type":"ContainerStarted","Data":"2fea2ec9472f8e938d33f86e268eb4d2f6e6cab10bcda4b48eff337c644b773a"} Jul 16 16:55:23.549066 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:23.549006 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5dcf46ddc4-n4hqd" podStartSLOduration=2.517353586 podStartE2EDuration="5.548987329s" totalImagesPullingTime="3.031633743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:55:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:55:23.546674966 +0000 UTC m=+190.469915155" watchObservedRunningTime="2026-07-16 16:55:23.548987329 +0000 UTC m=+190.472227519" Jul 16 16:55:24.275423 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.275377 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b748bb88d-d6z4q"] Jul 16 16:55:24.280121 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.280078 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.282201 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.282128 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 16:55:24.282441 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.282417 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 16:55:24.284218 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.282675 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 16:55:24.284218 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.283124 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 16:55:24.285062 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.284985 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 16:55:24.285170 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.285059 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5gqfc\"" Jul 16 16:55:24.285270 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.285171 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 16:55:24.285270 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.285211 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 16:55:24.287635 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.287615 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 16:55:24.289243 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.289190 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b748bb88d-d6z4q"] Jul 16 16:55:24.351361 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.351332 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-service-ca\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.351522 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.351393 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-trusted-ca-bundle\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.351522 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.351488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-oauth-serving-cert\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.351522 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.351518 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-console-config\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.351702 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.351543 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b32f094-75aa-459c-bff2-2d3d0f002260-console-oauth-config\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.351702 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.351561 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtcp8\" (UniqueName: \"kubernetes.io/projected/8b32f094-75aa-459c-bff2-2d3d0f002260-kube-api-access-qtcp8\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.351702 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.351648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b32f094-75aa-459c-bff2-2d3d0f002260-console-serving-cert\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.403591 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.403526 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:24.452752 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.452717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-oauth-serving-cert\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.452925 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.452756 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-console-config\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.453015 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.452989 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b32f094-75aa-459c-bff2-2d3d0f002260-console-oauth-config\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.453073 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.453036 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtcp8\" (UniqueName: \"kubernetes.io/projected/8b32f094-75aa-459c-bff2-2d3d0f002260-kube-api-access-qtcp8\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.453127 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.453077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b32f094-75aa-459c-bff2-2d3d0f002260-console-serving-cert\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.453173 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.453150 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-service-ca\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.453236 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.453214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-trusted-ca-bundle\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.453657 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.453629 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-console-config\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.453787 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.453667 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-oauth-serving-cert\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.453877 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.453859 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-service-ca\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.454074 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.454056 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-trusted-ca-bundle\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.455547 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.455528 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b32f094-75aa-459c-bff2-2d3d0f002260-console-oauth-config\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.455702 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.455687 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b32f094-75aa-459c-bff2-2d3d0f002260-console-serving-cert\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.460843 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.460823 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtcp8\" (UniqueName: \"kubernetes.io/projected/8b32f094-75aa-459c-bff2-2d3d0f002260-kube-api-access-qtcp8\") pod \"console-b748bb88d-d6z4q\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.503661 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.503632 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:24.558682 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.558594 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:24.593111 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.593082 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:24.736291 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:24.736220 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b748bb88d-d6z4q"] Jul 16 16:55:24.738467 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:55:24.738439 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b32f094_75aa_459c_bff2_2d3d0f002260.slice/crio-48f0cf01fa48d954666595677383e35f26eeb10ae5d167adb5a3d436b13e8bce WatchSource:0}: Error finding container 48f0cf01fa48d954666595677383e35f26eeb10ae5d167adb5a3d436b13e8bce: Status 404 returned error can't find the container with id 48f0cf01fa48d954666595677383e35f26eeb10ae5d167adb5a3d436b13e8bce Jul 16 16:55:25.076170 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:25.076139 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:25.135978 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:25.135942 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:25.537337 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:25.537303 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b748bb88d-d6z4q" event={"ID":"8b32f094-75aa-459c-bff2-2d3d0f002260","Type":"ContainerStarted","Data":"723d81baa0abf2ac93861b5b35399c6c290e0aeafc28b7f83e7215b25b450246"} Jul 16 16:55:25.537509 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:25.537357 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b748bb88d-d6z4q" event={"ID":"8b32f094-75aa-459c-bff2-2d3d0f002260","Type":"ContainerStarted","Data":"48f0cf01fa48d954666595677383e35f26eeb10ae5d167adb5a3d436b13e8bce"} Jul 16 16:55:25.556053 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:25.556008 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b748bb88d-d6z4q" podStartSLOduration=1.555993676 podStartE2EDuration="1.555993676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:55:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:55:25.554071553 +0000 UTC m=+192.477311742" watchObservedRunningTime="2026-07-16 16:55:25.555993676 +0000 UTC m=+192.479233865" Jul 16 16:55:29.068737 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:29.068699 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:29.122287 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:29.122257 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:30.106900 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.106866 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b748bb88d-d6z4q"] Jul 16 16:55:30.138452 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.138417 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75d44d7ddb-k4q9w"] Jul 16 16:55:30.143065 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.143036 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.151166 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.150916 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d44d7ddb-k4q9w"] Jul 16 16:55:30.202762 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.202732 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/808d38da-7231-4738-890b-a7295ffd02ec-console-serving-cert\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.202933 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.202785 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808d38da-7231-4738-890b-a7295ffd02ec-trusted-ca-bundle\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.202933 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.202806 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/808d38da-7231-4738-890b-a7295ffd02ec-oauth-serving-cert\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.202933 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.202832 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjjwv\" (UniqueName: \"kubernetes.io/projected/808d38da-7231-4738-890b-a7295ffd02ec-kube-api-access-zjjwv\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.202933 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.202878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/808d38da-7231-4738-890b-a7295ffd02ec-console-oauth-config\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.202933 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.202897 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/808d38da-7231-4738-890b-a7295ffd02ec-console-config\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.202933 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.202931 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/808d38da-7231-4738-890b-a7295ffd02ec-service-ca\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.304030 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.303992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/808d38da-7231-4738-890b-a7295ffd02ec-console-oauth-config\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.304030 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.304031 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/808d38da-7231-4738-890b-a7295ffd02ec-console-config\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.304226 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.304056 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/808d38da-7231-4738-890b-a7295ffd02ec-service-ca\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.304226 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.304108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/808d38da-7231-4738-890b-a7295ffd02ec-console-serving-cert\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.304226 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.304157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808d38da-7231-4738-890b-a7295ffd02ec-trusted-ca-bundle\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.304226 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.304182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/808d38da-7231-4738-890b-a7295ffd02ec-oauth-serving-cert\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.304226 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.304203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjwv\" (UniqueName: \"kubernetes.io/projected/808d38da-7231-4738-890b-a7295ffd02ec-kube-api-access-zjjwv\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.304933 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.304908 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/808d38da-7231-4738-890b-a7295ffd02ec-service-ca\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.305044 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.305020 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/808d38da-7231-4738-890b-a7295ffd02ec-oauth-serving-cert\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.305088 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.304998 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/808d38da-7231-4738-890b-a7295ffd02ec-console-config\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.305088 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.305073 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808d38da-7231-4738-890b-a7295ffd02ec-trusted-ca-bundle\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.306723 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.306699 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/808d38da-7231-4738-890b-a7295ffd02ec-console-serving-cert\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.306787 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.306756 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/808d38da-7231-4738-890b-a7295ffd02ec-console-oauth-config\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.312400 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.312375 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjjwv\" (UniqueName: \"kubernetes.io/projected/808d38da-7231-4738-890b-a7295ffd02ec-kube-api-access-zjjwv\") pod \"console-75d44d7ddb-k4q9w\" (UID: \"808d38da-7231-4738-890b-a7295ffd02ec\") " pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.454784 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.454748 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:30.506527 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.506488 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:30.592708 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:30.592677 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d44d7ddb-k4q9w"] Jul 16 16:55:30.596022 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:55:30.595993 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808d38da_7231_4738_890b_a7295ffd02ec.slice/crio-3d70324847b03e21e2af3135da9f785dd691632e6ea39bd8eaf59ecd1886b4b3 WatchSource:0}: Error finding container 3d70324847b03e21e2af3135da9f785dd691632e6ea39bd8eaf59ecd1886b4b3: Status 404 returned error can't find the container with id 3d70324847b03e21e2af3135da9f785dd691632e6ea39bd8eaf59ecd1886b4b3 Jul 16 16:55:31.102445 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:31.102411 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:31.167835 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:31.167801 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:31.562221 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:31.562187 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d44d7ddb-k4q9w" event={"ID":"808d38da-7231-4738-890b-a7295ffd02ec","Type":"ContainerStarted","Data":"1b06334cc3f156375525c7fab21df94a584ace965046cdd9cb16de91449db26f"} Jul 16 16:55:31.562374 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:31.562235 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d44d7ddb-k4q9w" event={"ID":"808d38da-7231-4738-890b-a7295ffd02ec","Type":"ContainerStarted","Data":"3d70324847b03e21e2af3135da9f785dd691632e6ea39bd8eaf59ecd1886b4b3"} Jul 16 16:55:31.579169 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:31.579115 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75d44d7ddb-k4q9w" podStartSLOduration=1.579097092 podStartE2EDuration="1.579097092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:55:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:55:31.577466615 +0000 UTC m=+198.500706803" watchObservedRunningTime="2026-07-16 16:55:31.579097092 +0000 UTC m=+198.502337281" Jul 16 16:55:34.594178 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:34.594132 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:40.454869 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:40.454839 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:40.455353 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:40.454934 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:40.459817 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:40.459792 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:40.603595 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:40.603556 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75d44d7ddb-k4q9w" Jul 16 16:55:40.760608 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:40.760513 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:40.860782 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:40.860744 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:40.911701 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:40.911664 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:41.103175 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:41.103096 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:41.171741 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:41.171703 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:55.128706 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.128638 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b748bb88d-d6z4q" podUID="8b32f094-75aa-459c-bff2-2d3d0f002260" containerName="console" containerID="cri-o://723d81baa0abf2ac93861b5b35399c6c290e0aeafc28b7f83e7215b25b450246" gracePeriod=15 Jul 16 16:55:55.380513 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.380440 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:55.522017 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.521984 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-console-config\") pod \"8b32f094-75aa-459c-bff2-2d3d0f002260\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " Jul 16 16:55:55.522017 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.522021 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b32f094-75aa-459c-bff2-2d3d0f002260-console-serving-cert\") pod \"8b32f094-75aa-459c-bff2-2d3d0f002260\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " Jul 16 16:55:55.522277 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.522052 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-service-ca\") pod \"8b32f094-75aa-459c-bff2-2d3d0f002260\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " Jul 16 16:55:55.522277 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.522090 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b32f094-75aa-459c-bff2-2d3d0f002260-console-oauth-config\") pod \"8b32f094-75aa-459c-bff2-2d3d0f002260\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " Jul 16 16:55:55.522277 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.522111 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtcp8\" (UniqueName: \"kubernetes.io/projected/8b32f094-75aa-459c-bff2-2d3d0f002260-kube-api-access-qtcp8\") pod \"8b32f094-75aa-459c-bff2-2d3d0f002260\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " Jul 16 16:55:55.522277 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.522130 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-trusted-ca-bundle\") pod \"8b32f094-75aa-459c-bff2-2d3d0f002260\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " Jul 16 16:55:55.522277 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.522174 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-oauth-serving-cert\") pod \"8b32f094-75aa-459c-bff2-2d3d0f002260\" (UID: \"8b32f094-75aa-459c-bff2-2d3d0f002260\") " Jul 16 16:55:55.522523 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.522418 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-console-config" (OuterVolumeSpecName: "console-config") pod "8b32f094-75aa-459c-bff2-2d3d0f002260" (UID: "8b32f094-75aa-459c-bff2-2d3d0f002260"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:55:55.522632 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.522609 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8b32f094-75aa-459c-bff2-2d3d0f002260" (UID: "8b32f094-75aa-459c-bff2-2d3d0f002260"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:55:55.522684 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.522625 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-service-ca" (OuterVolumeSpecName: "service-ca") pod "8b32f094-75aa-459c-bff2-2d3d0f002260" (UID: "8b32f094-75aa-459c-bff2-2d3d0f002260"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:55:55.522684 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.522675 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8b32f094-75aa-459c-bff2-2d3d0f002260" (UID: "8b32f094-75aa-459c-bff2-2d3d0f002260"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:55:55.524466 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.524441 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b32f094-75aa-459c-bff2-2d3d0f002260-kube-api-access-qtcp8" (OuterVolumeSpecName: "kube-api-access-qtcp8") pod "8b32f094-75aa-459c-bff2-2d3d0f002260" (UID: "8b32f094-75aa-459c-bff2-2d3d0f002260"). InnerVolumeSpecName "kube-api-access-qtcp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:55:55.524466 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.524459 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b32f094-75aa-459c-bff2-2d3d0f002260-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8b32f094-75aa-459c-bff2-2d3d0f002260" (UID: "8b32f094-75aa-459c-bff2-2d3d0f002260"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:55:55.524640 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.524502 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b32f094-75aa-459c-bff2-2d3d0f002260-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8b32f094-75aa-459c-bff2-2d3d0f002260" (UID: "8b32f094-75aa-459c-bff2-2d3d0f002260"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:55:55.623145 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.623111 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b32f094-75aa-459c-bff2-2d3d0f002260-console-oauth-config\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:55:55.623145 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.623142 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtcp8\" (UniqueName: \"kubernetes.io/projected/8b32f094-75aa-459c-bff2-2d3d0f002260-kube-api-access-qtcp8\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:55:55.623145 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.623152 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-trusted-ca-bundle\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:55:55.623361 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.623162 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-oauth-serving-cert\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:55:55.623361 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.623171 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-console-config\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:55:55.623361 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.623180 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b32f094-75aa-459c-bff2-2d3d0f002260-console-serving-cert\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:55:55.623361 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.623189 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b32f094-75aa-459c-bff2-2d3d0f002260-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:55:55.661890 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.661803 2563 generic.go:356] "Generic (PLEG): container finished" podID="8b32f094-75aa-459c-bff2-2d3d0f002260" containerID="723d81baa0abf2ac93861b5b35399c6c290e0aeafc28b7f83e7215b25b450246" exitCode=0 Jul 16 16:55:55.661890 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.661866 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b748bb88d-d6z4q" Jul 16 16:55:55.662064 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.661898 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b748bb88d-d6z4q" event={"ID":"8b32f094-75aa-459c-bff2-2d3d0f002260","Type":"ContainerDied","Data":"723d81baa0abf2ac93861b5b35399c6c290e0aeafc28b7f83e7215b25b450246"} Jul 16 16:55:55.662064 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.661949 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b748bb88d-d6z4q" event={"ID":"8b32f094-75aa-459c-bff2-2d3d0f002260","Type":"ContainerDied","Data":"48f0cf01fa48d954666595677383e35f26eeb10ae5d167adb5a3d436b13e8bce"} Jul 16 16:55:55.662064 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.661968 2563 scope.go:117] "RemoveContainer" containerID="723d81baa0abf2ac93861b5b35399c6c290e0aeafc28b7f83e7215b25b450246" Jul 16 16:55:55.670446 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.670425 2563 scope.go:117] "RemoveContainer" containerID="723d81baa0abf2ac93861b5b35399c6c290e0aeafc28b7f83e7215b25b450246" Jul 16 16:55:55.670736 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:55:55.670717 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"723d81baa0abf2ac93861b5b35399c6c290e0aeafc28b7f83e7215b25b450246\": container with ID starting with 723d81baa0abf2ac93861b5b35399c6c290e0aeafc28b7f83e7215b25b450246 not found: ID does not exist" containerID="723d81baa0abf2ac93861b5b35399c6c290e0aeafc28b7f83e7215b25b450246" Jul 16 16:55:55.670805 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.670743 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"723d81baa0abf2ac93861b5b35399c6c290e0aeafc28b7f83e7215b25b450246"} err="failed to get container status \"723d81baa0abf2ac93861b5b35399c6c290e0aeafc28b7f83e7215b25b450246\": rpc error: code = NotFound desc = could not find container \"723d81baa0abf2ac93861b5b35399c6c290e0aeafc28b7f83e7215b25b450246\": container with ID starting with 723d81baa0abf2ac93861b5b35399c6c290e0aeafc28b7f83e7215b25b450246 not found: ID does not exist" Jul 16 16:55:55.678323 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.678298 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b748bb88d-d6z4q"] Jul 16 16:55:55.682462 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:55.682439 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b748bb88d-d6z4q"] Jul 16 16:55:57.171206 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:57.171178 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:57.226340 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:57.226305 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:57.604807 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:57.604777 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b32f094-75aa-459c-bff2-2d3d0f002260" path="/var/lib/kubelet/pods/8b32f094-75aa-459c-bff2-2d3d0f002260/volumes" Jul 16 16:55:58.483069 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:58.483031 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:55:58.584992 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:55:58.584947 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:56:34.225198 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:56:34.225164 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:56:34.325551 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:56:34.325513 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:56:45.267130 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:56:45.267088 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:56:45.324283 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:56:45.324249 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:13.502445 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:13.502408 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-txmzt_7b1ce2c6-8921-4e94-908f-b1f88eafa433/console-operator/1.log" Jul 16 16:57:13.508326 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:13.508303 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/ovn-acl-logging/0.log" Jul 16 16:57:13.510846 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:13.510823 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-txmzt_7b1ce2c6-8921-4e94-908f-b1f88eafa433/console-operator/1.log" Jul 16 16:57:13.513339 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:13.513318 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 16:57:13.517075 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:13.517055 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/ovn-acl-logging/0.log" Jul 16 16:57:23.431840 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.431806 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch"] Jul 16 16:57:23.434222 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.432130 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b32f094-75aa-459c-bff2-2d3d0f002260" containerName="console" Jul 16 16:57:23.434222 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.432140 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b32f094-75aa-459c-bff2-2d3d0f002260" containerName="console" Jul 16 16:57:23.434222 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.432193 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b32f094-75aa-459c-bff2-2d3d0f002260" containerName="console" Jul 16 16:57:23.435111 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.435095 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" Jul 16 16:57:23.437133 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.437109 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 16:57:23.437427 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.437413 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 16:57:23.437473 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.437455 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qk8f2\"" Jul 16 16:57:23.443851 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.443825 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch"] Jul 16 16:57:23.511689 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.511658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54bc2665-8b65-4ed6-8302-6a3fea559c04-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch\" (UID: \"54bc2665-8b65-4ed6-8302-6a3fea559c04\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" Jul 16 16:57:23.511835 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.511707 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw4km\" (UniqueName: \"kubernetes.io/projected/54bc2665-8b65-4ed6-8302-6a3fea559c04-kube-api-access-mw4km\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch\" (UID: \"54bc2665-8b65-4ed6-8302-6a3fea559c04\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" Jul 16 16:57:23.511835 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.511730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54bc2665-8b65-4ed6-8302-6a3fea559c04-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch\" (UID: \"54bc2665-8b65-4ed6-8302-6a3fea559c04\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" Jul 16 16:57:23.612295 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.612265 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw4km\" (UniqueName: \"kubernetes.io/projected/54bc2665-8b65-4ed6-8302-6a3fea559c04-kube-api-access-mw4km\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch\" (UID: \"54bc2665-8b65-4ed6-8302-6a3fea559c04\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" Jul 16 16:57:23.612440 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.612306 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54bc2665-8b65-4ed6-8302-6a3fea559c04-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch\" (UID: \"54bc2665-8b65-4ed6-8302-6a3fea559c04\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" Jul 16 16:57:23.612440 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.612388 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54bc2665-8b65-4ed6-8302-6a3fea559c04-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch\" (UID: \"54bc2665-8b65-4ed6-8302-6a3fea559c04\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" Jul 16 16:57:23.612791 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.612769 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54bc2665-8b65-4ed6-8302-6a3fea559c04-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch\" (UID: \"54bc2665-8b65-4ed6-8302-6a3fea559c04\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" Jul 16 16:57:23.612868 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.612785 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54bc2665-8b65-4ed6-8302-6a3fea559c04-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch\" (UID: \"54bc2665-8b65-4ed6-8302-6a3fea559c04\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" Jul 16 16:57:23.622004 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.621975 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw4km\" (UniqueName: \"kubernetes.io/projected/54bc2665-8b65-4ed6-8302-6a3fea559c04-kube-api-access-mw4km\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch\" (UID: \"54bc2665-8b65-4ed6-8302-6a3fea559c04\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" Jul 16 16:57:23.744892 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.744839 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" Jul 16 16:57:23.804658 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.804631 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:23.890541 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.890506 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch"] Jul 16 16:57:23.893371 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:57:23.893332 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54bc2665_8b65_4ed6_8302_6a3fea559c04.slice/crio-39e40b4ff1faa4c751b1fac7f274489d3079c883f3af936f89f985563264a42d WatchSource:0}: Error finding container 39e40b4ff1faa4c751b1fac7f274489d3079c883f3af936f89f985563264a42d: Status 404 returned error can't find the container with id 39e40b4ff1faa4c751b1fac7f274489d3079c883f3af936f89f985563264a42d Jul 16 16:57:23.895366 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:23.895346 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 16:57:24.016870 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:24.016809 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" event={"ID":"54bc2665-8b65-4ed6-8302-6a3fea559c04","Type":"ContainerStarted","Data":"39e40b4ff1faa4c751b1fac7f274489d3079c883f3af936f89f985563264a42d"} Jul 16 16:57:25.305805 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:25.305772 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:31.052685 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:31.052653 2563 generic.go:356] "Generic (PLEG): container finished" podID="54bc2665-8b65-4ed6-8302-6a3fea559c04" containerID="1eda5338d560977bbb0a79afbdc84ceb30247705a57bb2720dbde815b4dc208d" exitCode=0 Jul 16 16:57:31.053130 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:31.052728 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" event={"ID":"54bc2665-8b65-4ed6-8302-6a3fea559c04","Type":"ContainerDied","Data":"1eda5338d560977bbb0a79afbdc84ceb30247705a57bb2720dbde815b4dc208d"} Jul 16 16:57:34.067848 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:34.067812 2563 generic.go:356] "Generic (PLEG): container finished" podID="54bc2665-8b65-4ed6-8302-6a3fea559c04" containerID="c9fb02e9106c6c7d0fd4a7921d4b0c5c847c8a8ba7c4192f86d57008271ac39f" exitCode=0 Jul 16 16:57:34.067848 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:34.067850 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" event={"ID":"54bc2665-8b65-4ed6-8302-6a3fea559c04","Type":"ContainerDied","Data":"c9fb02e9106c6c7d0fd4a7921d4b0c5c847c8a8ba7c4192f86d57008271ac39f"} Jul 16 16:57:41.101506 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:41.101473 2563 generic.go:356] "Generic (PLEG): container finished" podID="54bc2665-8b65-4ed6-8302-6a3fea559c04" containerID="6473911789eb3143e24fa71474b89cb9ce899243ea503e4e75391acbefbd6487" exitCode=0 Jul 16 16:57:41.101882 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:41.101559 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" event={"ID":"54bc2665-8b65-4ed6-8302-6a3fea559c04","Type":"ContainerDied","Data":"6473911789eb3143e24fa71474b89cb9ce899243ea503e4e75391acbefbd6487"} Jul 16 16:57:42.237637 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:42.237616 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" Jul 16 16:57:42.388802 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:42.388725 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54bc2665-8b65-4ed6-8302-6a3fea559c04-util\") pod \"54bc2665-8b65-4ed6-8302-6a3fea559c04\" (UID: \"54bc2665-8b65-4ed6-8302-6a3fea559c04\") " Jul 16 16:57:42.388802 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:42.388783 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54bc2665-8b65-4ed6-8302-6a3fea559c04-bundle\") pod \"54bc2665-8b65-4ed6-8302-6a3fea559c04\" (UID: \"54bc2665-8b65-4ed6-8302-6a3fea559c04\") " Jul 16 16:57:42.389026 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:42.388826 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw4km\" (UniqueName: \"kubernetes.io/projected/54bc2665-8b65-4ed6-8302-6a3fea559c04-kube-api-access-mw4km\") pod \"54bc2665-8b65-4ed6-8302-6a3fea559c04\" (UID: \"54bc2665-8b65-4ed6-8302-6a3fea559c04\") " Jul 16 16:57:42.389459 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:42.389418 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54bc2665-8b65-4ed6-8302-6a3fea559c04-bundle" (OuterVolumeSpecName: "bundle") pod "54bc2665-8b65-4ed6-8302-6a3fea559c04" (UID: "54bc2665-8b65-4ed6-8302-6a3fea559c04"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:57:42.391143 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:42.391120 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54bc2665-8b65-4ed6-8302-6a3fea559c04-kube-api-access-mw4km" (OuterVolumeSpecName: "kube-api-access-mw4km") pod "54bc2665-8b65-4ed6-8302-6a3fea559c04" (UID: "54bc2665-8b65-4ed6-8302-6a3fea559c04"). InnerVolumeSpecName "kube-api-access-mw4km". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:57:42.393082 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:42.393060 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54bc2665-8b65-4ed6-8302-6a3fea559c04-util" (OuterVolumeSpecName: "util") pod "54bc2665-8b65-4ed6-8302-6a3fea559c04" (UID: "54bc2665-8b65-4ed6-8302-6a3fea559c04"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:57:42.489993 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:42.489962 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw4km\" (UniqueName: \"kubernetes.io/projected/54bc2665-8b65-4ed6-8302-6a3fea559c04-kube-api-access-mw4km\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:57:42.489993 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:42.489988 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54bc2665-8b65-4ed6-8302-6a3fea559c04-util\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:57:42.489993 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:42.489998 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54bc2665-8b65-4ed6-8302-6a3fea559c04-bundle\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:57:43.111763 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:43.111733 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" event={"ID":"54bc2665-8b65-4ed6-8302-6a3fea559c04","Type":"ContainerDied","Data":"39e40b4ff1faa4c751b1fac7f274489d3079c883f3af936f89f985563264a42d"} Jul 16 16:57:43.111763 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:43.111756 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5qj8ch" Jul 16 16:57:43.111969 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:43.111784 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39e40b4ff1faa4c751b1fac7f274489d3079c883f3af936f89f985563264a42d" Jul 16 16:57:44.421245 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:44.421203 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:44.514250 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:44.514202 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:45.619037 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.619007 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh"] Jul 16 16:57:45.619467 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.619335 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54bc2665-8b65-4ed6-8302-6a3fea559c04" containerName="extract" Jul 16 16:57:45.619467 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.619347 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="54bc2665-8b65-4ed6-8302-6a3fea559c04" containerName="extract" Jul 16 16:57:45.619467 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.619358 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54bc2665-8b65-4ed6-8302-6a3fea559c04" containerName="pull" Jul 16 16:57:45.619467 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.619364 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="54bc2665-8b65-4ed6-8302-6a3fea559c04" containerName="pull" Jul 16 16:57:45.619467 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.619386 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54bc2665-8b65-4ed6-8302-6a3fea559c04" containerName="util" Jul 16 16:57:45.619467 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.619391 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="54bc2665-8b65-4ed6-8302-6a3fea559c04" containerName="util" Jul 16 16:57:45.619467 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.619448 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="54bc2665-8b65-4ed6-8302-6a3fea559c04" containerName="extract" Jul 16 16:57:45.659720 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.659684 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh"] Jul 16 16:57:45.659858 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.659778 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh" Jul 16 16:57:45.662114 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.662093 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 16 16:57:45.662226 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.662158 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 16 16:57:45.662379 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.662365 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-s7x48\"" Jul 16 16:57:45.662451 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.662390 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 16 16:57:45.814971 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.814935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq4wj\" (UniqueName: \"kubernetes.io/projected/0652215d-ef8c-469c-b00d-e2e734f1dff5-kube-api-access-vq4wj\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-882rh\" (UID: \"0652215d-ef8c-469c-b00d-e2e734f1dff5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh" Jul 16 16:57:45.815130 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.814980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0652215d-ef8c-469c-b00d-e2e734f1dff5-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-882rh\" (UID: \"0652215d-ef8c-469c-b00d-e2e734f1dff5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh" Jul 16 16:57:45.916469 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.916390 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq4wj\" (UniqueName: \"kubernetes.io/projected/0652215d-ef8c-469c-b00d-e2e734f1dff5-kube-api-access-vq4wj\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-882rh\" (UID: \"0652215d-ef8c-469c-b00d-e2e734f1dff5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh" Jul 16 16:57:45.916469 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.916423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0652215d-ef8c-469c-b00d-e2e734f1dff5-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-882rh\" (UID: \"0652215d-ef8c-469c-b00d-e2e734f1dff5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh" Jul 16 16:57:45.918952 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.918932 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0652215d-ef8c-469c-b00d-e2e734f1dff5-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-882rh\" (UID: \"0652215d-ef8c-469c-b00d-e2e734f1dff5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh" Jul 16 16:57:45.929589 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.929535 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq4wj\" (UniqueName: \"kubernetes.io/projected/0652215d-ef8c-469c-b00d-e2e734f1dff5-kube-api-access-vq4wj\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-882rh\" (UID: \"0652215d-ef8c-469c-b00d-e2e734f1dff5\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh" Jul 16 16:57:45.970539 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:45.970514 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh" Jul 16 16:57:46.138610 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:46.138582 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh"] Jul 16 16:57:46.141331 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:57:46.141306 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0652215d_ef8c_469c_b00d_e2e734f1dff5.slice/crio-d6c56fb37624bbfc81632337dd3e19dfa804e9e0cde01edaf12ba68c2e7dc02f WatchSource:0}: Error finding container d6c56fb37624bbfc81632337dd3e19dfa804e9e0cde01edaf12ba68c2e7dc02f: Status 404 returned error can't find the container with id d6c56fb37624bbfc81632337dd3e19dfa804e9e0cde01edaf12ba68c2e7dc02f Jul 16 16:57:46.340630 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:46.340545 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:46.439559 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:46.439533 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:47.129533 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:47.129498 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh" event={"ID":"0652215d-ef8c-469c-b00d-e2e734f1dff5","Type":"ContainerStarted","Data":"d6c56fb37624bbfc81632337dd3e19dfa804e9e0cde01edaf12ba68c2e7dc02f"} Jul 16 16:57:50.747541 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:50.747510 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:51.042254 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.042164 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:51.048150 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.048125 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-jlvvp"] Jul 16 16:57:51.050446 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.050428 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:57:51.052376 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.052355 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 16 16:57:51.052478 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.052397 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 16 16:57:51.052478 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.052415 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-b8lk4\"" Jul 16 16:57:51.061046 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.061020 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96v76\" (UniqueName: \"kubernetes.io/projected/bfc02661-2043-43eb-b5f6-8f837097a2f9-kube-api-access-96v76\") pod \"keda-operator-77f648d694-jlvvp\" (UID: \"bfc02661-2043-43eb-b5f6-8f837097a2f9\") " pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:57:51.061130 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.061117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bfc02661-2043-43eb-b5f6-8f837097a2f9-certificates\") pod \"keda-operator-77f648d694-jlvvp\" (UID: \"bfc02661-2043-43eb-b5f6-8f837097a2f9\") " pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:57:51.061189 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.061135 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/bfc02661-2043-43eb-b5f6-8f837097a2f9-cabundle0\") pod \"keda-operator-77f648d694-jlvvp\" (UID: \"bfc02661-2043-43eb-b5f6-8f837097a2f9\") " pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:57:51.063856 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.063837 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-jlvvp"] Jul 16 16:57:51.150615 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.150560 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh" event={"ID":"0652215d-ef8c-469c-b00d-e2e734f1dff5","Type":"ContainerStarted","Data":"1e1fa909e500d4d9743e5ca48ab7a3004ecce6679d376999a84afeb6e72ed389"} Jul 16 16:57:51.150764 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.150724 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh" Jul 16 16:57:51.161953 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.161924 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96v76\" (UniqueName: \"kubernetes.io/projected/bfc02661-2043-43eb-b5f6-8f837097a2f9-kube-api-access-96v76\") pod \"keda-operator-77f648d694-jlvvp\" (UID: \"bfc02661-2043-43eb-b5f6-8f837097a2f9\") " pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:57:51.162150 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.162132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bfc02661-2043-43eb-b5f6-8f837097a2f9-certificates\") pod \"keda-operator-77f648d694-jlvvp\" (UID: \"bfc02661-2043-43eb-b5f6-8f837097a2f9\") " pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:57:51.162226 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.162167 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/bfc02661-2043-43eb-b5f6-8f837097a2f9-cabundle0\") pod \"keda-operator-77f648d694-jlvvp\" (UID: \"bfc02661-2043-43eb-b5f6-8f837097a2f9\") " pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:57:51.162287 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:51.162259 2563 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 16 16:57:51.162287 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:51.162280 2563 secret.go:281] references non-existent secret key: ca.crt Jul 16 16:57:51.162389 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:51.162290 2563 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 16 16:57:51.162389 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:51.162303 2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-jlvvp: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 16 16:57:51.162389 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:51.162373 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfc02661-2043-43eb-b5f6-8f837097a2f9-certificates podName:bfc02661-2043-43eb-b5f6-8f837097a2f9 nodeName:}" failed. No retries permitted until 2026-07-16 16:57:51.662353192 +0000 UTC m=+338.585593363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/bfc02661-2043-43eb-b5f6-8f837097a2f9-certificates") pod "keda-operator-77f648d694-jlvvp" (UID: "bfc02661-2043-43eb-b5f6-8f837097a2f9") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 16 16:57:51.162873 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.162850 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/bfc02661-2043-43eb-b5f6-8f837097a2f9-cabundle0\") pod \"keda-operator-77f648d694-jlvvp\" (UID: \"bfc02661-2043-43eb-b5f6-8f837097a2f9\") " pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:57:51.170023 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.169981 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh" podStartSLOduration=2.126506391 podStartE2EDuration="6.169968164s" totalImagesPullingTime="4.043461773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:57:51.168616564 +0000 UTC m=+338.091856754" watchObservedRunningTime="2026-07-16 16:57:51.169968164 +0000 UTC m=+338.093208353" Jul 16 16:57:51.175233 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.175205 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96v76\" (UniqueName: \"kubernetes.io/projected/bfc02661-2043-43eb-b5f6-8f837097a2f9-kube-api-access-96v76\") pod \"keda-operator-77f648d694-jlvvp\" (UID: \"bfc02661-2043-43eb-b5f6-8f837097a2f9\") " pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:57:51.277639 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.277555 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:51.430937 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.430914 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9"] Jul 16 16:57:51.433687 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.433666 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:57:51.435467 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.435449 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 16 16:57:51.450352 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.450330 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9"] Jul 16 16:57:51.464792 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.464765 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/09dc8065-4151-4bca-9b42-372a5f0cd401-certificates\") pod \"keda-metrics-apiserver-55557df8c-8qbc9\" (UID: \"09dc8065-4151-4bca-9b42-372a5f0cd401\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:57:51.464903 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.464807 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sggr5\" (UniqueName: \"kubernetes.io/projected/09dc8065-4151-4bca-9b42-372a5f0cd401-kube-api-access-sggr5\") pod \"keda-metrics-apiserver-55557df8c-8qbc9\" (UID: \"09dc8065-4151-4bca-9b42-372a5f0cd401\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:57:51.464967 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.464932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/09dc8065-4151-4bca-9b42-372a5f0cd401-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-8qbc9\" (UID: \"09dc8065-4151-4bca-9b42-372a5f0cd401\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:57:51.488695 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.488668 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:51.565637 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.565610 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/09dc8065-4151-4bca-9b42-372a5f0cd401-certificates\") pod \"keda-metrics-apiserver-55557df8c-8qbc9\" (UID: \"09dc8065-4151-4bca-9b42-372a5f0cd401\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:57:51.565749 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.565643 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sggr5\" (UniqueName: \"kubernetes.io/projected/09dc8065-4151-4bca-9b42-372a5f0cd401-kube-api-access-sggr5\") pod \"keda-metrics-apiserver-55557df8c-8qbc9\" (UID: \"09dc8065-4151-4bca-9b42-372a5f0cd401\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:57:51.565749 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.565679 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/09dc8065-4151-4bca-9b42-372a5f0cd401-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-8qbc9\" (UID: \"09dc8065-4151-4bca-9b42-372a5f0cd401\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:57:51.565854 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:51.565763 2563 secret.go:281] references non-existent secret key: tls.crt Jul 16 16:57:51.565854 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:51.565778 2563 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 16 16:57:51.565854 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:51.565802 2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9: references non-existent secret key: tls.crt Jul 16 16:57:51.566046 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:51.565864 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09dc8065-4151-4bca-9b42-372a5f0cd401-certificates podName:09dc8065-4151-4bca-9b42-372a5f0cd401 nodeName:}" failed. No retries permitted until 2026-07-16 16:57:52.065846145 +0000 UTC m=+338.989086317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/09dc8065-4151-4bca-9b42-372a5f0cd401-certificates") pod "keda-metrics-apiserver-55557df8c-8qbc9" (UID: "09dc8065-4151-4bca-9b42-372a5f0cd401") : references non-existent secret key: tls.crt Jul 16 16:57:51.566126 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.566104 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/09dc8065-4151-4bca-9b42-372a5f0cd401-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-8qbc9\" (UID: \"09dc8065-4151-4bca-9b42-372a5f0cd401\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:57:51.584413 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.584392 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sggr5\" (UniqueName: \"kubernetes.io/projected/09dc8065-4151-4bca-9b42-372a5f0cd401-kube-api-access-sggr5\") pod \"keda-metrics-apiserver-55557df8c-8qbc9\" (UID: \"09dc8065-4151-4bca-9b42-372a5f0cd401\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:57:51.666867 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.666826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bfc02661-2043-43eb-b5f6-8f837097a2f9-certificates\") pod \"keda-operator-77f648d694-jlvvp\" (UID: \"bfc02661-2043-43eb-b5f6-8f837097a2f9\") " pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:57:51.666980 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:51.666960 2563 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 16 16:57:51.666980 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:51.666979 2563 secret.go:281] references non-existent secret key: ca.crt Jul 16 16:57:51.667096 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:51.666986 2563 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 16 16:57:51.667096 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:51.666997 2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-jlvvp: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 16 16:57:51.667096 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:51.667043 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfc02661-2043-43eb-b5f6-8f837097a2f9-certificates podName:bfc02661-2043-43eb-b5f6-8f837097a2f9 nodeName:}" failed. No retries permitted until 2026-07-16 16:57:52.667030221 +0000 UTC m=+339.590270388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/bfc02661-2043-43eb-b5f6-8f837097a2f9-certificates") pod "keda-operator-77f648d694-jlvvp" (UID: "bfc02661-2043-43eb-b5f6-8f837097a2f9") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 16 16:57:51.856289 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.856199 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:51.954763 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:51.954734 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:52.071239 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:52.071208 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/09dc8065-4151-4bca-9b42-372a5f0cd401-certificates\") pod \"keda-metrics-apiserver-55557df8c-8qbc9\" (UID: \"09dc8065-4151-4bca-9b42-372a5f0cd401\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:57:52.071393 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:52.071334 2563 secret.go:281] references non-existent secret key: tls.crt Jul 16 16:57:52.071393 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:52.071347 2563 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 16 16:57:52.071393 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:52.071364 2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9: references non-existent secret key: tls.crt Jul 16 16:57:52.071512 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:57:52.071412 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09dc8065-4151-4bca-9b42-372a5f0cd401-certificates podName:09dc8065-4151-4bca-9b42-372a5f0cd401 nodeName:}" failed. No retries permitted until 2026-07-16 16:57:53.071398812 +0000 UTC m=+339.994638978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/09dc8065-4151-4bca-9b42-372a5f0cd401-certificates") pod "keda-metrics-apiserver-55557df8c-8qbc9" (UID: "09dc8065-4151-4bca-9b42-372a5f0cd401") : references non-existent secret key: tls.crt Jul 16 16:57:52.250023 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:52.249985 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:52.357467 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:52.357428 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:52.645950 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:52.645862 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:52.676643 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:52.676616 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bfc02661-2043-43eb-b5f6-8f837097a2f9-certificates\") pod \"keda-operator-77f648d694-jlvvp\" (UID: \"bfc02661-2043-43eb-b5f6-8f837097a2f9\") " pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:57:52.679172 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:52.679154 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bfc02661-2043-43eb-b5f6-8f837097a2f9-certificates\") pod \"keda-operator-77f648d694-jlvvp\" (UID: \"bfc02661-2043-43eb-b5f6-8f837097a2f9\") " pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:57:52.739159 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:52.739130 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:52.861674 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:52.861645 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:57:53.080149 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:53.080109 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/09dc8065-4151-4bca-9b42-372a5f0cd401-certificates\") pod \"keda-metrics-apiserver-55557df8c-8qbc9\" (UID: \"09dc8065-4151-4bca-9b42-372a5f0cd401\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:57:53.082981 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:53.082960 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/09dc8065-4151-4bca-9b42-372a5f0cd401-certificates\") pod \"keda-metrics-apiserver-55557df8c-8qbc9\" (UID: \"09dc8065-4151-4bca-9b42-372a5f0cd401\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:57:53.200686 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:53.200664 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-jlvvp"] Jul 16 16:57:53.203136 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:57:53.203113 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc02661_2043_43eb_b5f6_8f837097a2f9.slice/crio-5cb845c6247573a61acda2b999b623eeb077d0dfa173aa0f994db86e0547c101 WatchSource:0}: Error finding container 5cb845c6247573a61acda2b999b623eeb077d0dfa173aa0f994db86e0547c101: Status 404 returned error can't find the container with id 5cb845c6247573a61acda2b999b623eeb077d0dfa173aa0f994db86e0547c101 Jul 16 16:57:53.244964 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:53.244944 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:57:53.378433 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:53.378407 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9"] Jul 16 16:57:53.380362 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:57:53.380329 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09dc8065_4151_4bca_9b42_372a5f0cd401.slice/crio-bf0cc5f3c43f471b8612a576f8657b696674d140acb89d2f2ec3248a9c65e0b0 WatchSource:0}: Error finding container bf0cc5f3c43f471b8612a576f8657b696674d140acb89d2f2ec3248a9c65e0b0: Status 404 returned error can't find the container with id bf0cc5f3c43f471b8612a576f8657b696674d140acb89d2f2ec3248a9c65e0b0 Jul 16 16:57:54.166583 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:54.166529 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-jlvvp" event={"ID":"bfc02661-2043-43eb-b5f6-8f837097a2f9","Type":"ContainerStarted","Data":"5cb845c6247573a61acda2b999b623eeb077d0dfa173aa0f994db86e0547c101"} Jul 16 16:57:54.167864 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:54.167829 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" event={"ID":"09dc8065-4151-4bca-9b42-372a5f0cd401","Type":"ContainerStarted","Data":"bf0cc5f3c43f471b8612a576f8657b696674d140acb89d2f2ec3248a9c65e0b0"} Jul 16 16:57:54.481720 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:54.481647 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:54.556124 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:54.556088 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:57:57.185415 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:57.185382 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-jlvvp" event={"ID":"bfc02661-2043-43eb-b5f6-8f837097a2f9","Type":"ContainerStarted","Data":"cb142f7fe30686e3d288ddb1b2e0669a4003621bc616299d23c9984a7bf7fb55"} Jul 16 16:57:57.185831 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:57.185561 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:57:57.204240 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:57:57.204192 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-jlvvp" podStartSLOduration=3.266904069 podStartE2EDuration="6.204175331s" totalImagesPullingTime="2.937271262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:57:57.202167276 +0000 UTC m=+344.125407465" watchObservedRunningTime="2026-07-16 16:57:57.204175331 +0000 UTC m=+344.127415519" Jul 16 16:58:01.207054 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:01.207017 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" event={"ID":"09dc8065-4151-4bca-9b42-372a5f0cd401","Type":"ContainerStarted","Data":"b42ec2ffb0dacd5836befaabcf9383d16782fd88600492ef5d4a76bb5d698787"} Jul 16 16:58:01.207430 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:01.207145 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:58:01.229478 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:01.229425 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" podStartSLOduration=2.97060654 podStartE2EDuration="10.229411331s" totalImagesPullingTime="7.258804791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:58:01.227980441 +0000 UTC m=+348.151220631" watchObservedRunningTime="2026-07-16 16:58:01.229411331 +0000 UTC m=+348.152651519" Jul 16 16:58:12.157219 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:12.157132 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-882rh" Jul 16 16:58:12.216528 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:12.216494 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-8qbc9" Jul 16 16:58:18.192891 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:18.192853 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-jlvvp" Jul 16 16:58:25.609356 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:25.609318 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:58:25.661227 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:25.661195 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:58:27.654788 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:27.654754 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:58:27.712132 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:27.712098 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:58:56.181142 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.181096 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:58:56.282754 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.282723 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-4bstm"] Jul 16 16:58:56.289265 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.289242 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:58:56.291286 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.291268 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 16 16:58:56.291372 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.291288 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 16 16:58:56.291498 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.291486 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-k56wt\"" Jul 16 16:58:56.292103 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.292090 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 16 16:58:56.295741 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.295711 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-4bstm"] Jul 16 16:58:56.315138 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.315117 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-kqd84"] Jul 16 16:58:56.318367 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.318353 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-kqd84" Jul 16 16:58:56.320003 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.319984 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 16 16:58:56.320109 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.319991 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-6d8bv\"" Jul 16 16:58:56.339042 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.339018 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-kqd84"] Jul 16 16:58:56.401422 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.401394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/70d98cc6-c004-49d9-9551-b39280e97e65-data\") pod \"seaweedfs-64568bcd49-kqd84\" (UID: \"70d98cc6-c004-49d9-9551-b39280e97e65\") " pod="kserve/seaweedfs-64568bcd49-kqd84" Jul 16 16:58:56.401422 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.401423 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13d6941c-9ca3-4295-8830-c321dab553c7-cert\") pod \"kserve-controller-manager-d55957fc4-4bstm\" (UID: \"13d6941c-9ca3-4295-8830-c321dab553c7\") " pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:58:56.401625 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.401467 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2gbt\" (UniqueName: \"kubernetes.io/projected/70d98cc6-c004-49d9-9551-b39280e97e65-kube-api-access-w2gbt\") pod \"seaweedfs-64568bcd49-kqd84\" (UID: \"70d98cc6-c004-49d9-9551-b39280e97e65\") " pod="kserve/seaweedfs-64568bcd49-kqd84" Jul 16 16:58:56.401625 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.401533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z472\" (UniqueName: \"kubernetes.io/projected/13d6941c-9ca3-4295-8830-c321dab553c7-kube-api-access-9z472\") pod \"kserve-controller-manager-d55957fc4-4bstm\" (UID: \"13d6941c-9ca3-4295-8830-c321dab553c7\") " pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:58:56.502353 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.502292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/70d98cc6-c004-49d9-9551-b39280e97e65-data\") pod \"seaweedfs-64568bcd49-kqd84\" (UID: \"70d98cc6-c004-49d9-9551-b39280e97e65\") " pod="kserve/seaweedfs-64568bcd49-kqd84" Jul 16 16:58:56.502353 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.502322 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13d6941c-9ca3-4295-8830-c321dab553c7-cert\") pod \"kserve-controller-manager-d55957fc4-4bstm\" (UID: \"13d6941c-9ca3-4295-8830-c321dab553c7\") " pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:58:56.502494 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.502365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2gbt\" (UniqueName: \"kubernetes.io/projected/70d98cc6-c004-49d9-9551-b39280e97e65-kube-api-access-w2gbt\") pod \"seaweedfs-64568bcd49-kqd84\" (UID: \"70d98cc6-c004-49d9-9551-b39280e97e65\") " pod="kserve/seaweedfs-64568bcd49-kqd84" Jul 16 16:58:56.502494 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.502416 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z472\" (UniqueName: \"kubernetes.io/projected/13d6941c-9ca3-4295-8830-c321dab553c7-kube-api-access-9z472\") pod \"kserve-controller-manager-d55957fc4-4bstm\" (UID: \"13d6941c-9ca3-4295-8830-c321dab553c7\") " pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:58:56.502772 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.502750 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/70d98cc6-c004-49d9-9551-b39280e97e65-data\") pod \"seaweedfs-64568bcd49-kqd84\" (UID: \"70d98cc6-c004-49d9-9551-b39280e97e65\") " pod="kserve/seaweedfs-64568bcd49-kqd84" Jul 16 16:58:56.504898 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.504878 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13d6941c-9ca3-4295-8830-c321dab553c7-cert\") pod \"kserve-controller-manager-d55957fc4-4bstm\" (UID: \"13d6941c-9ca3-4295-8830-c321dab553c7\") " pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:58:56.512543 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.512518 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z472\" (UniqueName: \"kubernetes.io/projected/13d6941c-9ca3-4295-8830-c321dab553c7-kube-api-access-9z472\") pod \"kserve-controller-manager-d55957fc4-4bstm\" (UID: \"13d6941c-9ca3-4295-8830-c321dab553c7\") " pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:58:56.512878 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.512860 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2gbt\" (UniqueName: \"kubernetes.io/projected/70d98cc6-c004-49d9-9551-b39280e97e65-kube-api-access-w2gbt\") pod \"seaweedfs-64568bcd49-kqd84\" (UID: \"70d98cc6-c004-49d9-9551-b39280e97e65\") " pod="kserve/seaweedfs-64568bcd49-kqd84" Jul 16 16:58:56.601406 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.601386 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:58:56.627215 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.627187 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-kqd84" Jul 16 16:58:56.748066 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.748041 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-4bstm"] Jul 16 16:58:56.750481 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:58:56.750455 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d6941c_9ca3_4295_8830_c321dab553c7.slice/crio-0d7e395f60123852794abb05371f63d6ec74c4916f281d11193ffd07c48f6135 WatchSource:0}: Error finding container 0d7e395f60123852794abb05371f63d6ec74c4916f281d11193ffd07c48f6135: Status 404 returned error can't find the container with id 0d7e395f60123852794abb05371f63d6ec74c4916f281d11193ffd07c48f6135 Jul 16 16:58:56.775629 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:56.775598 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-kqd84"] Jul 16 16:58:56.781734 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:58:56.781711 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d98cc6_c004_49d9_9551_b39280e97e65.slice/crio-7d16d092422e3ceae47614b73b3566a9fcc4eaedb1afc1507da61858b9848b17 WatchSource:0}: Error finding container 7d16d092422e3ceae47614b73b3566a9fcc4eaedb1afc1507da61858b9848b17: Status 404 returned error can't find the container with id 7d16d092422e3ceae47614b73b3566a9fcc4eaedb1afc1507da61858b9848b17 Jul 16 16:58:57.463437 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:57.463396 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" event={"ID":"13d6941c-9ca3-4295-8830-c321dab553c7","Type":"ContainerStarted","Data":"0d7e395f60123852794abb05371f63d6ec74c4916f281d11193ffd07c48f6135"} Jul 16 16:58:57.466038 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:57.465980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-kqd84" event={"ID":"70d98cc6-c004-49d9-9551-b39280e97e65","Type":"ContainerStarted","Data":"7d16d092422e3ceae47614b73b3566a9fcc4eaedb1afc1507da61858b9848b17"} Jul 16 16:58:57.859047 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:57.858962 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:58:57.917024 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:58:57.916984 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:59:00.483046 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:00.482996 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" event={"ID":"13d6941c-9ca3-4295-8830-c321dab553c7","Type":"ContainerStarted","Data":"714afa1533715010c0bae30da3cda307ef2746de88f6eb47e7ed197e283eb884"} Jul 16 16:59:00.483492 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:00.483067 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:59:00.484655 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:00.484605 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-kqd84" event={"ID":"70d98cc6-c004-49d9-9551-b39280e97e65","Type":"ContainerStarted","Data":"1faab588228ab671439e44a088f17a949514a6a8eddbc40822ec5639581416e8"} Jul 16 16:59:00.484824 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:00.484730 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-kqd84" Jul 16 16:59:00.500201 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:00.500137 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" podStartSLOduration=0.957634691 podStartE2EDuration="4.500114584s" totalImagesPullingTime="3.542479893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:59:00.498934399 +0000 UTC m=+407.422174587" watchObservedRunningTime="2026-07-16 16:59:00.500114584 +0000 UTC m=+407.423354774" Jul 16 16:59:00.515321 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:00.515240 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-kqd84" podStartSLOduration=0.912286162 podStartE2EDuration="4.515218656s" totalImagesPullingTime="3.602932494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:59:00.514899052 +0000 UTC m=+407.438139247" watchObservedRunningTime="2026-07-16 16:59:00.515218656 +0000 UTC m=+407.438458846" Jul 16 16:59:01.491217 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:01.491184 2563 generic.go:356] "Generic (PLEG): container finished" podID="13d6941c-9ca3-4295-8830-c321dab553c7" containerID="714afa1533715010c0bae30da3cda307ef2746de88f6eb47e7ed197e283eb884" exitCode=1 Jul 16 16:59:01.491654 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:01.491265 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" event={"ID":"13d6941c-9ca3-4295-8830-c321dab553c7","Type":"ContainerDied","Data":"714afa1533715010c0bae30da3cda307ef2746de88f6eb47e7ed197e283eb884"} Jul 16 16:59:01.491654 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:01.491509 2563 scope.go:117] "RemoveContainer" containerID="714afa1533715010c0bae30da3cda307ef2746de88f6eb47e7ed197e283eb884" Jul 16 16:59:02.497705 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:02.497669 2563 generic.go:356] "Generic (PLEG): container finished" podID="13d6941c-9ca3-4295-8830-c321dab553c7" containerID="ad55211b2dc0735e88c9d3f88f34aea87d428ae00cecc7dfbbc4c9b9ed69c204" exitCode=1 Jul 16 16:59:02.498160 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:02.497760 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" event={"ID":"13d6941c-9ca3-4295-8830-c321dab553c7","Type":"ContainerDied","Data":"ad55211b2dc0735e88c9d3f88f34aea87d428ae00cecc7dfbbc4c9b9ed69c204"} Jul 16 16:59:02.498160 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:02.497840 2563 scope.go:117] "RemoveContainer" containerID="714afa1533715010c0bae30da3cda307ef2746de88f6eb47e7ed197e283eb884" Jul 16 16:59:02.498160 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:02.498085 2563 scope.go:117] "RemoveContainer" containerID="ad55211b2dc0735e88c9d3f88f34aea87d428ae00cecc7dfbbc4c9b9ed69c204" Jul 16 16:59:02.498304 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:59:02.498282 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4bstm_kserve(13d6941c-9ca3-4295-8830-c321dab553c7)\"" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" Jul 16 16:59:03.503462 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:03.503432 2563 scope.go:117] "RemoveContainer" containerID="ad55211b2dc0735e88c9d3f88f34aea87d428ae00cecc7dfbbc4c9b9ed69c204" Jul 16 16:59:03.503862 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:59:03.503646 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4bstm_kserve(13d6941c-9ca3-4295-8830-c321dab553c7)\"" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" Jul 16 16:59:05.483497 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:05.483458 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:59:05.483910 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:05.483891 2563 scope.go:117] "RemoveContainer" containerID="ad55211b2dc0735e88c9d3f88f34aea87d428ae00cecc7dfbbc4c9b9ed69c204" Jul 16 16:59:05.484113 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:59:05.484091 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4bstm_kserve(13d6941c-9ca3-4295-8830-c321dab553c7)\"" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" Jul 16 16:59:06.494207 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:06.494173 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-kqd84" Jul 16 16:59:06.602065 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:06.602035 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:59:06.602362 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:06.602345 2563 scope.go:117] "RemoveContainer" containerID="ad55211b2dc0735e88c9d3f88f34aea87d428ae00cecc7dfbbc4c9b9ed69c204" Jul 16 16:59:06.602604 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:59:06.602559 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4bstm_kserve(13d6941c-9ca3-4295-8830-c321dab553c7)\"" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" Jul 16 16:59:17.599834 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:17.599804 2563 scope.go:117] "RemoveContainer" containerID="ad55211b2dc0735e88c9d3f88f34aea87d428ae00cecc7dfbbc4c9b9ed69c204" Jul 16 16:59:18.575285 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:18.575252 2563 generic.go:356] "Generic (PLEG): container finished" podID="13d6941c-9ca3-4295-8830-c321dab553c7" containerID="a23ecc4a33f791d1bd6d11a55d4e2ef9c91bf8be0ee9d9d4338d123a3da98200" exitCode=1 Jul 16 16:59:18.575480 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:18.575326 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" event={"ID":"13d6941c-9ca3-4295-8830-c321dab553c7","Type":"ContainerDied","Data":"a23ecc4a33f791d1bd6d11a55d4e2ef9c91bf8be0ee9d9d4338d123a3da98200"} Jul 16 16:59:18.575480 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:18.575383 2563 scope.go:117] "RemoveContainer" containerID="ad55211b2dc0735e88c9d3f88f34aea87d428ae00cecc7dfbbc4c9b9ed69c204" Jul 16 16:59:18.575761 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:18.575739 2563 scope.go:117] "RemoveContainer" containerID="a23ecc4a33f791d1bd6d11a55d4e2ef9c91bf8be0ee9d9d4338d123a3da98200" Jul 16 16:59:18.575950 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:59:18.575928 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4bstm_kserve(13d6941c-9ca3-4295-8830-c321dab553c7)\"" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" Jul 16 16:59:20.484031 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:20.483988 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:59:20.484486 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:20.484346 2563 scope.go:117] "RemoveContainer" containerID="a23ecc4a33f791d1bd6d11a55d4e2ef9c91bf8be0ee9d9d4338d123a3da98200" Jul 16 16:59:20.484559 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:59:20.484540 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4bstm_kserve(13d6941c-9ca3-4295-8830-c321dab553c7)\"" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" Jul 16 16:59:25.822404 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:25.822362 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:59:25.976631 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:25.976597 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:59:26.601753 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:26.601719 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:59:26.602121 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:26.602106 2563 scope.go:117] "RemoveContainer" containerID="a23ecc4a33f791d1bd6d11a55d4e2ef9c91bf8be0ee9d9d4338d123a3da98200" Jul 16 16:59:26.602309 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:59:26.602291 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4bstm_kserve(13d6941c-9ca3-4295-8830-c321dab553c7)\"" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" Jul 16 16:59:27.984351 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:27.984315 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:59:31.494271 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.494235 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-4bstm"] Jul 16 16:59:31.528354 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.528319 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-l6qtx"] Jul 16 16:59:31.533946 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.533925 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 16:59:31.540220 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.540194 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-l6qtx"] Jul 16 16:59:31.636396 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.636364 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" event={"ID":"13d6941c-9ca3-4295-8830-c321dab553c7","Type":"ContainerDied","Data":"0d7e395f60123852794abb05371f63d6ec74c4916f281d11193ffd07c48f6135"} Jul 16 16:59:31.636509 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.636422 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d7e395f60123852794abb05371f63d6ec74c4916f281d11193ffd07c48f6135" Jul 16 16:59:31.642650 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.642630 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:59:31.704963 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.704934 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnbhm\" (UniqueName: \"kubernetes.io/projected/d6743f85-821a-4ff3-a9ff-820e8939cd24-kube-api-access-hnbhm\") pod \"kserve-controller-manager-d55957fc4-l6qtx\" (UID: \"d6743f85-821a-4ff3-a9ff-820e8939cd24\") " pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 16:59:31.705086 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.704974 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6743f85-821a-4ff3-a9ff-820e8939cd24-cert\") pod \"kserve-controller-manager-d55957fc4-l6qtx\" (UID: \"d6743f85-821a-4ff3-a9ff-820e8939cd24\") " pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 16:59:31.805845 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.805762 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z472\" (UniqueName: \"kubernetes.io/projected/13d6941c-9ca3-4295-8830-c321dab553c7-kube-api-access-9z472\") pod \"13d6941c-9ca3-4295-8830-c321dab553c7\" (UID: \"13d6941c-9ca3-4295-8830-c321dab553c7\") " Jul 16 16:59:31.805845 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.805798 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13d6941c-9ca3-4295-8830-c321dab553c7-cert\") pod \"13d6941c-9ca3-4295-8830-c321dab553c7\" (UID: \"13d6941c-9ca3-4295-8830-c321dab553c7\") " Jul 16 16:59:31.806047 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.806029 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnbhm\" (UniqueName: \"kubernetes.io/projected/d6743f85-821a-4ff3-a9ff-820e8939cd24-kube-api-access-hnbhm\") pod \"kserve-controller-manager-d55957fc4-l6qtx\" (UID: \"d6743f85-821a-4ff3-a9ff-820e8939cd24\") " pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 16:59:31.806106 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.806084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6743f85-821a-4ff3-a9ff-820e8939cd24-cert\") pod \"kserve-controller-manager-d55957fc4-l6qtx\" (UID: \"d6743f85-821a-4ff3-a9ff-820e8939cd24\") " pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 16:59:31.807920 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.807889 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13d6941c-9ca3-4295-8830-c321dab553c7-cert" (OuterVolumeSpecName: "cert") pod "13d6941c-9ca3-4295-8830-c321dab553c7" (UID: "13d6941c-9ca3-4295-8830-c321dab553c7"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:59:31.808049 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.807990 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d6941c-9ca3-4295-8830-c321dab553c7-kube-api-access-9z472" (OuterVolumeSpecName: "kube-api-access-9z472") pod "13d6941c-9ca3-4295-8830-c321dab553c7" (UID: "13d6941c-9ca3-4295-8830-c321dab553c7"). InnerVolumeSpecName "kube-api-access-9z472". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:59:31.808426 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.808398 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6743f85-821a-4ff3-a9ff-820e8939cd24-cert\") pod \"kserve-controller-manager-d55957fc4-l6qtx\" (UID: \"d6743f85-821a-4ff3-a9ff-820e8939cd24\") " pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 16:59:31.817165 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.817145 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnbhm\" (UniqueName: \"kubernetes.io/projected/d6743f85-821a-4ff3-a9ff-820e8939cd24-kube-api-access-hnbhm\") pod \"kserve-controller-manager-d55957fc4-l6qtx\" (UID: \"d6743f85-821a-4ff3-a9ff-820e8939cd24\") " pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 16:59:31.846296 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.846272 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 16:59:31.907839 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.907813 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z472\" (UniqueName: \"kubernetes.io/projected/13d6941c-9ca3-4295-8830-c321dab553c7-kube-api-access-9z472\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:59:31.907953 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.907841 2563 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13d6941c-9ca3-4295-8830-c321dab553c7-cert\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\"" Jul 16 16:59:31.976340 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:31.976197 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-l6qtx"] Jul 16 16:59:31.978929 ip-10-0-140-61 kubenswrapper[2563]: W0716 16:59:31.978904 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6743f85_821a_4ff3_a9ff_820e8939cd24.slice/crio-f0875c11da3ce298365018ed8e93a4d776b0f3eb24a2fc2ecd597a7d242ab740 WatchSource:0}: Error finding container f0875c11da3ce298365018ed8e93a4d776b0f3eb24a2fc2ecd597a7d242ab740: Status 404 returned error can't find the container with id f0875c11da3ce298365018ed8e93a4d776b0f3eb24a2fc2ecd597a7d242ab740 Jul 16 16:59:32.642761 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:32.642684 2563 generic.go:356] "Generic (PLEG): container finished" podID="d6743f85-821a-4ff3-a9ff-820e8939cd24" containerID="bdee2b0f2f3a485cfeed77d94e3b2a514b846ba7290a7ad2612690554db53a1b" exitCode=1 Jul 16 16:59:32.643128 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:32.642777 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" event={"ID":"d6743f85-821a-4ff3-a9ff-820e8939cd24","Type":"ContainerDied","Data":"bdee2b0f2f3a485cfeed77d94e3b2a514b846ba7290a7ad2612690554db53a1b"} Jul 16 16:59:32.643128 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:32.642824 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" event={"ID":"d6743f85-821a-4ff3-a9ff-820e8939cd24","Type":"ContainerStarted","Data":"f0875c11da3ce298365018ed8e93a4d776b0f3eb24a2fc2ecd597a7d242ab740"} Jul 16 16:59:32.643128 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:32.642863 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55957fc4-4bstm" Jul 16 16:59:32.643128 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:32.642964 2563 scope.go:117] "RemoveContainer" containerID="bdee2b0f2f3a485cfeed77d94e3b2a514b846ba7290a7ad2612690554db53a1b" Jul 16 16:59:32.677177 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:32.677152 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-4bstm"] Jul 16 16:59:32.682787 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:32.682767 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-4bstm"] Jul 16 16:59:33.604785 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:33.604742 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" path="/var/lib/kubelet/pods/13d6941c-9ca3-4295-8830-c321dab553c7/volumes" Jul 16 16:59:33.649378 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:33.649344 2563 generic.go:356] "Generic (PLEG): container finished" podID="d6743f85-821a-4ff3-a9ff-820e8939cd24" containerID="f565830226787b7278d037834aab40364d16f78bbc3059cc11e736aec3a05059" exitCode=1 Jul 16 16:59:33.649846 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:33.649419 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" event={"ID":"d6743f85-821a-4ff3-a9ff-820e8939cd24","Type":"ContainerDied","Data":"f565830226787b7278d037834aab40364d16f78bbc3059cc11e736aec3a05059"} Jul 16 16:59:33.649846 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:33.649483 2563 scope.go:117] "RemoveContainer" containerID="bdee2b0f2f3a485cfeed77d94e3b2a514b846ba7290a7ad2612690554db53a1b" Jul 16 16:59:33.649846 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:33.649726 2563 scope.go:117] "RemoveContainer" containerID="f565830226787b7278d037834aab40364d16f78bbc3059cc11e736aec3a05059" Jul 16 16:59:33.649996 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:59:33.649937 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 16:59:34.237744 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:34.237707 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:59:34.339963 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:34.339888 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 16:59:34.655298 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:34.655232 2563 scope.go:117] "RemoveContainer" containerID="f565830226787b7278d037834aab40364d16f78bbc3059cc11e736aec3a05059" Jul 16 16:59:34.655643 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:59:34.655381 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 16:59:36.846401 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:36.846369 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 16:59:36.846806 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:36.846706 2563 scope.go:117] "RemoveContainer" containerID="f565830226787b7278d037834aab40364d16f78bbc3059cc11e736aec3a05059" Jul 16 16:59:36.846888 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:59:36.846869 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 16:59:41.846939 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:41.846909 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 16:59:41.847291 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:41.847260 2563 scope.go:117] "RemoveContainer" containerID="f565830226787b7278d037834aab40364d16f78bbc3059cc11e736aec3a05059" Jul 16 16:59:41.847440 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:59:41.847420 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 16:59:52.599722 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:52.599693 2563 scope.go:117] "RemoveContainer" containerID="f565830226787b7278d037834aab40364d16f78bbc3059cc11e736aec3a05059" Jul 16 16:59:53.740646 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:53.740611 2563 generic.go:356] "Generic (PLEG): container finished" podID="d6743f85-821a-4ff3-a9ff-820e8939cd24" containerID="a0a043b1408141078c88d44031dde7fee109d3455529c08a41e2f8b3ab8590de" exitCode=1 Jul 16 16:59:53.741099 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:53.740689 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" event={"ID":"d6743f85-821a-4ff3-a9ff-820e8939cd24","Type":"ContainerDied","Data":"a0a043b1408141078c88d44031dde7fee109d3455529c08a41e2f8b3ab8590de"} Jul 16 16:59:53.741099 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:53.740760 2563 scope.go:117] "RemoveContainer" containerID="f565830226787b7278d037834aab40364d16f78bbc3059cc11e736aec3a05059" Jul 16 16:59:53.741099 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:53.741081 2563 scope.go:117] "RemoveContainer" containerID="a0a043b1408141078c88d44031dde7fee109d3455529c08a41e2f8b3ab8590de" Jul 16 16:59:53.741267 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:59:53.741245 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 16:59:56.847077 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:56.847048 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 16:59:56.847547 ip-10-0-140-61 kubenswrapper[2563]: I0716 16:59:56.847327 2563 scope.go:117] "RemoveContainer" containerID="a0a043b1408141078c88d44031dde7fee109d3455529c08a41e2f8b3ab8590de" Jul 16 16:59:56.847547 ip-10-0-140-61 kubenswrapper[2563]: E0716 16:59:56.847488 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:00:01.846678 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:01.846646 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 17:00:01.847052 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:01.847000 2563 scope.go:117] "RemoveContainer" containerID="a0a043b1408141078c88d44031dde7fee109d3455529c08a41e2f8b3ab8590de" Jul 16 17:00:01.847168 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:00:01.847151 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:00:16.599648 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:16.599614 2563 scope.go:117] "RemoveContainer" containerID="a0a043b1408141078c88d44031dde7fee109d3455529c08a41e2f8b3ab8590de" Jul 16 17:00:19.068694 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:19.068653 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 17:00:19.126159 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:19.126120 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 17:00:19.860068 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:19.860036 2563 generic.go:356] "Generic (PLEG): container finished" podID="d6743f85-821a-4ff3-a9ff-820e8939cd24" containerID="e940bf64e48c040ece75a9c679010b1a0b3809a5e03efac62302a60b62bbc8f5" exitCode=1 Jul 16 17:00:19.860266 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:19.860115 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" event={"ID":"d6743f85-821a-4ff3-a9ff-820e8939cd24","Type":"ContainerDied","Data":"e940bf64e48c040ece75a9c679010b1a0b3809a5e03efac62302a60b62bbc8f5"} Jul 16 17:00:19.860266 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:19.860182 2563 scope.go:117] "RemoveContainer" containerID="a0a043b1408141078c88d44031dde7fee109d3455529c08a41e2f8b3ab8590de" Jul 16 17:00:19.860522 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:19.860508 2563 scope.go:117] "RemoveContainer" containerID="e940bf64e48c040ece75a9c679010b1a0b3809a5e03efac62302a60b62bbc8f5" Jul 16 17:00:19.860756 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:00:19.860737 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:00:21.846486 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:21.846444 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 17:00:21.846943 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:21.846509 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 17:00:21.846943 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:21.846821 2563 scope.go:117] "RemoveContainer" containerID="e940bf64e48c040ece75a9c679010b1a0b3809a5e03efac62302a60b62bbc8f5" Jul 16 17:00:21.847031 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:00:21.846985 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:00:32.396534 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:32.396490 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 17:00:36.599934 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:36.599900 2563 scope.go:117] "RemoveContainer" containerID="e940bf64e48c040ece75a9c679010b1a0b3809a5e03efac62302a60b62bbc8f5" Jul 16 17:00:36.600375 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:00:36.600156 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:00:50.599885 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:00:50.599856 2563 scope.go:117] "RemoveContainer" containerID="e940bf64e48c040ece75a9c679010b1a0b3809a5e03efac62302a60b62bbc8f5" Jul 16 17:00:50.600351 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:00:50.600032 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:01:03.601898 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:01:03.601872 2563 scope.go:117] "RemoveContainer" containerID="e940bf64e48c040ece75a9c679010b1a0b3809a5e03efac62302a60b62bbc8f5" Jul 16 17:01:08.082481 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:01:08.082448 2563 generic.go:356] "Generic (PLEG): container finished" podID="d6743f85-821a-4ff3-a9ff-820e8939cd24" containerID="dc01bfb47c136b2a142878e16c5e5c616316b20e2043c19ebcb0f9eae32a7a1a" exitCode=1 Jul 16 17:01:08.082967 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:01:08.082515 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" event={"ID":"d6743f85-821a-4ff3-a9ff-820e8939cd24","Type":"ContainerDied","Data":"dc01bfb47c136b2a142878e16c5e5c616316b20e2043c19ebcb0f9eae32a7a1a"} Jul 16 17:01:08.082967 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:01:08.082590 2563 scope.go:117] "RemoveContainer" containerID="e940bf64e48c040ece75a9c679010b1a0b3809a5e03efac62302a60b62bbc8f5" Jul 16 17:01:08.082967 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:01:08.082876 2563 scope.go:117] "RemoveContainer" containerID="dc01bfb47c136b2a142878e16c5e5c616316b20e2043c19ebcb0f9eae32a7a1a" Jul 16 17:01:08.083137 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:01:08.083112 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:01:11.846838 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:01:11.846807 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 17:01:11.847267 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:01:11.846860 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 17:01:11.847267 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:01:11.847115 2563 scope.go:117] "RemoveContainer" containerID="dc01bfb47c136b2a142878e16c5e5c616316b20e2043c19ebcb0f9eae32a7a1a" Jul 16 17:01:11.847336 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:01:11.847266 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:01:23.601529 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:01:23.601499 2563 scope.go:117] "RemoveContainer" containerID="dc01bfb47c136b2a142878e16c5e5c616316b20e2043c19ebcb0f9eae32a7a1a" Jul 16 17:01:23.601932 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:01:23.601729 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:01:35.604744 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:01:35.604718 2563 scope.go:117] "RemoveContainer" containerID="dc01bfb47c136b2a142878e16c5e5c616316b20e2043c19ebcb0f9eae32a7a1a" Jul 16 17:01:35.605127 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:01:35.604877 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:01:46.599816 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:01:46.599789 2563 scope.go:117] "RemoveContainer" containerID="dc01bfb47c136b2a142878e16c5e5c616316b20e2043c19ebcb0f9eae32a7a1a" Jul 16 17:01:46.600250 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:01:46.599958 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:01:57.599682 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:01:57.599650 2563 scope.go:117] "RemoveContainer" containerID="dc01bfb47c136b2a142878e16c5e5c616316b20e2043c19ebcb0f9eae32a7a1a" Jul 16 17:01:57.600134 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:01:57.599829 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:02:11.599070 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:11.599038 2563 scope.go:117] "RemoveContainer" containerID="dc01bfb47c136b2a142878e16c5e5c616316b20e2043c19ebcb0f9eae32a7a1a" Jul 16 17:02:11.599689 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:02:11.599207 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:02:13.538779 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:13.538751 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-txmzt_7b1ce2c6-8921-4e94-908f-b1f88eafa433/console-operator/1.log" Jul 16 17:02:13.544505 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:13.544483 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/ovn-acl-logging/0.log" Jul 16 17:02:13.548788 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:13.548770 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-txmzt_7b1ce2c6-8921-4e94-908f-b1f88eafa433/console-operator/1.log" Jul 16 17:02:13.554309 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:13.554288 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/ovn-acl-logging/0.log" Jul 16 17:02:25.599273 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:25.599245 2563 scope.go:117] "RemoveContainer" containerID="dc01bfb47c136b2a142878e16c5e5c616316b20e2043c19ebcb0f9eae32a7a1a" Jul 16 17:02:25.601536 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:02:25.599408 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:02:36.599130 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:36.599061 2563 scope.go:117] "RemoveContainer" containerID="dc01bfb47c136b2a142878e16c5e5c616316b20e2043c19ebcb0f9eae32a7a1a" Jul 16 17:02:36.599462 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:36.599394 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 17:02:39.504719 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:39.504687 2563 generic.go:356] "Generic (PLEG): container finished" podID="d6743f85-821a-4ff3-a9ff-820e8939cd24" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" exitCode=1 Jul 16 17:02:39.505112 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:39.504754 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" event={"ID":"d6743f85-821a-4ff3-a9ff-820e8939cd24","Type":"ContainerDied","Data":"5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d"} Jul 16 17:02:39.505112 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:39.504811 2563 scope.go:117] "RemoveContainer" containerID="dc01bfb47c136b2a142878e16c5e5c616316b20e2043c19ebcb0f9eae32a7a1a" Jul 16 17:02:39.505225 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:39.505117 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:02:39.505323 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:02:39.505304 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:02:41.847008 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:41.846974 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 17:02:41.847440 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:41.847032 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 17:02:41.847440 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:41.847353 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:02:41.847528 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:02:41.847509 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:02:57.605031 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:02:57.605001 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:02:57.605594 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:02:57.605166 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:03:11.599526 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:03:11.599494 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:03:11.600005 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:03:11.599739 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:03:26.599797 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:03:26.599757 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:03:26.600303 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:03:26.599933 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:03:38.599769 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:03:38.599741 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:03:38.600216 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:03:38.599897 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:03:50.599970 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:03:50.599934 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:03:50.600460 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:03:50.600122 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:04:01.599861 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:04:01.599832 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:04:01.600317 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:04:01.600003 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:04:12.599633 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:04:12.599544 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:04:12.600049 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:04:12.599762 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:04:27.599331 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:04:27.599296 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:04:27.599815 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:04:27.599497 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:04:34.826258 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:04:34.826225 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 17:04:38.624581 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:04:38.624529 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 17:04:41.599803 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:04:41.599768 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:04:41.600290 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:04:41.599956 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:04:46.169581 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:04:46.169547 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 17:04:55.599240 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:04:55.599207 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:04:55.599647 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:04:55.599406 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:04:57.252466 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:04:57.252426 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 17:04:57.418795 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:04:57.418766 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 17:04:57.523088 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:04:57.523014 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 17:05:00.501340 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:00.501306 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k4c97_affdec92-dfd2-49b0-878a-4ef13cc5bfa0/global-pull-secret-syncer/0.log" Jul 16 17:05:00.550835 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:00.550814 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" Jul 16 17:05:00.695946 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:00.695921 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-61.ec2.internal_5c90a46431eae6b3cdd7f5745d0d2187/haproxy/0.log" Jul 16 17:05:02.894829 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:02.894799 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 17:05:03.008204 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:03.008165 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 17:05:05.145777 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:05.145738 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-ll8zj_82f2686c-d513-41f0-aa83-24d31354bba3/cluster-monitoring-operator/0.log" Jul 16 17:05:05.181196 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:05.181173 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-7kgbv_aa69d716-f6c9-4dc4-8d12-a7d9846a7072/kube-state-metrics/0.log" Jul 16 17:05:05.210666 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:05.210634 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-7kgbv_aa69d716-f6c9-4dc4-8d12-a7d9846a7072/kube-rbac-proxy-main/0.log" Jul 16 17:05:05.242640 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:05.242615 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-7kgbv_aa69d716-f6c9-4dc4-8d12-a7d9846a7072/kube-rbac-proxy-self/0.log" Jul 16 17:05:05.280535 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:05.280500 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-868d7b44c7-gnccp_d74f47d8-8a86-483b-8654-287101e9b491/metrics-server/0.log" Jul 16 17:05:05.313370 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:05.313343 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-wqnhs_b1317aca-0b0c-49a2-b48a-53b8e54b3a2b/monitoring-plugin/0.log" Jul 16 17:05:05.349432 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:05.349397 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ngfqh_397d19fc-89cc-44cc-a138-5e6370deb80e/node-exporter/0.log" Jul 16 17:05:05.381643 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:05.381615 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ngfqh_397d19fc-89cc-44cc-a138-5e6370deb80e/kube-rbac-proxy/0.log" Jul 16 17:05:05.410275 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:05.410201 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ngfqh_397d19fc-89cc-44cc-a138-5e6370deb80e/init-textfile/0.log" Jul 16 17:05:06.059159 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:06.059134 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dcf46ddc4-n4hqd_712f4548-5663-452d-a69c-6a60e5456526/telemeter-client/0.log" Jul 16 17:05:06.107789 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:06.107766 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dcf46ddc4-n4hqd_712f4548-5663-452d-a69c-6a60e5456526/reload/0.log" Jul 16 17:05:06.146090 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:06.146064 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5dcf46ddc4-n4hqd_712f4548-5663-452d-a69c-6a60e5456526/kube-rbac-proxy/0.log" Jul 16 17:05:06.193480 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:06.193456 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dcfbccd5d-b52gz_2b9a13f6-156c-4bad-b2d5-e436438d28cb/thanos-query/0.log" Jul 16 17:05:06.229176 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:06.229157 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dcfbccd5d-b52gz_2b9a13f6-156c-4bad-b2d5-e436438d28cb/kube-rbac-proxy-web/0.log" Jul 16 17:05:06.275732 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:06.275715 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dcfbccd5d-b52gz_2b9a13f6-156c-4bad-b2d5-e436438d28cb/kube-rbac-proxy/0.log" Jul 16 17:05:06.314685 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:06.314630 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dcfbccd5d-b52gz_2b9a13f6-156c-4bad-b2d5-e436438d28cb/prom-label-proxy/0.log" Jul 16 17:05:06.342873 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:06.342857 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dcfbccd5d-b52gz_2b9a13f6-156c-4bad-b2d5-e436438d28cb/kube-rbac-proxy-rules/0.log" Jul 16 17:05:06.374183 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:06.374161 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dcfbccd5d-b52gz_2b9a13f6-156c-4bad-b2d5-e436438d28cb/kube-rbac-proxy-metrics/0.log" Jul 16 17:05:06.599747 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:06.599670 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:05:06.599928 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:05:06.599906 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:05:08.027578 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.027532 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-txmzt_7b1ce2c6-8921-4e94-908f-b1f88eafa433/console-operator/1.log" Jul 16 17:05:08.031871 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.031849 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-txmzt_7b1ce2c6-8921-4e94-908f-b1f88eafa433/console-operator/2.log" Jul 16 17:05:08.387814 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.387735 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg"] Jul 16 17:05:08.388137 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.388125 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" containerName="manager" Jul 16 17:05:08.388182 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.388139 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" containerName="manager" Jul 16 17:05:08.388182 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.388152 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" containerName="manager" Jul 16 17:05:08.388182 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.388158 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" containerName="manager" Jul 16 17:05:08.388182 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.388176 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" containerName="manager" Jul 16 17:05:08.388182 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.388181 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" containerName="manager" Jul 16 17:05:08.388330 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.388232 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" containerName="manager" Jul 16 17:05:08.388330 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.388239 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" containerName="manager" Jul 16 17:05:08.388330 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.388247 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="13d6941c-9ca3-4295-8830-c321dab553c7" containerName="manager" Jul 16 17:05:08.391042 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.391027 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.392909 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.392888 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wrnvb\"/\"openshift-service-ca.crt\"" Jul 16 17:05:08.392909 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.392901 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wrnvb\"/\"kube-root-ca.crt\"" Jul 16 17:05:08.393266 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.393251 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wrnvb\"/\"default-dockercfg-l6vlz\"" Jul 16 17:05:08.400081 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.400058 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg"] Jul 16 17:05:08.472998 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.472968 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e366cc6c-89b5-4f74-8a51-6bba5c73c925-proc\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.473151 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.473024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e366cc6c-89b5-4f74-8a51-6bba5c73c925-sys\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.473151 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.473049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8djm5\" (UniqueName: \"kubernetes.io/projected/e366cc6c-89b5-4f74-8a51-6bba5c73c925-kube-api-access-8djm5\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.473151 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.473070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e366cc6c-89b5-4f74-8a51-6bba5c73c925-lib-modules\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.473151 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.473086 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e366cc6c-89b5-4f74-8a51-6bba5c73c925-podres\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.489791 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.489767 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75d44d7ddb-k4q9w_808d38da-7231-4738-890b-a7295ffd02ec/console/0.log" Jul 16 17:05:08.574271 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.574241 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e366cc6c-89b5-4f74-8a51-6bba5c73c925-sys\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.574441 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.574276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djm5\" (UniqueName: \"kubernetes.io/projected/e366cc6c-89b5-4f74-8a51-6bba5c73c925-kube-api-access-8djm5\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.574441 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.574298 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e366cc6c-89b5-4f74-8a51-6bba5c73c925-lib-modules\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.574441 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.574314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e366cc6c-89b5-4f74-8a51-6bba5c73c925-podres\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.574441 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.574363 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e366cc6c-89b5-4f74-8a51-6bba5c73c925-proc\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.574441 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.574377 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e366cc6c-89b5-4f74-8a51-6bba5c73c925-sys\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.574704 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.574444 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e366cc6c-89b5-4f74-8a51-6bba5c73c925-proc\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.574704 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.574464 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e366cc6c-89b5-4f74-8a51-6bba5c73c925-lib-modules\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.574704 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.574488 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e366cc6c-89b5-4f74-8a51-6bba5c73c925-podres\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.582536 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.582517 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8djm5\" (UniqueName: \"kubernetes.io/projected/e366cc6c-89b5-4f74-8a51-6bba5c73c925-kube-api-access-8djm5\") pod \"perf-node-gather-daemonset-vxwxg\" (UID: \"e366cc6c-89b5-4f74-8a51-6bba5c73c925\") " pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.701399 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.701371 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:08.834988 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:08.834967 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg"] Jul 16 17:05:08.837249 ip-10-0-140-61 kubenswrapper[2563]: W0716 17:05:08.837220 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode366cc6c_89b5_4f74_8a51_6bba5c73c925.slice/crio-3973da9bf648c71c6104500999ceefb877b8da700bf9685731574867a7c0dbb0 WatchSource:0}: Error finding container 3973da9bf648c71c6104500999ceefb877b8da700bf9685731574867a7c0dbb0: Status 404 returned error can't find the container with id 3973da9bf648c71c6104500999ceefb877b8da700bf9685731574867a7c0dbb0 Jul 16 17:05:09.076916 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:09.076886 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-x7x28_ba7a0d6f-5c2f-4ba1-989c-36718a369e34/volume-data-source-validator/0.log" Jul 16 17:05:09.184749 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:09.184716 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" event={"ID":"e366cc6c-89b5-4f74-8a51-6bba5c73c925","Type":"ContainerStarted","Data":"4a648c06c2aa7ec4c160ad885074c72949b30ef189ce7dba1126ba0460ef460a"} Jul 16 17:05:09.184908 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:09.184767 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" event={"ID":"e366cc6c-89b5-4f74-8a51-6bba5c73c925","Type":"ContainerStarted","Data":"3973da9bf648c71c6104500999ceefb877b8da700bf9685731574867a7c0dbb0"} Jul 16 17:05:09.184908 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:09.184795 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:09.201889 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:09.201838 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" podStartSLOduration=1.201825133 podStartE2EDuration="1.201825133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:05:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:05:09.199109455 +0000 UTC m=+776.122349647" watchObservedRunningTime="2026-07-16 17:05:09.201825133 +0000 UTC m=+776.125065323" Jul 16 17:05:10.144991 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:10.144965 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w5lkh_03ee3d74-6c5d-43fc-acec-8310503383ba/dns/0.log" Jul 16 17:05:10.186585 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:10.186535 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w5lkh_03ee3d74-6c5d-43fc-acec-8310503383ba/kube-rbac-proxy/0.log" Jul 16 17:05:10.229691 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:10.229656 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6mpfx_f89f9cf1-72d8-4f16-b4ac-4816fb07fc4a/dns-node-resolver/0.log" Jul 16 17:05:10.832926 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:10.832901 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6fwnq_e6be25c0-d3f1-449a-9a74-5915c0ac7965/node-ca/0.log" Jul 16 17:05:11.765162 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:11.765138 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68f9b9d6bd-m9kzh_f90ab8e7-db12-47c5-8ef2-fb10b74128b6/router/0.log" Jul 16 17:05:12.155918 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:12.155843 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wks9k_926ee6a5-b8a8-4fe0-b4ea-603be40e3d91/serve-healthcheck-canary/0.log" Jul 16 17:05:12.568604 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:12.568556 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-ghtrx_b0aba567-5292-4d1f-8588-c65d1d31da4a/insights-operator/1.log" Jul 16 17:05:12.568850 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:12.568837 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-ghtrx_b0aba567-5292-4d1f-8588-c65d1d31da4a/insights-operator/0.log" Jul 16 17:05:12.748121 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:12.748095 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xgjjg_2ca12e5e-8790-4541-853b-747c59b63992/kube-rbac-proxy/0.log" Jul 16 17:05:12.773240 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:12.773217 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xgjjg_2ca12e5e-8790-4541-853b-747c59b63992/exporter/0.log" Jul 16 17:05:12.799750 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:12.799718 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xgjjg_2ca12e5e-8790-4541-853b-747c59b63992/extractor/0.log" Jul 16 17:05:14.908712 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:14.908680 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-d55957fc4-l6qtx_d6743f85-821a-4ff3-a9ff-820e8939cd24/manager/5.log" Jul 16 17:05:14.908712 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:14.908712 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-d55957fc4-l6qtx_d6743f85-821a-4ff3-a9ff-820e8939cd24/manager/5.log" Jul 16 17:05:14.966475 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:14.966446 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-kqd84_70d98cc6-c004-49d9-9551-b39280e97e65/seaweedfs/0.log" Jul 16 17:05:15.200107 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:15.200081 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wrnvb/perf-node-gather-daemonset-vxwxg" Jul 16 17:05:15.969893 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:15.969861 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2hd8z_abaee616-fc40-40a2-8415-6c253b3e0c89/konnectivity-agent/0.log" limit=1024 Jul 16 17:05:19.885836 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:19.885787 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-7jrgk_ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2/kube-storage-version-migrator-operator/1.log" Jul 16 17:05:19.886595 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:19.886577 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-7jrgk_ffb5a58e-8679-42d3-a3ea-d4023bf5ccc2/kube-storage-version-migrator-operator/0.log" Jul 16 17:05:20.599942 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:20.599909 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:05:21.248081 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.248053 2563 generic.go:356] "Generic (PLEG): container finished" podID="d6743f85-821a-4ff3-a9ff-820e8939cd24" containerID="7a82d3af5b4b2962292b380941f10e53e280ed0c010dc19b748a21a829e9ef33" exitCode=1 Jul 16 17:05:21.248455 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.248121 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" event={"ID":"d6743f85-821a-4ff3-a9ff-820e8939cd24","Type":"ContainerDied","Data":"7a82d3af5b4b2962292b380941f10e53e280ed0c010dc19b748a21a829e9ef33"} Jul 16 17:05:21.248455 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.248181 2563 scope.go:117] "RemoveContainer" containerID="5be0d89d731fe9ffacc5fa2b5312efea1ff80f565dc01986df321ee6be9b321d" Jul 16 17:05:21.248561 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.248514 2563 scope.go:117] "RemoveContainer" containerID="7a82d3af5b4b2962292b380941f10e53e280ed0c010dc19b748a21a829e9ef33" Jul 16 17:05:21.248788 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:05:21.248767 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:05:21.301298 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.301248 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfdn2_a8749d82-f357-4897-82e5-7a4a02e757f0/kube-multus-additional-cni-plugins/0.log" Jul 16 17:05:21.328282 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.328260 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfdn2_a8749d82-f357-4897-82e5-7a4a02e757f0/egress-router-binary-copy/0.log" Jul 16 17:05:21.355716 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.355699 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfdn2_a8749d82-f357-4897-82e5-7a4a02e757f0/cni-plugins/0.log" Jul 16 17:05:21.380306 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.380289 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfdn2_a8749d82-f357-4897-82e5-7a4a02e757f0/bond-cni-plugin/0.log" Jul 16 17:05:21.404688 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.404670 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfdn2_a8749d82-f357-4897-82e5-7a4a02e757f0/routeoverride-cni/0.log" Jul 16 17:05:21.432740 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.432725 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfdn2_a8749d82-f357-4897-82e5-7a4a02e757f0/whereabouts-cni-bincopy/0.log" Jul 16 17:05:21.455252 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.455230 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfdn2_a8749d82-f357-4897-82e5-7a4a02e757f0/whereabouts-cni/0.log" Jul 16 17:05:21.491036 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.491012 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kpdjj_2d717853-81cb-4975-8c68-fea79c880f46/kube-multus/0.log" Jul 16 17:05:21.647850 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.647781 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p8bxj_616b8d16-1b94-4015-bd70-d3f891934cc0/network-metrics-daemon/0.log" Jul 16 17:05:21.673439 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.673419 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p8bxj_616b8d16-1b94-4015-bd70-d3f891934cc0/kube-rbac-proxy/0.log" Jul 16 17:05:21.846681 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.846651 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 17:05:21.846833 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:21.846710 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" Jul 16 17:05:22.254755 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:22.254728 2563 scope.go:117] "RemoveContainer" containerID="7a82d3af5b4b2962292b380941f10e53e280ed0c010dc19b748a21a829e9ef33" Jul 16 17:05:22.255114 ip-10-0-140-61 kubenswrapper[2563]: E0716 17:05:22.254922 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-l6qtx_kserve(d6743f85-821a-4ff3-a9ff-820e8939cd24)\"" pod="kserve/kserve-controller-manager-d55957fc4-l6qtx" podUID="d6743f85-821a-4ff3-a9ff-820e8939cd24" Jul 16 17:05:22.753096 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:22.753069 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/ovn-controller/0.log" Jul 16 17:05:22.779550 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:22.779526 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/ovn-acl-logging/0.log" Jul 16 17:05:22.779550 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:22.779546 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/ovn-acl-logging/1.log" Jul 16 17:05:22.800999 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:22.800977 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/kube-rbac-proxy-node/0.log" Jul 16 17:05:22.829222 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:22.829204 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/kube-rbac-proxy-ovn-metrics/0.log" Jul 16 17:05:22.856952 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:22.856912 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/northd/0.log" Jul 16 17:05:22.884308 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:22.884292 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/nbdb/0.log" Jul 16 17:05:22.910415 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:22.910399 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/sbdb/0.log" Jul 16 17:05:22.955012 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:22.954991 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8z9j_fb69eacb-ddea-492f-93e0-91625661c1e3/ovnkube-controller/0.log" Jul 16 17:05:24.238298 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:24.238274 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-869dcfcdcd-4vknj_5bd4a1b4-0c76-460c-9b8c-069f9242dd29/check-endpoints/0.log" Jul 16 17:05:24.311704 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:24.311680 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2ltgt_ca5e32e7-3eaa-4aa2-80b2-aff9c2fd3d54/network-check-target-container/0.log" Jul 16 17:05:25.360958 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:25.360882 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-zr6qr_3e99c497-e769-4773-8777-6643fafc9bb6/iptables-alerter/0.log" Jul 16 17:05:26.095245 ip-10-0-140-61 kubenswrapper[2563]: I0716 17:05:26.095214 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-zxjhw_eb57aa64-5197-46a7-ae33-4b2f8e9817de/tuned/0.log"